Background:
The Catalyst Community Advisor (CA) process serves as an essential and critical element in ensuring that the world’s largest decentralized innovation platform delivers the desired outcomes. Radical inclusivity and very low barriers to entry result in hundreds of CAs from around the globe writing 1,000s of assessments. The “Wisdom of the Crowd” should ensure that the best proposals receive the highest ratings. Studies of past funds demonstrate a strong correlation between high CA rankings and successful funding.
As Catalyst grows, a few challenges with the CA process have emerged. Anonymity, while critical for providing impartial feedback, allows for fake profiles and gaming of the system. Low quality reviews mean extra work for Veteran Community Assessors (vCAs).
-> In Fund7, vCAs excluded 46% of assessments
-> In Fund6, 40% of assessments did not make the cut
As each successive fund grows in size, the CA community must deliver more assessments.
-> Proposers submitted over 1,000 ideas in Fund7, requiring at least 3,000 individual reviews
As more and more proposers submit high quality proposals, the five star rating system does not allow sufficient ranking and prioritization of equally well-conceived proposals.
Importantly, our proposal team has not cataloged these critiques independently or in isolation. Rather, a significant part of the research that led to this proposal involved intensive interaction with the CA community. Kenric Nelson, Catalyst Circle v2 Representative for the CA community built on the initiatives developed by Victor Corcino (CCv1 Rep for CAs), which Nadia Hopkins (CCv3 Rep for CAs) is continuing. Kenric is a co-proposer and core team member, and we continue to work closely with Nadia, particularly the CA Onboarding & Education Initiative she has launched, to ensure that community feedback drives our solution.
Solution - Qualifying Course:
Many proposers, CAs, and vCAs have identified a lack of CA education and understanding as an important reason for low quality reviews. To provide just a couple of examples, CAs confuse challenge-setting proposals with regular proposals, do not understand the requirement to provide feedback in each of the three review sections (Impact, Feasibility, and Auditability), or lack the basic understanding needed to assess more technical proposals. Our team is seeking to address this challenge, while maintaining CAs anonymity and while supporting the philosophy of radical inclusivity by keeping barriers to entry low.
In our proposal, anyone wishing to serve as a CA would attend a brief virtual course. Upon completion of the course, the Educational Institution (EI) offering the course would issue the CA a Verified Credential (VC) that the CA would hold in their decentralized identity wallet. When registering to serve as a CA in the next fund, the CA would present the VC in Ideascale in order to unlock the capacity to write assessments. The CA would then use the VC to sign each assessment they write.
As part of the pilot envisioned in this proposal, we would establish this process only for the Decentralized Identity Challenge (or a related DID challenge. We would measure the impact of the onboarding course by comparing reviews written for proposals in the pilot challenge compared to other challenges, which did not require the onboarding course.
Assuming successful implementation of the pilot, the issuance of VCs to CAs could serve as a building block for many other improvements to the CA process, such as the development of a reputation model, the issuance of credentials identifying specific CA skills and capabilities, and the ability to provide voters with information about a CAs experience while maintaining CA anonymity.
The team has submitted an accompanying proposal, PRISM DIDs for Catalyst (<u>https://cardano.ideascale.com/c/idea/399040</u>), which could support the development of these follow-on initiatives. (Please note the referenced proposal also stands on its own and would support the team’s work on other uses of DIDs to improve the CA process).
Draft Workflow For the Proposed Solution:
- Prospective CA registers with the Educational Institution (EI)
- CA attends and passes the course
- EI issues a “CA” credential (If the CA does not pass the course, no credential is issued)
- CA registers on Ideascale by providing an email address, ADA address, and "CA" credential
- During the assessment phase the CA signs reviews using the “CA” credential
- For a Graphical Illustration of the Proposal Workflow, see slide 9 of the attached deck
The Challenge calls for solutions that support the rapid growth of Cardano. The Catalyst CA Onboarding pilot provides the perfect use-case for implementing PRISM technology. All of the stakeholders are already deeply embedded in the Cardano community and committed to the blockchain’s success. They also already have the basic blockchain understanding and technological skills (use of virtual wallets, ability to attend virtual courses, familiarity with providing blockchain data such as an ADA address) that make adoption of the PRISM solution feasible and likely. There isn’t a better community to target regarding implementation and usage of Atala PRISM.
Catalyst itself is scaling rapidly, in order to support the continued rapid growth of Cardano. As more and more proposals request funding, the community needs to find a way to rapidly scale the CA process, while not compromising on the quality or thoroughness of the reviews. Providing a decentralized identity for CAs would serve as the first building block of a broader reputation system, which would serve as a key feature of achieving the twin goals of scalability and quality.
The Challenge Brief also highlights the need for interoperability, noting that “most digital credentials sit on Hyperledger Indy ledgers.” The ProofSpace team brings deep experience with Hyperledger Indy and already provides SSI capabilities for that ecosystem. This proposal does not require interoperability with Hyperledger, given that all the stakeholders, all credentials, and all activity will occur within the Atala PRISM environment. However, as CAs are beginning to use identity wallets and gaining VCs, it is an important feature that these tools provide interoperability for the next use-cases that will emerge down the road.
The Challenge Brief recognizes the need to create “alternatives to accredited education and career paths” and the importance of “developing technology and governance primitives to support any community that wants to establish new education and career paths.” By delivering a successful model of a decentralized means of issuing education credentials, the CA Onboarding program can serve as an example that other groups and communities can easily replicate.
Risk - The CA community does not agree with the approach
Mitigant - Decentralization and community-led solutions serve as foundational principles for this proposal. As mentioned previously, identification of current problems with the CA process and recommended solutions have come from deep and intensive discussions with the CA community. The proposal team plans to continue close collaboration with the CA community. We are working with Nadia Hopkins (CCv3 Rep for CAs) and participating in initiatives to discuss the process of providing CA education.
Importantly, this proposal team has not yet identified an Educational Institution to provide the onboarding course. The focus of our team involves implementing Atala PRISM technology to support improvements to the CA process. We will continue working with the strong CA community to identify the best partner (or partners) to provide the course, and defer to the CA experts regarding the content of the course and the requirements for a CA to “pass” the course.
Additionally, while an onboarding course may add a very small hurdle for participation, on the other hand, having a completed a course may provide potential CAs with additional confidence to begin writing assessments. Many CAs express hesitation or concern regarding their lack of understanding of the process. Taking a course and receiving a Verified Credential may actually encourage participation from those considering the CA role by providing assurance that they have received the necessary training.
Risk - IOG currently controls the Catalyst process and must agree to any changes
Mitigant - We have been closely discussing this proposal with IOG PRISM (Tony Rose and Anushka Soma-Patel) as well as with the IOG Catalyst team. IOG has indicated initial support, and it appears that integrating PRISM technology into the Catalyst process sits squarely on the IOG Roadmap. While completely in-line with IOG planning, the proposal would provide an important opportunity for the CA community to continue to influence the development and evolution of the CA process.
Risk - The proposal requires several technical implementations with third party systems
Mitigant - Ideascale currently serves as the platform for CA registration and assessment writing. The ProofSpace team is already investigating API documentation and believes integration would be relatively straight-forward. Kenric Nelson has significant experience in overseeing technical integrations and can take the lead in ensuring a smooth process. Similarly, when the COTI team launched a Challenge, the Catalyst updated the CA registration questions to include a field for entering a COTI payment address, so the precedent has been set for making sensible changes to this process.
As an additional benefit, beginning to store data in a decentralized manner, in the CA identity wallets, provides the Catalyst community with more flexibility should we one day decide to move away from Ideascale.
The Educational Institution will also need a virtual platform upon which to offer the course, and will need to have VC-issuing capabilities integrated into that platform. Through additional discussions with Tony Rose, we understand that the PRISM team may have a solution that we could incorporate into our pilot. ProofSpace would be able to work with that platform to provide the integration for VC issuance.
Risk - Atala PRISM is not yet live on mainnet
Mitigant - The ProofSpace team has deep technical experience delivering SSI solutions. IOG has recently provided access to the PRISM SDK, and ProofSpace has received Catalyst funding to build out their PRISM capabilities. The proposal team will continue working closely with IOG to develop a roadmap that fits with the IOG release timeline. If the pilot is ready for integration into Catalyst before the PRISM mainnet launch, it might be possible to launch a Proof of Concept project at a small scale using the testnet, in order to demonstrate feasibility.