The Developer Advisory Board came into its own this season, maturing from an experiment into a proper board with processes and significant impact on the Collective. It was amazing to see the results over the season, and we have many great ideas to expand that impact in future seasons.
1. What is your assessment of the impact KPIs that were set in your Budget Proposal at the start of the Season?
The KPIs listed at the start of the season were:
-
Did 100% of Protocol Upgrades have a non-technical summary posted within 72 hours and get approval or comments from the DAB? - YES!
-
What NPS score would the Grants Council reviewers provide (answering: “On a scale from 1-10, if it were up to you, how likely would you be to renew the DAB next season?”) - 10/10 (@Gonna.eth)
-
What NPS score would the Citizens give the DAB (answering: “On a scale from 1-10, how much value do you feel the DAB provided the community this season?”) - 6.86/10 (Telegram poll, 15 votes)
-
Did voting participation on Protocol Upgrades increase (including abstains) since the non-technical summaries were implemented? - YES! Average total votes before summaries was 47M, after summaries was 56M, a 19% increase (data)
-
Did the number of milestones missed by grant recipients decrease on DAB-approved grants relative to grants before the DAB? - It’s still too early to tell
-
Did the quality of technical grants chosen increase, as evaluated by members of the OP Labs engineering team? - We were not able to gather this information
2. Impact assessment - how well did your team’s outputs support the Intent they were authorized under?
The DAB charter for this season included: (a) supporting the community in technical decisions like protocol upgrades, (b) supporting the GC in evaluating MR applications and (c) bringing additional technical perspective to the OP ecosystem (and exploring new ways we could support).
On (a): We provided a plain English summary for the protocol upgrade this season. We also met with the OP Labs team to understand their roadmap, and have provided feedback on the Foundation’s Decentralization Roadmap and Product Vision, as well as the implementations of the Custom Gas Token and interop.
On (b): We worked with the GC to provide detailed feedback on 179 Mission Request applications, which has proven to be very helpful in their evaluation process. We have integrated the DAB directly into Charmverse so we can engage directly with teams, and leave comments for the GC to consider. The Grant’s Council has given an NPS score of 10/10 for our help.
On (c): We have hosted community calls to discuss additional ways to support the Collective in future seasons. Some of the big themes will be discussed below in #5. Additionally, many of us served as judges for Retro PGF 5.
All in all, I feel the team was very successful in supporting the Intent.
3. What are the major problems you ran into over the course of the Season?
a) Early in the season, there was some work to hammer out logistics, but since that has all been buttoned up, things have run very smoothly.
b) The big remaining problem is that it seems like there are so many ways the DAB can be helpful to the Collective, and only some of these ideas are being surfaced. Because we can’t see into every area of the organization, it’s hard to identify these opportunities. The community calls have been helpful, but I believe we can do a lot more.
4. What are possible solutions that could be explored next Season?
We’ll continue to work closely with the GC to ensure our workflows fit nicely together, and host community calls to ask for the community’s support in seeing the areas of the Collective where we can provide the most value.
It will also be helpful to integrate more closely with OP Labs, as having a clear vision for the product roadmap and technical details will allow us to serve as a kind of liaison to the community (for example, seeing opportunities for important Mission Requests, advising applicants about how their work fits in with potential future changes, etc.)
5. What improvements to the team’s mandate would you suggest for next Season?
With two seasons under our belts, the clear message seems to be that the DAB has many more ways to be useful, and can take on more responsibility within the Collective. Specifically, we are planning the following for S7:
-
Take over the full program to assess audit requests from the Grants Council.
-
Take full responsibility for selecting the teams that will deliver on Foundation Mission Requests.
-
Take a more active approach to understanding the technical roadmap, and use this understanding to work with the Foundation to craft the rolling Foundation Mission Requests, and with the Grants Council to craft Governance Mission Requests.
-
Experiment with acting as “dev rel for the Collective”, playing a more active role in getting outside developers involved. For example, hosting office hours to help match developers with interesting projects, advising on writing good applications, a link to get in touch at the bottom of all Mission Requests, hosting demo days for completed MRs, etc.
-
Explore an ongoing role for the DAB to help future Retro PGF rounds close the gap between badgeholders and the better results that expert voters achieved in RPGF 5.