Growth: Difference between revisions

Wikimedia Foundation projects Growth Increasing new editor retention in mid-size wikis. Start: 2018-07-01 Team members: Benoît Evellin (community relations specialist), Elena Tonkovidova (senior test engineer), Sergio Gimeno (senior software engineer), Martin Urbanec (senior software engineer), Cynthia Simiyu (software engineer), Morten Warncke-Wang (staff data scientist), Rita Ho (principal user experience designer), Julieta Fernández (user experience designer) Backlog: #Growth-Team Management: Dennis Mburugu (engineering), Kirsten Stoller (senior product manager) Updates: Current project updates Work with us and involve your community Get updates on your talk page!

• The Growth team annual plan details the projects we will work on this year.
• Our current work is documented through Growth team weekly updates
• Sign up for our multilingual newsletter , distributed every two months.

See our past projects | Growth's History and objectives | Deployment table

• Article check
• Non-editing participation
• Engagement emails
• Copyedit
• User profile

To see updates on these initiatives and the specific projects underneath them stay informed!.

• Understanding first day (EditorJourney)
• Personalized first day
  • Welcome survey
  • Newcomer homepage
  • Newcomer tasks
  • Structured tasks
    • Add a link
    • Add an image
    • Add an image, section level
  • Mentor dashboard
• Focus on help desk
  • Help panel
• Positive reinforcement
• Community configuration
• Newcomer Experience Projects

Deployment table

For the purposes of this team, “new contributors” are people who have registered accounts on a wiki project, even if they have not made an edit. To “retain” them means that they make edits and continue to make edits over time. Though we hope that contributors are retained for months and years, we know that they will first have to make it through their first days and weeks. Those first days and weeks are more likely to be the Growth team’s focus.

There are different periods of time over which we can measure retention. One definition might be “second month retention”, meaning a contributor is "retained" if they edit during their first month and also edit during their second month. But another definition might be “second week retention”, meaning a contributor is "retained" if they edit during their first week and also edit during their second week.

As we work, the Growth team will determine which types of retention are most important to track and to increase. See this page for a formal definition of retention.

Wikimedia projects need to have a constant stream of new contributors in order to become hubs for broad and deep content. New contributors replace experienced contributors who stop editing. They also increase the diversity of the editing community. This stream of new editors allows projects to grow their content while increasing the diversity of their content. But in many Wikimedia projects, the number of active contributors is decreasing or staying the same, and the retention rate of new contributors is also decreasing or staying the same. This issue was studied in the 2013 paper The Rise and Decline of an Open Collaboration System: How Wikipedia's reaction to popularity is causing its decline. The authors showed that active contributors in English Wikipedia began to shrink in 2007, with the major cause being increasing technical and cultural barriers for contributors. Since then, similar patterns have been seen in other Wikimedia projects.

Data showing the state of active contributors and contributor retention in Wikimedia projects is forthcoming.

Beyond the high-level numbers themselves, additional research suggests that many new contributors do not reach their full potential because contributing is both technically and culturally complicated. For instance, it is common for excited new contributors to have their first edits reverted or their first pages deleted without an informative explanation. This causes them to be confused and disappointed, and ultimately not to continue editing.

Together, the numbers, research, and stories, mean that we can do better to engage and retain new contributors. In particular, the Wikimedia Foundation decided to focus on mid-size Wikipedias because those projects need to grow their content, have challenges with contributor retention, and there is potential for software to help.

To better understand what causes new contributors to stay and to leave, the Wikimedia Foundation completed the New Editor Experiences research project in 2017.  The project identified the main challenges experienced by new contributors to Wikipedia, and a set of potential solutions.  See the “Challenges” and “Solutions” sections below for the details.

The Growth team formed to take action on the challenges and solutions identified by the research project. We will continue our relationship with the Czech and Korean communities by testing changes in those wikis first. When we discover changes that increase contributor retention, we will engage other communities to consider deploying those changes in more wikis.

Although much valuable research has already been done to help our team understand new editors, important open questions remain. The team records and prioritizes our open questions on this page . We will be deliberate about using research, data, surveys, and feature instrumentation to answer them.

The following is a list of healthy characteristics that we think wikis should exhibit with respect to new contributors.  They are guiding principles for our team, and we hope to help make them a reality in the wikis we work with.

• Diverse contributors lead to wikis with broad and deep content.
• Contributors who want to make useful improvements to a wiki should all be able to find a place in the community where they fit in.
• Contributors should be able to learn to edit on their own.
• Contributors of any skill level should be able to ask for and receive help from other community members.
• Contributors should be able to learn and edit in a supportive and non-confrontational environment.

The mission of the Wikimedia Foundation's Growth team is to support new account holders by designing and building engaging, intuitive, and inclusive products that make it easier to join the Wikimedia movement.

We envision a thriving Wikimedia community where the barrier to entry for contributing to Wikipedia and other Wikimedia projects is lower, allowing more people to successfully become active editors, and advance into roles that require more experience, leading to a sustainable and diverse knowledge commons.

There are challenges that stand in the way of the principles above. The main challenges were identified by the New Editor Experiences research project that was completed in 2017. With the help of Czech and Korean community members, researchers interviewed 64 contributors to Czech and Korean Wikipedias to learn about why they started editing, what they found easy or difficult, and if they've stopped editing, why they stopped. The project surfaced a set of technical, conceptual, and cultural challenges, summarized below (2017 observations). Growth team’s work, along with other Wikimedia Foundation teams, helps wikis overcome these challenges so that the principles can become reality.

• Technical: new contributors struggle with specific skills needed to contribute.
  • Editing: though Visual Editor is helpful for new contributors, it is hard for them to learn the process of building, citing, and publishing.
  • Communication: new contributors have trouble finding and using Talk pages. This is because Talk pages do not use Visual Editor, and because they work differently than other internet discussion systems.
  • Finding help: many wikis have scattered and inconsistent help materials that are difficult for new contributors to find and use.
• Conceptual: new contributors have trouble learning core wiki policies and best practices.  The following are the concepts that are most challenging.
  • Community: many new contributors do not realize there is an active community behind each wiki project.
  • Verifiability and citations: all content must be attributed to reliable sources.
  • Notability: all content must have garnered enough broad attention to deserve an article.
  • Encyclopedic style and neutral point of view: articles should present content without bias toward one side of an argument.
  • Copyright: content should not violate the licensing of its sources.
• Cultural: the wiki environment can be discouraging to new contributors who are trying to find where they fit in.
  • Personas: new contributors have different objectives for why they are editing, but it is hard to figure out how to accomplish them.
  • Framing: the way that contributors communicate impacts whether new contributors stay. Negative feedback can discourage further contribution.

The Growth team will attempt multiple solutions to the above challenges, and we will learn and expand as we go along.  These are the findings from the New Editor Experiences project that will guide the solutions we attempt:

• Intermediaries: many new contributors have succeeded because a partner or mentor helped them learn to edit.  These partners are frequently found in off-wiki places like schools, libraries, or meetups.
• Iterative learning: new contributors have more success when they learn editing skills over time in safe environments.
• Outside help: new contributors frequently search for help outside of Wikipedia, either in off-wiki communications, or through other internet resources.

Those trends lead to two main categories of solutions to the challenges described above.  The work of our team will usually fit into one of these categories:

• Human-to-human help: forums and programs that connect contributors to each other so that experienced contributors can help newer contributors succeed.  This can include help desk forums, mentorship opportunities, or even off-wiki connections.
• In-context help: changes to the Wikipedia editing experience to surface helpful guidance around technical and conceptual challenges.  This is guidance surfaced at the time it is needed, in the place where it is needed -- as opposed to on a separate page that may be difficult to find.

This page contains the list of ideas that the team has considered and discussed with communities.

We want to hear from you! Please check out this guide on engaging with the Growth team!

These are links and research that underpin the background, principles, challenges, and solutions above, and that continue to shape our team’s thinking.

• The Rise and Decline of an Open Collaboration System: How Wikipedia's reaction to popularity is causing its decline
• New Editor Experiences
• Post-registration editor survey
• Formal definitions of editor retention
• Mentoring in Wikipedia: A Clash of Cultures
• Tea & Sympathy: Crafting Positive New User Experiences on Wikipedia
• The original Growth team from 2013 - 2014.
• Research on the impact of the Wikipedia Adventure
• Evaluating the impact of the Wikipedia Teahouse on newcomer socialization and retention
• Accept, decline, postpone: How newcomer productivity is reduced in English Wikipedia by pre-publication review
• The Pipeline of Online Participation Inequalities: The Case of Wikipedia Editing
• Research on New editors' first session and retention
• Fostering Public Good Contributions with Symbolic Awards: A Large-Scale Natural Field Experiment at Wikipedia