Moderator selection criteria

This document was created by the @forums-governance team as a result of the identified need of providing transparency and clarity on how decisions around the selection of moderators are made.

It aims to summarize the process and requirements for the community to suggest and validate new moderators on these forums.

This is version 1.1. It was approved on 2023-11-30.

Note: The intention is to come up with good-enough guidelines that have general consensus and that are expected to keep improving over time.

OSM Forums - Moderator selection criteria

Requirements

In order for a person to be a forum or category moderator, they would need to fulfill the following requirements:

  • Actively contributing in the community conversations at least in the last 6 months.
  • No active bans or sanctions because of past misbehavior or abuse.
  • Good record of being exemplary, treating others with kindness.
  • Disclosure of relevant affiliations and willingness to follow the OSMF WG Conflict of Interest Policy
  • Commitment to fulfill the role responsibilities (see below)

On-boarding and responsibilities

By putting themselves forward for a category moderator position, candidates commit to:

  • Proactive Moderation: Stay active and regularly monitor conversations and community flags.
  • Incident Response: Follow and enforce the category and forum etiquette guidelines.

They will be provided with detailed moderator guidelines with clear examples on how to deal with common tasks and recommendations for difficult situations. The rest of the moderators will help on-board new members and will provide peer-support.

The primary responsibility of site moderators is to implement sanctions that require higher account privileges, which they would do upon request by category moderators. Site moderators should generally not exercise their elevated privileges on their own initiative or within a category they moderate as category moderators. However, site moderators can act as a backup if a category moderator team is falling behind on handling flags.

New moderators process for new categories

Please note the requirements above before suggesting a new moderator.

Communities and users can suggest new moderators by opening a new topic in the ā€œNew category requestā€ category. Candidates suggested will need to reply on the topic sharing that they are OK being candidates.

The proposed moderator team as a whole will be confirmed by a discussion and poll as described below.

Approved moderators will be added to the corresponding groups by the forum governance team.

Applications for site moderator status

Any user who is already moderator in at least one category is eligible to (additionally) become a site moderator. They can volunteer for the role at any time and are confirmed individually through a discussion and poll as described below.

Health-checks

At any time

If any moderator stops fulfilling any of the points in the requirements list at any time, anyone can flag it privately to the @forums-governance team. The team may respond by removing the userā€™s moderator status.

Yearly

Once a year, communities will be encouraged to check on their current moderatorsā€™ status, open for public comments for 7 days. New mods needed, or rotation on the ones no longer fulfilling requirements can be communicated as a new topic here.

In case of conflict

In cases where the evaluation of requirements fulfillment turn not to be obvious, the forums governance team will use a poll with the community to decide whether to grant/revoke moderator status.

Polls

Polls are used during category creation, during applications for site moderator status, and sometimes during health checks.

They are preceded by a community discussion which is open for at least 5 days (always including weekend days), allowing anyone in the community to share their thoughts and additional suggestions.

After these 5 days, a public forum poll will be called to (Approve, Reject) the candidate or list of candidates.

The poll will be open for another 5 days (always including weekend days), and it will be approved with least 80% of ā€œYesā€ votes.

Voters are encouraged to comment on the topic explaining the reasons for their votes.

Special note on existing moderators

Since some category moderators have been added before this new process was in place, we will be running a ā€œNew moderators process for new categoriesā€ (described above) in 3 monthsā€™ time (December 10th) to re-validate their roles.

5 Likes

maybe make clear that activity on old forum also counts?

2 Likes

that is quite high and likely to fail

also, sooner or later there will be bunch of multiaccounts voting no

what happens if vote fails without anyone giving reason to oppose? Is vote anonymous?

Since community conversations happen in many channels, I would say activity in any community communication channel should count (Forums, mailing list, telegram, matrix,ircā€¦others)

1 Like

@Firefishy shared that we should be able to identify multi-accounts easily.

In this proposal, public voting mean public poll here, which show who voted what.

1 Like
  1. Many communities are local/national, with members not necessarily speaking English, and not reading anything outside the community. I think this calls for running discussions, votes and healthchecks within the community category, not in the ā€œNew category requestā€ category. And in local language.
  2. Why, when proposing a new moderator, the poll is on the list of moderators? Wouldnā€™t it be better if the vote was for every proposed moderator separately?
  3. I donā€™t know the other communities, but itā€™s quite common in old Polish forum that people read it once a week. I would suggest extending the time for discussion and polls up to two weeks.
2 Likes

Nevertheless 80% is high. This means four times more people accepting the moderator and caring to vote than people that donā€™t want this particular moderator for any reason. This may result in leaving a community without a moderator, come some trolls.

And oh, I have seen trollsā€¦

We could simply stand at standard 50%+1 vote or I can come up with some more or less complicated formula to make it hard to go below some preferred number of moderators for a community.

2 Likes

I think the most important thing is that moderators overstepping their
mandate can be recalled quickly and easily enough. It is ok for me if a
moderator only has 51% support when starting their work, but if at any
later time more than 20% of participants are unhappy with the
moderatorā€™s work they need to go. There will always be some people
unhappy with a moderator (including the trolls of which you speak) but
if 20% are unhappy then the moderator is not the right person for the jobā€¦

4 Likes

Sure. Provided that we are talking about 20% of all the community members, not 20% of people who took part in the poll. Because otherwise people not caring to vote will make removing any moderator possible.

2 Likes

Thanks for the feedback @rmikke

Yes, it should be clarified. A mechanism to coordinate all categories to open the evaluation period at the same time (and maybe sharing a tag for visibility) might be needed I guess.

That possibility was considered when the proposal was drafted, but that introduces a few additional issues:

  • Additional complexity in the voting mechanism and how thatā€™s counted.
  • Adds a ā€œpopularity contestā€ factor thatā€™s known to penalize emerging leadership in open source communities.
  • Adds a personal evaluation factor that penalizes people down-voted, which for some people/personality types is a moral mining issue.
  • Removes the incentive for the community to discuss and come first with an agreed list of people and delegates that to a simple voting without much need of prior discussion.

For those reasons, it was unclear what the benefit of individual voting was introducing vs the potential negative factors that have been observed in other communities using this method.

I donā€™t have a strong opinion here, having categories agreeing and having their moderators approved in 10 days looked reasonable to avoid much delay on getting initially the categories up and running. Not sure whatā€™s the right balance here.

I donā€™t understand. What is more complex in two polls for two moderators, than one?
And the more moderators are on the list, the more probable it is that anyone who dislikes one proposed moderator will vote against the list and in effect the vote will be negative for the whole list.

Nope. We are not talking alternatives here. Itā€™s not ā€œchoose one ofā€, itā€™s yes or no for every proposed moderator. They may all pass. I canā€™t any contest here, no popularity contest in particular.

Yeah, thatā€™s kind of valid point.

Well, if the community came up with an agreed list of people, no poll would be needed at all, would it?
But it would some active group that prepares a list and they would keep hold on the community governance. There are advantages to it, as there would rather not be grudges between moderators from one group, but OTOH community members outside this group may feel underrepresented or manipulated.

Also kind of valid point. Maybe those periods should be shorter when setting up a community. But for established (and larger) communities there is no rush, the community is working anyway and there should be time for less frequent members to react.

3 Likes

Shouldnā€™t it be anonymous?

1 Like

To avoid abuses, trolls and puppet-accounts, the poll is proposed to be public, but feel free to disagree and share if you have flags about it.

1 Like

There are advantages to both anonymous and non-anonymous votings. As the moderators donā€™t have many ways to prosecute people for their voting, I think anonymous voting is not needed.

1 Like

What about situations with a group of trolls (itā€™s common), who during a specific period occupy the conversation and this space, resulting in the desertion of other members? These people would vote for another kind of moderator. Is that an organic evolution we want to allow?

Many people, in a same community, wonā€™t vote if itā€™s not anonymous, because they wonā€™t want to create friction. Typical behaviour in Latam.

2 Likes

I donā€™t have the solution but I really think it could be uncomfortable for many people to vote his way.

That is also true @mapeadora

If anonymous the community wonā€™t have the ability to audit if something weird has happened (like trolls and puppet-accounts).

But I understand some people donā€™t want to be exposed of voting no to a proposal.

Thatā€™s one of the reasons the voting is to the lists created by the community discussion, not individuals.

But maybe there is a middle-ground where both things can be solved. Ideas?

(Note that the poll/voting proposal was to incorporate a mechanisms where the communities themselves can oversee and validate their proposals, which I also understand is complex in an environment where most communities donā€™t have a formalized chapter or members list.)

Well, itā€™s typcal for every community where the government abuses or used to abuse itā€™s position. We have it in Eastern Europe as well.
But I guess if public voting works for wiki , why wouldnā€™t it work here?