How about limit new accounts?

I can tell you from experience with vandalism in August, it’s best not to do anything with your hands. Only if after reverts that it was not fixed.

In the Russian community we recommended the following Telegram: Contact @ruosm

  1. While reverts are in progress, do not edit affected names
  2. To redraw the map in the browser after rollbacks, reload the page without cache: Ctrl+F5 or Cmd+Shift+R.
  3. If you notice new cases: go to user profile → Report this User

Also at the link you can also see that we reported the current status of reverts and explained how it works, why vandalism may not disappear from the map for a long time.

2 Likes

A bit off-topic w.r.t. the current issues, but since I haven’t seen it mentioned anywhere: Here are two who have investigated using machine learning to detect vandalism in OSM: https://dl.acm.org/doi/10.1145/3474717.3484204, https://dl.acm.org/doi/fullHtml/10.1145/3485447.3512224 (Preprints: [2203.11087] Ovid: A Machine Learning Approach for Automated Vandalism Detection in OpenStreetMap, [2201.10406] Attention-Based Vandalism Detection in OpenStreetMap), Enriching and validating geographic information on the web. The accuracies are not particularly high, but one issue with such algorithms is the labeling of data, which can only get better if more people are involved. Something like this could serve as another, automated second line of defense (after limiting new accounts / introducing trust models), along with rule-based detections.

1 Like

Another reason why it’s important to reduce the size of edits is the abnormal size of the diffs.

https://prometheus.openstreetmap.org/d/_MGuv5SVk/overpass?orgId=1&viewPanel=12&from=1690408721478&to=1698184721478&refresh=1m

HDYC and OSMCha (if I remember correctly because Overpass was unavailable) became victims of such diffs in the past times. Live-update users in OsmAnd also faced huge updates.

Also, edits with 10k modified objects are very difficult to view quickly and without lags in the change viewer. OSMCha, Achavi, JOSM.


And imagine vandalising not just one person, but several hundred organised on some 4chan or on a video blogger’s stream :jack_o_lantern:

3 Likes

If someone is interested in this topic and wants to help: Limit number of edits per user and day · Issue #2342 · openstreetmap/openstreetmap-website · GitHub mentions that code was deployed to a test server.

By the way, code is already deployed for testing here: https://tomh.apis.dev.openstreetmap.org/
You need to sign up there (your main osm.org account won’t work there), and then try uploading some, or even lots of data.

you can test whether reasonable edits are going through and mass scale vandalism is limited (and error handling in editors and API and so on)

5 Likes

@SomeoneElse Looks like a vandal hacked into another mapper’s account. Be careful during reverts. https://www.openstreetmap.org/user/Silka123/history

We’'ll have a look. Blocked for now, we’ll amend that message with more detail once more detail is know.

At first glance it looks like a case of password-stuffing; and if so it wouldn’t be the first example in OSM. The general advice to avoid this sort of thing is for people to ensure that they don’t share passwords between accounts for different things on the internet (so that if passwords for site A get published, they aren’t useful for site B).

4 Likes

Add the ability to rate limit edits by tomhughes · Pull Request #4319 · openstreetmap/openstreetmap-website · GitHub is now merged

large-scale vandal activity should be now reduced, as large edit volume will be blocked, especially from fresh accounts

note that large scale edits from new accounts may be also affected, but should not affect vast majority of genuine new users

brand new bot/import accounts may need to operate in way dealing with rate limits if editing at huge volume, also old ones may be affected if volume is exceptionally large


Thanks for everyone who contributed!

Note that further changes may be needed to make life harder for vandals. For example abusive use of delete account feature likely should be stopped/reduced.

7 Likes

… and now reverted (by several people, including me in this changeset).

Because there have been several people reverting things at the same time, it’d be really helpful if people could see if there are any examples of problem data still existing?

It’s all right. Here is an overpass query with all the phrases used by the vandal, which I used to check the data now and last time. overpass turbo

2 Likes

There are new phrases. For example, "БОЛEE 310 000… ".

1 Like

Have we blocked that nasty tomhughes yet? :stuck_out_tongue:

1 Like

OK, that is quite funny automatic title generation :slight_smile:

“quite bad”?

With the latest vandalism in mind:
Wouldn’t it be a good idea to also limit the changesets of new accounts in size (area)?
This would make it slightly more difficult to make global vandalism resulting in this massive tile updates we saw the last week.

10 Likes

This keeps re-occurring Vandalismus endeckt ?! - #30 by BrummsLee

While it technically may be expensive to learn how far a node was moved, the area of the edit should be cheap to compute.

3 Likes

This :arrow_up:. Preventing new accounts from creating large geographical changesets is hopefully the simplest and most effective way to prevent large-scale visible vandalism. It would be even better if the editor restricted changes to the new user’s current location, similar to how StreetComplete operates.

1 Like

As much as I enjoy introducing OSM to my neighbors, hoping they’ll join me in improving coverage of Silicon Valley, I also respect that many of them choose to contribute in parts of the world that are comparatively underrepresented, such as through HOT.

StreetComplete asks for your location using Android’s location services. iD can similarly obtain your location from the browser if you click the button to jump to your location. However, it doesn’t ask for this information upfront, because this project has historically determined that sharing your current location should not be a prerequisite to editing the map.

It would be quite ironic if the first-run experience were to consist of, on the one hand, an option to opt out of loading brand logos from Facebook’s CDN to avoid divulging the fact that you can see a McDonald’s in street-level imagery, but on the other hand, a requirement to share your location before proceeding. At the moment, one cannot forever associate a mapper with their whereabouts based on where they made their first edits. It should probably remain that way.

4 Likes

The “editor” in this case is something written by the vandal themselves, so that’s not an approach that’s going to work.

5 Likes

Understood.

What about the idea of “Preventing new accounts from creating large geographical changesets” regardless of location? Sorry if this topic has already been covered, but I am finding it challenging to keep track of all these related discussions. :sweat_smile:

Where to focus from the Editor to the API to the Tile Server ? When such intensive vandalism actions, I suggested before that it would be possible to focus at the API level. I dont know how the API is managed but I supposed that a Detection function could be located before the API adds new data to the database to detect vandalism content and simply ignore such changesets. This function could be triggered when intensive vandalism and adapted to particular situations. New accounts or any other criteria like abusive language or moving nodes km away could be considered.

This might slow the API processing and force OSM contributors to try to resend their changeset if data not uploaded to the database. But there would be less problems to later correct both in the database and the Tile server.

2 Likes