Seeking Guidance on Benchmarking OSM POIs Across Different Countries

General talk
1

Hello OSM Community,

I am currently working on a project that involves evaluating the representativeness of OpenStreetMap (OSM) Points of Interest (POIs) across different countries. Specifically, we want to understand how well OSM reflects the underlying volumes and positions of POIs by category on a regional basis.

We want to take a few general categories - Restaurants, Accomodation, Shopping, Entertainment, Health etc

We aim to assess:

  1. Volume: How accurate is the count of POIs in each category compared to other data sources or actual counts?
  2. Position: How reliable are the geographical positions of these POIs?

Key Questions:

  1. What are the best practices and methodologies for benchmarking OSM POIs against other data sources? Are there any established metrics or specific research on evaluating the accuracy of POI volumes and positions?
  2. What external datasets or tools can be used to compare and validate the accuracy of OSM POIs? Are there any platforms or resources that can assist in assessing the quality of POIs in OSM, particularly across different regions or countries?

If anyone has experience or knowledge about benchmarking OSM POIs, particularly in the categories mentioned above, or knows of relevant research, tools, or case studies, your input would be greatly appreciated!

1 Like
2

All The Places is useful external source: https://www.alltheplaces.xyz/
It contains data scraped from brand websites so it won’t contain shops/restaurant which are not part of the chain.
It was partially used as source of at least small-scale imports to OSM so there is probably bias.
I suspect POIs in ATP are much more likely to be in OSM than a random POI.