How do I download the entire internet?

General talk
1

OK, I suspect that I don’t need the whole internet, but how can I get every tag for every object for the island of Ireland in text format (txt, CSV, XLSX or similar). I don’t need location data or meta data. I’m looking for them all, because it is often the minority ones that cause problems, e.g. material=storage_tank, addr:housenumber=“,”, building=wall, or building=yesb.

I could run some scripts with Overpass Turbo, but that would be impolite and I don’t want to break the servers.

Skill levels:

  • iD (only) - fairly good.
  • Basic overpass, postpass, taginfo queries - OK.
  • Spreadsheets (yeah, yeah, databases in spreadsheets, sue me :slightly_smiling_face: ) - fairly good.
  • Ability to deal with ‘different’ technology - can be low to very low.
2

You could get an extract of all Irish data (regional extract e.g. from Geofabrik) and then look at the tags, for example with osmium-tool the “cat” command and the opl format (one per line), combine it with “cut” to get only the tags.
Or maybe the Irish regional taginfo is what you actually want?

2 Likes
3

I’m well used to accessing that here: OpenStreetMap Taginfo Ireland and Northern Ireland (there are lots of other options for other countries and regions also).

However, if I look at keys, it runs to 11,000 tags: Keys | OpenStreetMap Taginfo Ireland and Northern Ireland or if I look at tags it has the 861 most frequent tags: Tags | OpenStreetMap Taginfo Ireland and Northern Ireland - however, if a tag is associated with less than 1,000 objects (for the normal Taginfo, this is 10,000 objects).

How do I get all the tags into my table with Taginfo?

4

If you follow Martin’s advice and download the regional extract that contains Ireland you can turn it into a .osm file which is really just a XML text file. From that you can parse it to your heart’s content. A scripting language that understands XML could make it pretty easy but even just a text editor or running grep and sort on the command line would work.

5

Either the regional extract or the https://planet.osm.org/ planet file is what you’re looking for.

6

Taginfo has all tags, it just doesn’t show all of them in the tags table. You can go to the database source page and download the sqlite database file linked from there. That db file contains lots of data and is easy to access with a bit of SQL.

7 Likes