Is the historydump tool written by @LarsF open source, and if so does anyone know where I can take a look at the source code? The link given near the bottom of this page seems to be broken (or I’m not allowed!)
This is a blast from the past!
I wrote this over 10 years ago.
I have to admit that I don’t know if I still have the source for this somewhere but I’ll try to remember to take a look when I’m home.
Feel free to ping me next week if I don’t get back to you!
1 Like
I just checked and I’m afraid I can’t find the source anymore.
It’s not on bitbucket anymore, I can’t find it on my harddrive either.
I assume it got lost on some migration.
How important is this?
Code archaeology time!
I checked svn and trac tickets, and there’s no mention of historydump. I also checked chef, and there’s no mentioned going back to when we introduced the public chef repo. Looking at the earliest full history file publicly available, history_2013-02-05_1701.osm.bz2, the XML starts with
<?xml version='1.0' encoding='UTF-8'?><osm version="0.6" generator="OpenStreetMap HistoryDump.java" timestamp="2013-02-05T17:01:47Z" copyright="OpenStreetMap and contributors" attribution="http://www.openstreetmap.org/copyright" license="http://opendatacommons.org/licenses/odbl/1-0/"><bound box="-90,-180,90,180" origin="http://api.openstreetmap.org/api/0.6"/
And yes, it’s one line. The entire file is one very long line.
Looking at history-141222.osm.bz2, it was made with planet-dump-ng which we now use for all planet files. It also isn’t all on one line.
I know we released history dumps infrequently, then did them weekly on an experimental basis with planet-dump-ng. I checked the deep archives and it looks like we started in late 2014. I didn’t look at any of the files because they cost money to restore.
If you did find the historydump code, I do not believe it could be run against the current database. We had problems with Osmosis generation failing because it held open a transaction too long, generating the full history would be worse, and the tool might not even support 64-bit IDs.
So it looks like that line was correct in the early 2010s, but has been incorrect for a long time. I’ll remove it.
1 Like
As a follow-up note, most of that wiki page is incorrect or irrelevant. It needs a complete rewrite, which is more than I want to do right now. I would not recommend writing any software based on the current contents.
2 Likes
Maybe mass removal of misleading contents would be a good idea?