Initial data load

bpronovost · 2012-06-03T20:22:18.000Z

I’ve installed a local OpenStreetMap architecture for a project I’m currently working on. We need to load a very large amount of data into our OpenStreetMap database.
The original data is stored in a FileGDB that is around 40Gb. It has been transfered into the OSM structure (with negative ids and non version, changeset tags).

My question is what would be the ideal way to procede to load this initial set of data?

I’v tried bulk_upload.py which takes about 1 hour to process 1/30000 of the data. Either my local API 0.6 needs to be tuned or it is not made to handle such important data updates.
Osmosis requires that their be changeset and version tags. Writing directly to the database without passing through the API would possibly speed up the process.

Thank you in advance for your advice.

scai · 2012-06-04T06:04:32.000Z

edit: sorry, wrong thread

stephan75 · 2012-06-04T13:36:47.000Z

When you cannot get any sufficient answer here(because your task is quite a bit special), try one of the mailing lists … see http://wiki.openstreetmap.org/wiki/Mailing_lists

I would recommend “dev” or “talk”