NOTE: I’ve moved this to help.openstreetmap.org, so please answer there
I’ve been trying to import this beast into PostgreSQL. I’ve been using EC2 since I don’t have enough HDD space myself.
My last attempt on a large EC2 instance, with 850GB, failed because it ran out of disk space. I have a graph to show it hitting the 850GB:
I’d like to know approximately how much space I need, or maybe 850GB is way bigger than required and osmosis is going into an infinite loop?
I couldn’t find out how to enable logging on osmosis, so I can see how far it’s gone into the import.
The command I’m using is:
time bzcat planet-latest.osm.bz2 | osmosis --read-xml file="/dev/stdin" enableDateParsing=no --write-pgsql user="osm" database="osm" password="osm"
For my next attempt I’ll give it 2TB