Disk space required for importing planet.osm into postgres w/ osmosis?


NOTE: I’ve moved this to help.openstreetmap.org, so please answer there :slight_smile:

I’ve been trying to import this beast into PostgreSQL. I’ve been using EC2 since I don’t have enough HDD space myself.

My last attempt on a large EC2 instance, with 850GB, failed because it ran out of disk space. I have a graph to show it hitting the 850GB:

I’d like to know approximately how much space I need, or maybe 850GB is way bigger than required and osmosis is going into an infinite loop?

I couldn’t find out how to enable logging on osmosis, so I can see how far it’s gone into the import.

The command I’m using is:

time bzcat planet-latest.osm.bz2 | osmosis --read-xml file="/dev/stdin" enableDateParsing=no --write-pgsql user="osm" database="osm" password="osm"

For my next attempt I’ll give it 2TB :slight_smile: