Extracting osm.pbf to osrm

recorder1 · February 24, 2025, 7:43am

Any suggestions on large osm.pbf file (80gb) extracting? Get an error from osrm-extract: Segmentation fault. 512GB Swap. Any other tools for doing this?

emvee · February 24, 2025, 7:51am

github.com/Project-OSRM/osrm-backend

osrm-extract with europe.osm.pbf and 64GB RAM failed due to memory limit ?!

geopend 07:06PM - 12 Oct 21 UTC

gesloten 03:27PM - 13 Oct 21 UTC

kimjohans

Hello all, i downloaded the current europe file from geofabrik.de to update my …current routing data. So i ran `osrm-extract europe-latest.osm.pbf` to extract the files, but: `...` `[info] Using profile api version 4` `[info] RAM: peak bytes used: 38270754816` `[error] [exception] std::bad_alloc` `[error] Please provide more memory or consider using a larger swapfile` On a server with 64GB RAM ??! I am not able to create a swap file (because it is an VServer) and there is (as far as i can see) no way to limit the RAM usage of osrm-extract. That VServer is powerful enough to do all my routing-calculations and i'm not able to rent an extra server just for extracting the PBF data. Honestly, i think that 64GB RAM should be fairly enough ... or there should be an option to limit the RAM usage. I will use OpenSource projects as often as i can and help them as good as i can, but (just my two cents) an open source project can only be used successfully and widely when a lot of people (here: developers) can use it. I know nobody in my colleagues circles with such a powerful server (128 GB RAM ?!). And on the widely used vservers swapping is deactivated. Any solution or idea (helpful ones, pls not "buy a root server", "use a smaller map" or "buy a good server") ?