QMS Routino Datenbank

Hallo allerseits,

für alle, die gerne eine Routino-Datenbank für QMapShack nutzen möchten, habe ich hier ein paar Infos aus dem Prozess, um sich ein Bild zu machen.

Im Infofenster beim Erstellen der Datenbank steht in etwa

eine Routingdatenbank zu erstellen,
dauert sehr lange und die Dateien sind dann ziemlich groß.

Mein System:
PC: Debian Linux, 2,7 GHz, 4 Cores, 16 GB Speicher
OSM Daten: europe-latest.osm.pbf (31 GB, vom 08.10.24)
Finale Routino-Datenbank: 11 GB
(zwischenzeitlich wuchsen die Files aber auf ca. 40-50 GB)

Hier der Auszug aus dem Journal:

/usr/bin/planetsplitter --dir=/PFAD/QMS/Routing --prefix=europe-latest --tagging=/usr/share/routino/tagging.xml --parse-only /PFAD/RAW/OSM-PBF/europe-latest.osm.pbf

Parse OSM Data [/PFAD/RAW/OSM-PBF/europe-latest.osm.pbf]
==============

Read: Bytes=31166941558 Nodes=3426732543 Ways=415961119 Relations=7498973

1. Etappe: der PC schafft ca 10000 Nodes in ca. 3-4 sek. schwankend → rechnerisch ca. 14 Tage, war aber nach 4,5 Tagen mit dem Parsen durch.

/usr/bin/planetsplitter --dir=/PFAD/QMS/Routing --prefix=europe-latest --tagging=/usr/share/routino/tagging.xml --process-only

Sort OSM Data
=============

Sorted Nodes: Nodes=3426732543 Duplicates=0
Sorted Ways: Ways=83068534 Duplicates=0
Sorted Route Relations: Relations=6185739 Duplicates=0
Sorted Turn Relations: Relations=872031 Duplicates=0

2. Etappe: nochmal 2,5 Tage, bis die 3426732543 Nodes sortiert waren.

Process OSM Data
================

[...] Checked Ways for unused Nodes: Ways=83068534 Highway Nodes=706460948 
Removing unused Nodes: Nodes=27390000 Highway=17385322 not-Removing unused 
[... superlange Liste ...] 
Nodes=3426732543 Highway=706460948 not-Highway=2720271595 

Split Ways: Ways=83068534 Segments=742921740    
Sorted Way Names: Ways=83068534
Updated Ways with Names: Ways=83068534 Names=4628969 
Sorted Segments: Segments=742921740
Processed Segments: Segments=742921740 Duplicates=229846 
Indexed Segments: Segments=742691894 
Processed Route Relations (1): Relations=6185739 Modified Ways=9670492 
Processed Route Relations (2): Relations=44526 Modified Ways=33915 
Processed Route Relations (3): Relations=6981 Modified Ways=2643 
Processed Route Relations (4): Relations=3453 Modified Ways=4 
Processing Turn Relations: Relations=829000 Deleted=43253 Added=598       
Processed Turn Relations: Relations=874059 Deleted=45110 Added=47138 
Sorted and Compacted Ways: Ways=83068534 Unique=9842638
Sorted Nodes Geographically: Nodes=706460948
Sorted Segments Geographically: Segments=742691894
Indexed Segments: Segments=742691894 
Sorted Turn Relations Geographically: Turn Relations=874059

Prune Unneeded Data
===================

Added Extra Segment Indexes: Segments=742691894
Pruned Straight Highway Nodes: Nodes=706460948 Pruned=386301773 
Deleted Pruned Nodes: Nodes=706460948 Pruned=386301042 
Sorted and Pruned Segments: Segments=742691894 Deleted=386301773
Sorted and Compacted Ways: Ways=9842638 Unique=9842613
Deleted Pruned Turn Relations: Relations=874059 Pruned=0 
Indexed Segments: Segments=356390121 
Added Extra Segment Indexes: Segments=356390121

Pruning Isolated Regions (foot): Segments=355590000 Adjusted=2109038
[...]
Isolated Regions (horse): Segments=150000 Adjusted=646 Pruned=0 
[...]
Pruned Short Segments: Segments=354586536 Short=13962541 Pruned=4927768 
Deleted Pruned Nodes: Nodes=318016673 Pruned=4927768 
Sorted and Pruned Segments: Segments=354586536 Deleted=4927768

Sorted and Compacted Ways: Ways=9919704 Unique=9913749
Deleted Pruned Turn Relations: Relations=873957 Pruned=104 
Indexed Segments: Segments=349658768 

Process Super-Data (iteration 0)
================================

Found Super-Nodes: Nodes=313088905 Super-Nodes=94789681  
Created Super-Segments: Super-Nodes=94789681 Super-Segments=250149695 
Sorted and Deduplicated Super-Segments: 
Super-Segments=250149695 Duplicate=118924021

Process Super-Data (iteration 1)
================================

Indexed Segments: Segments=131225674 
Found Super-Nodes: Nodes=313088905 Super-Nodes=77922375  
Created Super-Segments: Super-Nodes=77922375 Super-Segments=216358091 
Sorted and Deduplicated Super-Segments: 
Super-Segments=216358091 Duplicate=101995392

Process Super-Data (iteration 2)
================================

Indexed Segments: Segments=114362699 
Found Super-Nodes: Nodes=313088905 Super-Nodes=75538502  
Created Super-Segments: Super-Nodes=75538502 Super-Segments=211470910 
Sorted and Deduplicated Super-Segments: 
Super-Segments=211470910 Duplicate=99493748

Process Super-Data (iteration 3)
================================

Indexed Segments: Segments=111977162 
Found Super-Nodes: Nodes=313088905 Super-Nodes=75156554  
Created Super-Segments: Super-Nodes=75156554 Super-Segments=210682665 
Sorted and Deduplicated Super-Segments: 
Super-Segments=210682665 Duplicate=99088442

Process Super-Data (iteration 4)
================================

Indexed Segments: Segments=111594223 
Found Super-Nodes: Nodes=313088905 Super-Nodes=75079367  
Created Super-Segments: Super-Nodes=75079367 Super-Segments=210526646 
Sorted and Deduplicated Super-Segments: 
Super-Segments=210526646 Duplicate=99010091

Process Super-Data (iteration 5)
================================

Indexed Segments: Segments=111516555 
Found Super-Nodes: Nodes=313088905 Super-Nodes=75056682  
Created Super-Segments: Super-Nodes=75056682 Super-Segments=210481499 
Sorted and Deduplicated Super-Segments: 
Super-Segments=210481499 Duplicate=98987887

Combine Segments and Super-Segments
===================================

Merging Segments: Segments=2930000 Super=828892 Merged=494548
[...]
Segments=349658768 Super=111493612 Merged=68533691 Added=42959921 

Cross-Reference Nodes and Segments
==================================

Sorted Nodes Geographically: Nodes=313088905
Sorted Segments Geographically: Segments=392618689
Indexed Segments: Segments=392618689 
Sorted Turn Relations Geographically: Turn Relations=873853

Write Out Database Files
========================

Wrote Nodes: Nodes=313088905  
Wrote Segments: Segments=392618689  
Wrote Ways: Ways=9913749  
Wrote Relations: Turn Relations=873853

!!! erledigt !!!

habe Morgens am 08.10. angefangen und am 15.10. Mittag war alles “erledigt”. :slight_smile: Puh! Dann ist mir eingefallen, es wäre besser, tatsächlich weltweit routen zu können und jetzt läuft die world-latest.osm.pbf durch. Hihi!