Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Many ways are missing after import #269

Open
Doev opened this issue Jun 8, 2020 · 17 comments
Open

Many ways are missing after import #269

Doev opened this issue Jun 8, 2020 · 17 comments
Labels

Comments

@Doev
Copy link

Doev commented Jun 8, 2020

When I compare the result with original osm-data after a import, I can see that there are many ways are nissing.

The screenshot shows a random area of the map. Green are the osm ways with the tag "residential" and blue is what was imported by osm2pgrouting.

grafik

@Doev Doev added the bug label Jun 8, 2020
@Doev
Copy link
Author

Doev commented Jun 8, 2020

grafik

@cayetanobv
Copy link
Member

Hi @Doev ,

Could you specify what osm2pgrouting version you are using? Could you copy/paste here exact command you are running? What xml config are you using?

Thanks,

@Doev
Copy link
Author

Doev commented Jun 8, 2020

Hello,

"This is osm2pgrouting Version 2.3.6" ... Ubuntu 20.04 Repo
The command was: "osm2pgrouting --clean --schema pgr -c mapconfig.xml -f germany-latest_reduced.osm -d osm_germany -U osm -W osm -h x.x.x.x

The OSM-File is complete, I do a test import with osm2psql.

I use the default config.

<?xml version="1.0" encoding="UTF-8"?>
<configuration>
  <tag_name name="highway" id="1">
    <tag_value name="motorway" id="101" />
    <tag_value name="motorway_link" id="102" />
    <tag_value name="motorway_junction" id="103" />
    <tag_value name="trunk" id="104" />
    <tag_value name="trunk_link" id="105" />
    <tag_value name="primary" id="106" />
    <tag_value name="primary_link" id="107" />
    <tag_value name="secondary" id="108" />
    <tag_value name="secondary_link" id="124" />
    <tag_value name="tertiary" id="109" />
    <tag_value name="tertiary_link" id="125" />
    <tag_value name="residential" id="110" />
    <tag_value name="living_street" id="111" />
    <tag_value name="service" id="112" />
    <tag_value name="track" id="113" />
    <tag_value name="pedestrian" id="114" />
    <tag_value name="services" id="115" />
    <tag_value name="bus_guideway" id="116" />
    <tag_value name="path" id="117" />
    <tag_value name="cycleway" id="118" />
    <tag_value name="footway" id="119" />
    <tag_value name="bridleway" id="120" />
    <tag_value name="byway" id="121" />
    <tag_value name="steps" id="122" />

    <tag_value name="unclassified" id="123" />
    <tag_value name="road" id="100" />
  </tag_name>
  <tag_name name="cycleway" id="2">
    <tag_value name="lane" id="201" />
    <tag_value name="track" id="202" />
    <tag_value name="opposite_lane" id="203" />
    <tag_value name="opposite" id="204" />
  </tag_name>
  <tag_name name="tracktype" id="3">
    <tag_value name="grade1" id="301" />
    <tag_value name="grade2" id="302" />
    <tag_value name="grade3" id="303" />
    <tag_value name="grade4" id="304" />
    <tag_value name="grade5" id="305" />
  </tag_name>
  <tag_name name="junction" id="4">
    <tag_value name="roundabout" id="401" />
  </tag_name>
</configuration>

@Doev
Copy link
Author

Doev commented Jun 8, 2020

I made a Test with an untouched file from Geofabrik. A smaler one, just from Rheinland-Pfalz. You can see a part of Koblenz:

grafik

@Doev
Copy link
Author

Doev commented Jun 8, 2020

~/osm$ osmconvert rheinland-pfalz-latest.osm.pbf > rheinland-pfalz-latest.osm |
~/osm$ osm2pgrouting --clean -c mapconfig.xml -f rheinland-pfalz-latest.osm -d test -U osm -W osm -h x.x.x.x |
Execution starts at: Mon Jun 8 12:51:53 2020 |
|
*************************************************** |
COMMAND LINE CONFIGURATION * |
*************************************************** |
Filename = rheinland-pfalz-latest.osm |
Configuration file = mapconfig.xml |
host = x.x.x.x |
port = 5432 |
dbname = test |
username = osm |
schema= |
prefix = |
suffix = |
Drop tables |
Don't create indexes |
Don't add OSM nodes |
*************************************************** |
Testing database connection: test |
database connection successful: test |
Connecting to the database |
connection success |
|
Dropping tables... |
TABLE: ways dropped ... OK. |
TABLE: ways_vertices_pgr dropped ... OK. |
TABLE: pointsofinterest dropped ... OK. |
TABLE: configuration dropped ... OK. |
TABLE: osm_nodes dropped ... OK. |
TABLE: osm_ways dropped ... OK. |
TABLE: osm_relations dropped ... OK. |
|
Creating tables... |
TABLE: ways_vertices_pgr created ... OK. |
TABLE: ways created ... OK. |
TABLE: pointsofinterest created ... OK. |
TABLE: configuration created ... OK. |
Opening configuration file: mapconfig.xml |
Parsing configuration |
|
Exporting configuration ... |

  • Done |
    Counting lines ... |
  • Done |
    Opening data file: rheinland-pfalz-latest.osm total lines: 55409705 |
    Parsing data |
    |
    |
    End Of file |
    |
    |
    Finish Parsing data |
    |
    Adding auxiliary tables to database... |
    |
    Export Ways ... |
    Processing 2673485 ways: |
    [| ] (0%) Total processed: 20000 Vertices inserted: 55293 Split ways inserted 50216 |
    [| ] (1%) Total processed: 40000 Vertices inserted: 52434 Split ways inserted 49611 |
    [| ] (2%) Total processed: 60000 Vertices inserted: 49785 Split ways inserted 48485 |
    [
    | ] (2%) Total processed: 80000 Vertices inserted: 44366 Split ways inserted 43733 |
    [| ] (3%) Total processed: 100000 Vertices inserted: 40278 Split ways inserted 40952 |
    [| ] (4%) Total processed: 120000 Vertices inserted: 39020 Split ways inserted 40007 |
    [
    | ] (5%) Total processed: 140000 Vertices inserted: 39724 Split ways inserted 41914 |
    [| ] (5%) Total processed: 160000 Vertices inserted: 36315 Split ways inserted 38801 |
    [
    | ] (6%) Total processed: 180000 Vertices inserted: 34336 Split ways inserted 36796 |
    [| ] (7%) Total processed: 200000 Vertices inserted: 26941 Split ways inserted 30098 |
    [
    | ] (8%) Total processed: 220000 Vertices inserted: 29205 Split ways inserted 32786 |
    [
    | ] (8%) Total processed: 240000 Vertices inserted: 28799 Split ways inserted 33202 |
    [
    | ] (9%) Total processed: 260000 Vertices inserted: 24658 Split ways inserted 28256 |
    [| ] (10%) Total processed: 280000 Vertices inserted: 20227 Split ways inserted 22475 |
    [
    | ] (11%) Total processed: 300000 Vertices inserted: 24379 Split ways inserted 26963 |
    [| ] (11%) Total processed: 320000 Vertices inserted: 16415 Split ways inserted 18920 |
    [
    | ] (12%) Total processed: 340000 Vertices inserted: 16981 Split ways inserted 19701 |
    [| ] (13%) Total processed: 360000 Vertices inserted: 17236 Split ways inserted 20028 |
    [
    | ] (14%) Total processed: 380000 Vertices inserted: 15329 Split ways inserted 18134 |
    [
    | ] (14%) Total processed: 400000 Vertices inserted: 20891 Split ways inserted 24266 |
    [
    | ] (15%) Total processed: 420000 Vertices inserted: 17630 Split ways inserted 21457 |
    [| ] (16%) Total processed: 440000 Vertices inserted: 17286 Split ways inserted 21491 |
    [
    | ] (17%) Total processed: 460000 Vertices inserted: 16204 Split ways inserted 20003 |
    [| ] (17%) Total processed: 480000 Vertices inserted: 15400 Split ways inserted 19225 |
    [
    | ] (18%) Total processed: 500000 Vertices inserted: 10109 Split ways inserted 13255 |
    [| ] (19%) Total processed: 520000 Vertices inserted: 10015 Split ways inserted 13685 |
    [
    | ] (20%) Total processed: 540000 Vertices inserted: 12540 Split ways inserted 16825 |
    [
    | ] (20%) Total processed: 560000 Vertices inserted: 9441 Split ways inserted 13231 |
    [
    | ] (21%) Total processed: 580000 Vertices inserted: 9759 Split ways inserted 13450 |
    [| ] (22%) Total processed: 600000 Vertices inserted: 12518 Split ways inserted 17011 |
    [
    | ] (23%) Total processed: 620000 Vertices inserted: 10820 Split ways inserted 15080 |
    [| ] (23%) Total processed: 640000 Vertices inserted: 10025 Split ways inserted 14730 |
    [
    | ] (24%) Total processed: 660000 Vertices inserted: 10469 Split ways inserted 13488 |
    [| ] (25%) Total processed: 680000 Vertices inserted: 7757 Split ways inserted 10463 |
    [
    | ] (26%) Total processed: 700000 Vertices inserted: 12827 Split ways inserted 16842 |
    [
    | ] (26%) Total processed: 720000 Vertices inserted: 4719 Split ways inserted 6783 |
    [
    | ] (27%) Total processed: 740000 Vertices inserted: 5622 Split ways inserted 8157 |
    [| ] (28%) Total processed: 760000 Vertices inserted: 5935 Split ways inserted 8362 |
    [
    | ] (29%) Total processed: 780000 Vertices inserted: 8140 Split ways inserted 10953 |
    [| ] (29%) Total processed: 800000 Vertices inserted: 5441 Split ways inserted 7778 |
    [
    | ] (30%) Total processed: 820000 Vertices inserted: 8874 Split ways inserted 11910 |
    [| ] (31%) Total processed: 840000 Vertices inserted: 7571 Split ways inserted 11022 |
    [
    | ] (32%) Total processed: 860000 Vertices inserted: 4777 Split ways inserted 6966 |
    [
    | ] (32%) Total processed: 880000 Vertices inserted: 5273 Split ways inserted 7914 |
    [
    | ] (33%) Total processed: 900000 Vertices inserted: 4464 Split ways inserted 6798 |
    [| ] (34%) Total processed: 920000 Vertices inserted: 8549 Split ways inserted 13056 |
    [
    | ] (35%) Total processed: 940000 Vertices inserted: 6099 Split ways inserted 9348 |
    [| ] (35%) Total processed: 960000 Vertices inserted: 3973 Split ways inserted 6257 |
    [
    | ] (36%) Total processed: 980000 Vertices inserted: 5772 Split ways inserted 8949 |
    [| ] (37%) Total processed: 1000000 Vertices inserted: 6663 Split ways inserted 9157 |
    [
    | ] (38%) Total processed: 1020000 Vertices inserted: 5965 Split ways inserted 8976 |
    [
    | ] (38%) Total processed: 1040000 Vertices inserted: 3083 Split ways inserted 4834 |
    [
    | ] (39%) Total processed: 1060000 Vertices inserted: 4444 Split ways inserted 7105 |
    [| ] (40%) Total processed: 1080000 Vertices inserted: 7579 Split ways inserted 12092 |
    [
    | ] (41%) Total processed: 1100000 Vertices inserted: 3524 Split ways inserted 5458 |
    [| ] (41%) Total processed: 1120000 Vertices inserted: 5338 Split ways inserted 8473 |
    [
    | ] (42%) Total processed: 1140000 Vertices inserted: 3359 Split ways inserted 5398 |
    [| ] (43%) Total processed: 1160000 Vertices inserted: 5105 Split ways inserted 8203 |
    [
    | ] (44%) Total processed: 1180000 Vertices inserted: 4401 Split ways inserted 7373 |
    [
    | ] (44%) Total processed: 1200000 Vertices inserted: 2863 Split ways inserted 5041 |
    [
    | ] (45%) Total processed: 1220000 Vertices inserted: 2577 Split ways inserted 4669 |
    [| ] (46%) Total processed: 1240000 Vertices inserted: 4405 Split ways inserted 6531 |
    [
    | ] (47%) Total processed: 1260000 Vertices inserted: 5081 Split ways inserted 8193 |
    [| ] (47%) Total processed: 1280000 Vertices inserted: 3027 Split ways inserted 4506 |
    [
    | ] (48%) Total processed: 1300000 Vertices inserted: 1279 Split ways inserted 2145 |
    [| ] (49%) Total processed: 1320000 Vertices inserted: 1258 Split ways inserted 2149 |
    [
    | ] (50%) Total processed: 1340000 Vertices inserted: 3324 Split ways inserted 5442 |
    [
    | ] (50%) Total processed: 1360000 Vertices inserted: 3032 Split ways inserted 4929 |
    [
    | ] (51%) Total processed: 1380000 Vertices inserted: 3562 Split ways inserted 5766 |
    [| ] (52%) Total processed: 1400000 Vertices inserted: 3779 Split ways inserted 6421 |
    [
    | ] (53%) Total processed: 1420000 Vertices inserted: 3268 Split ways inserted 5413 |
    [| ] (53%) Total processed: 1440000 Vertices inserted: 4033 Split ways inserted 7165 |
    [
    | ] (54%) Total processed: 1460000 Vertices inserted: 3705 Split ways inserted 6296 |
    [| ] (55%) Total processed: 1480000 Vertices inserted: 2567 Split ways inserted 4502 |
    [
    | ] (56%) Total processed: 1500000 Vertices inserted: 2773 Split ways inserted 4818 |
    [
    | ] (56%) Total processed: 1520000 Vertices inserted: 3680 Split ways inserted 6324 |
    [
    | ] (57%) Total processed: 1540000 Vertices inserted: 3574 Split ways inserted 6025 |
    [| ] (58%) Total processed: 1560000 Vertices inserted: 4298 Split ways inserted 6474 |
    [
    | ] (59%) Total processed: 1580000 Vertices inserted: 2348 Split ways inserted 3518 |
    [| ] (59%) Total processed: 1600000 Vertices inserted: 822 Split ways inserted 1492 |
    [
    | ] (60%) Total processed: 1620000 Vertices inserted: 980 Split ways inserted 1851 |
    [| ] (61%) Total processed: 1640000 Vertices inserted: 720 Split ways inserted 1254 |
    [
    | ] (62%) Total processed: 1660000 Vertices inserted: 2374 Split ways inserted 3849 |
    [
    | ] (62%) Total processed: 1680000 Vertices inserted: 1693 Split ways inserted 3383 |
    [
    | ] (63%) Total processed: 1700000 Vertices inserted: 2168 Split ways inserted 3860 |
    [| ] (64%) Total processed: 1720000 Vertices inserted: 4518 Split ways inserted 6617 |
    [
    | ] (65%) Total processed: 1740000 Vertices inserted: 2884 Split ways inserted 4454 |
    [| ] (65%) Total processed: 1760000 Vertices inserted: 3573 Split ways inserted 5982 |
    [
    | ] (66%) Total processed: 1780000 Vertices inserted: 3962 Split ways inserted 6906 |
    [| ] (67%) Total processed: 1800000 Vertices inserted: 5710 Split ways inserted 9576 |
    [
    | ] (68%) Total processed: 1820000 Vertices inserted: 4886 Split ways inserted 8531 |
    [
    | ] (68%) Total processed: 1840000 Vertices inserted: 5566 Split ways inserted 8886 |
    [
    | ] (69%) Total processed: 1860000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1840000th to: 1860000th way |
    count1860000 While processing FROM 1840000th to: 1860000th way |
    [| ] (70%) Total processed: 1880000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1860000th to: 1880000th way |
    count1880000 While processing FROM 1860000th to: 1880000th way |
    [
    | ] (71%) Total processed: 1900000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1880000th to: 1900000th way |
    count1900000 While processing FROM 1880000th to: 1900000th way |
    [| ] (71%) Total processed: 1920000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1900000th to: 1920000th way |
    count1920000 While processing FROM 1900000th to: 1920000th way |
    [
    | ] (72%) Total processed: 1940000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1920000th to: 1940000th way |
    count1940000 While processing FROM 1920000th to: 1940000th way |
    [| ] (73%) Total processed: 1960000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1940000th to: 1960000th way |
    count1960000 While processing FROM 1940000th to: 1960000th way |
    [
    | ] (74%) Total processed: 1980000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1960000th to: 1980000th way |
    count1980000 While processing FROM 1960000th to: 1980000th way |
    [
    | ] (74%) Total processed: 2000000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 1980000th to: 2000000th way |
    count2000000 While processing FROM 1980000th to: 2000000th way |
    [
    | ] (75%) Total processed: 2020000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2000000th to: 2020000th way |
    count2020000 While processing FROM 2000000th to: 2020000th way |
    [| ] (76%) Total processed: 2040000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2020000th to: 2040000th way |
    count2040000 While processing FROM 2020000th to: 2040000th way |
    [
    | ] (77%) Total processed: 2060000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2040000th to: 2060000th way |
    count2060000 While processing FROM 2040000th to: 2060000th way |
    [| ] (77%) Total processed: 2080000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2060000th to: 2080000th way |
    count2080000 While processing FROM 2060000th to: 2080000th way |
    [
    | ] (78%) Total processed: 2100000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2080000th to: 2100000th way |
    count2100000 While processing FROM 2080000th to: 2100000th way |
    [| ] (79%) Total processed: 2120000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2100000th to: 2120000th way |
    count2120000 While processing FROM 2100000th to: 2120000th way |
    [
    | ] (80%) Total processed: 2140000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2120000th to: 2140000th way |
    count2140000 While processing FROM 2120000th to: 2140000th way |
    [
    | ] (80%) Total processed: 2160000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2140000th to: 2160000th way |
    count2160000 While processing FROM 2140000th to: 2160000th way |
    [
    | ] (81%) Total processed: 2180000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2160000th to: 2180000th way |
    count2180000 While processing FROM 2160000th to: 2180000th way |
    [| ] (82%) Total processed: 2200000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2180000th to: 2200000th way |
    count2200000 While processing FROM 2180000th to: 2200000th way |
    [
    | ] (83%) Total processed: 2220000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2200000th to: 2220000th way |
    count2220000 While processing FROM 2200000th to: 2220000th way |
    [| ] (83%) Total processed: 2240000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2220000th to: 2240000th way |
    count2240000 While processing FROM 2220000th to: 2240000th way |
    [
    | ] (84%) Total processed: 2260000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2240000th to: 2260000th way |
    count2260000 While processing FROM 2240000th to: 2260000th way |
    [| ] (85%) Total processed: 2280000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2260000th to: 2280000th way |
    count2280000 While processing FROM 2260000th to: 2280000th way |
    [
    | ] (86%) Total processed: 2300000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2280000th to: 2300000th way |
    count2300000 While processing FROM 2280000th to: 2300000th way |
    [
    | ] (86%) Total processed: 2320000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2300000th to: 2320000th way |
    count2320000 While processing FROM 2300000th to: 2320000th way |
    [
    | ] (87%) Total processed: 2340000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2320000th to: 2340000th way |
    count2340000 While processing FROM 2320000th to: 2340000th way |
    [| ] (88%) Total processed: 2360000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2340000th to: 2360000th way |
    count2360000 While processing FROM 2340000th to: 2360000th way |
    [
    | ] (89%) Total processed: 2380000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2360000th to: 2380000th way |
    count2380000 While processing FROM 2360000th to: 2380000th way |
    [| ] (89%) Total processed: 2400000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2380000th to: 2400000th way |
    count2400000 While processing FROM 2380000th to: 2400000th way |
    [
    | ] (90%) Total processed: 2420000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2400000th to: 2420000th way |
    count2420000 While processing FROM 2400000th to: 2420000th way |
    [| ] (91%) Total processed: 2440000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2420000th to: 2440000th way |
    count2440000 While processing FROM 2420000th to: 2440000th way |
    [
    | ] (92%) Total processed: 2460000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2440000th to: 2460000th way |
    count2460000 While processing FROM 2440000th to: 2460000th way |
    [
    | ] (92%) Total processed: 2480000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2460000th to: 2480000th way |
    count2480000 While processing FROM 2460000th to: 2480000th way |
    [
    | ] (93%) Total processed: 2500000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2480000th to: 2500000th way |
    count2500000 While processing FROM 2480000th to: 2500000th way |
    [| ] (94%) Total processed: 2520000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2500000th to: 2520000th way |
    count2520000 While processing FROM 2500000th to: 2520000th way |
    [
    | ] (95%) Total processed: 2540000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2520000th to: 2540000th way |
    count2540000 While processing FROM 2520000th to: 2540000th way |
    [| ] (95%) Total processed: 2560000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2540000th to: 2560000th way |
    count2560000 While processing FROM 2540000th to: 2560000th way |
    [
    | ] (96%) Total processed: 2580000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2560000th to: 2580000th way |
    count2580000 While processing FROM 2560000th to: 2580000th way |
    [| ] (97%) Total processed: 2600000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2580000th to: 2600000th way |
    count2600000 While processing FROM 2580000th to: 2600000th way |
    [
    | ] (97%) Total processed: 2620000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2600000th to: 2620000th way |
    count2620000 While processing FROM 2600000th to: 2620000th way |
    [| ] (98%) Total processed: 2640000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2620000th to: 2640000th way |
    count2640000 While processing FROM 2620000th to: 2640000th way |
    [
    | ] (99%) Total processed: 2660000 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2640000th to: 2660000th way |
    count2660000 While processing FROM 2640000th to: 2660000th way |
    [**************************************************|] (100%) Total processed: 2673485 |
    ERROR: relation "__ways118428" does not exist |
    |
    While processing FROM 2660000th to: 2673485th way |
    count2673485 While processing FROM 2660000th to: 2673485th way |
    |
    Creating indexes ... |
    |
    Processing Points of Interest ... |
    ######################### |
    size of streets: 2673485 |
    Execution started at: Mon Jun 8 12:51:53 2020 |
    Execution ended at: Mon Jun 8 13:32:43 2020 |
    Elapsed time: 2449.34 Seconds. |
    User CPU time: -> 277.109 seconds |
    #########################

@cayetanobv
Copy link
Member

Hi @Doev ,

I've downloaded raw OSM file using Overpass API and it seems all Ok in this area of Koblenz. See screenshot:
image

Could you test with this file if it works for you? Or you can download using Overpass API.
koblenz.zip

@Doev
Copy link
Author

Doev commented Jun 8, 2020

There are some roads missing (maybe not all tags was included), but it looks much better. No errors while importing.

grafik

@cayetanobv
Copy link
Member

Missing roads are because of the BBOX I've used to download OSM data that intersects and left out all that info so that's correct. Anyway I've imported entire rheinland Geofabrik dataset and I'm losing some roads in the same area. I need to go deep into data to see what is happening there (red is missing roads):
image

@Doev
Copy link
Author

Doev commented Jun 9, 2020

Thank you. I will take a look to the Overpass API, so far I haven't worked with it.

BTW: How is your background map called?

@cayetanobv
Copy link
Member

Base map I've used is CARTO Positron. You can use in QGIS adding as XYZ Tiles server: https://cartodb-basemaps-a.global.ssl.fastly.net/light_all/{z}/{x}/{y}.png
image

@Doev
Copy link
Author

Doev commented Jun 23, 2020

I imported the planet-osm file for germany with osmosis to postgresl. I deleted all nodes/ways that I don't need. I exported the data with osmosis and create a new osm-file. I imported the file with osm2pgrouting.

Until now, I didn't find any missing ways. Everything seems ok.

@zdila
Copy link

zdila commented Mar 1, 2021

I am encountering the same issue. I also tried to use osmium cat to convert pbf from Geofabrik to osm. Command osmium check-refs finds no issues.

@tygrysio
Copy link

tygrysio commented Sep 14, 2021

I have the same problem.
Fedora 34. pgRouting-3.2.1. osm2pgrouting-2.3.8
Imports a small batch of data.
https://download.geofabrik.de/europe/poland/malopolskie.html
Wielicka Street (Kraków) is not continuous. This is one of the main roads. Two one-way roadways side by side.
Before that, a few years ago, everything worked fine.
Previously, I was loading data on November 22, 2019
osm2pgrouting

@tygrysio
Copy link

tygrysio commented Sep 16, 2021

I am still looking for the reason.
This is the same layout of the road but from 2019-01-01.
https://download.geofabrik.de/europe/poland/malopolskie-190101.osm.pbf
Unfortunately, the background of the map is modern.
It loads without errors. (Fedora 34. pgRouting-3.2.1. osm2pgrouting-2.3.8)
Also without errors ERROR: relation "__ways********" does not exist
osm2pgrouting20190101

way id="945765463"

@ImreSamu
Copy link

imho:
try with a bigger chunk size ( --chunk 10000000 ) in some cases the default is not enough

#296 (comment)

@tygrysio
Copy link

tygrysio commented Sep 16, 2021

imho:
try with a bigger chunk size ( --chunk 10000000 ) in some cases the default is not enough

#296 (comment)

The data was loaded without errors ERROR: relation "__ways********" does not exist.
I will see what it looks like in the pictures

@tygrysio
Copy link

tygrysio commented Sep 16, 2021

It's good.
Thank you for your help.
osm2pgrouting20210916

I think the reason is that these roads are added much later. And they have a very distant ID. And they are not in the same data packet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants