Re: [Libosmscout-development] Import Problems, step #20

[Nicholas H. <ni...@ze...>]

I am pretty sure you ran out of memory, as I have seen that error before on a system with 8 gigs. I would use a minimum of 16 gigs if you are doing imports. I have never had issues with 16.

Nicholas Hubbard
Owner
Zed Said Studio LLC
www.zedsaid.com
ni...@ze...

> On Sep 22, 2016, at 3:41 PM, Augusto Paula <aug...@dy...> wrote:
> 
> Hello, 
> 
> I am working on a project in which I need to import the map of Brazil, I wasn't expecting any problems at first since, for what I have seen, people have imported much bigger maps without any trouble.
> 
> This is what I get : 
> 
> + Step #20 - LocationIndexGenerator... 
>    Module description: Create index for lookup of objects based on address data
>    Module requires file 'nodes.dat'
>    Module requires file 'ways.dat'
>    Module requires file 'areas.dat'
>    Module requires file 'nodeaddress.dat'
>    Module requires file 'wayaddress.dat'
>    Module requires file 'areaaddress.dat'
>    Module provides file 'location.idx'
> - Setup...
> - Scanning for administrative boundaries of type 'area'...
>    WW Boundary area boundary_administrative 16141694 has no name
>    WW Boundary area boundary_administrative 16156918 has no name
>    WW Boundary area boundary_administrative 16841350 has no name
>    WW Boundary area boundary_administrative 16842616 has no name
>    No tag 'admin_level' for relation boundary_administrative 24333186
>    No tag 'admin_level' for relation boundary_administrative 24481884
>    WW Boundary area boundary_administrative 25762093 has no name
>    No tag 'admin_level' for relation boundary_administrative 38787813
>    WW Boundary area boundary_administrative 39347286 has no name
>    WW Boundary area boundary_administrative 43579815 has no name
>    WW Boundary area boundary_administrative 46534671 has no name
>    WW Boundary area boundary_administrative 46534805 has no name
>    WW Boundary area boundary_administrative 47853692 has no name
>    No tag 'admin_level' for relation boundary_administrative 48576963
>    WW Boundary area boundary_administrative 48591509 has no name
>    WW Boundary area boundary_administrative 48915333 has no name
>    WW Boundary area boundary_administrative 49215694 has no name
>    WW Boundary area boundary_administrative 56869955 has no name
>    WW Boundary area boundary_administrative 56890402 has no name
>    WW Boundary area boundary_administrative 67481409 has no name
>    WW Boundary area boundary_administrative 67481871 has no name
>    WW Boundary area boundary_administrative 67482071 has no name
>    WW Boundary area boundary_administrative 67482884 has no name
>    WW Boundary area boundary_administrative 67482995 has no name
>    WW Boundary area boundary_administrative 67483833 has no name
>    WW Boundary area boundary_administrative 67484321 has no name
>    WW Boundary area boundary_administrative 67484412 has no name
>    WW Boundary area boundary_administrative 67484515 has no name
>    WW Boundary area boundary_administrative 67484586 has no name
>    WW Boundary area boundary_administrative 67484946 has no name
>    WW Boundary area boundary_administrative 67485719 has no name
>    WW Boundary area boundary_administrative 67485846 has no name
>    WW Boundary area boundary_administrative 67486098 has no name
>    WW Boundary area boundary_administrative 67486286 has no name
>    WW Boundary area boundary_administrative 75331129 has no name
>    % 51.40 (767656/1493455)
>    No tag 'admin_level' for relation boundary_administrative 76543281
>    No tag 'admin_level' for relation boundary_administrative 78511909
>    No tag 'admin_level' for relation boundary_administrative 78512600
>    No tag 'admin_level' for relation boundary_administrative 78516990
>    No tag 'admin_level' for relation boundary_administrative 79744276
>    No tag 'admin_level' for relation boundary_administrative 80204044
>    No tag 'admin_level' for relation boundary_administrative 80206127
>    WW Boundary area boundary_administrative 97442376 has no name
>    WW Boundary area boundary_administrative 97442395 has no name
>    WW Boundary area boundary_administrative 97504765 has no name
>    WW Boundary area boundary_administrative 97505368 has no name
>    WW Boundary area boundary_administrative 97505393 has no name
>    WW Boundary area boundary_administrative 97505418 has no name
>    WW Boundary area boundary_administrative 97505447 has no name
>    WW Boundary area boundary_administrative 97505474 has no name
>    WW Boundary area boundary_administrative 97505501 has no name
>    WW Boundary area boundary_administrative 97505530 has no name
>    WW Boundary area boundary_administrative 97505555 has no name
>    WW Boundary area boundary_administrative 97505635 has no name
>    WW Boundary area boundary_administrative 97505705 has no name
>    WW Boundary area boundary_administrative 97506563 has no name
>    WW Boundary area boundary_administrative 97509045 has no name
>    WW Boundary area boundary_administrative 97509090 has no name
>    WW Boundary area boundary_administrative 97509115 has no name
>    WW Boundary area boundary_administrative 97509204 has no name
>    WW Boundary area boundary_administrative 97509235 has no name
>    WW Boundary area boundary_administrative 97512667 has no name
>    WW Boundary area boundary_administrative 97513682 has no name
>    WW Boundary area boundary_administrative 97513721 has no name
>    WW Boundary area boundary_administrative 97513976 has no name
>    WW Boundary area boundary_administrative 99950768 has no name
>    WW Boundary area boundary_administrative 99951949 has no name
>    WW Boundary area boundary_administrative 99952603 has no name
>    WW Boundary area boundary_administrative 99952630 has no name
>    Found 14741 areas of type 'administrative boundary'
> - Sorting in administrative boundaries of level 1...
> - Sorting in administrative boundaries of level 2...
> - Sorting in administrative boundaries of level 3...
> - Sorting in administrative boundaries of level 4...
> - Sorting in administrative boundaries of level 5...
>    % 25.93 (3822/14741)
> - Sorting in administrative boundaries of level 6...
> - Sorting in administrative boundaries of level 7...
>    % 13.68 (2017/14741)
>    % 17.73 (2614/14741)
>    % 74.34 (10959/14741)
> - Sorting in administrative boundaries of level 8...
>    % 4.97 (733/14741)
>    % 9.37 (1381/14741)
>    % 11.15 (1644/14741)
>    % 16.75 (2469/14741)
>    % 21.02 (3099/14741)
>    % 48.84 (7200/14741)
>    % 67.63 (9969/14741)
>    % 77.40 (11410/14741)
>    % 86.17 (12703/14741)
>    % 97.58 (14385/14741)
> - Sorting in administrative boundaries of level 9...
>    % 9.12 (1344/14741)
>    % 13.76 (2028/14741)
>    % 16.42 (2421/14741)
>    % 22.81 (3363/14741)
>    % 49.41 (7284/14741)
>    % 66.02 (9732/14741)
>    % 80.35 (11845/14741)
> - Sorting in administrative boundaries of level 10...
>    % 57.18 (8429/14741)
>    % 73.54 (10840/14741)
> - Indexing regions of type 'area'...
>    WW Region place_village 323199 has no name
>    WW Region place_hamlet 1693809 has no name
>    WW Region place_hamlet 1693831 has no name
>    WW Region place_hamlet 10614344 has no name
>    WW Region place_village 10620126 has no name
>    WW Region place_suburb 11983667 has no name
>    WW Region place_hamlet 12170962 has no name
>    WW Region place_suburb 16020896 has no name
>    WW Region place_suburb 16192632 has no name
>    WW Region place_village 17824640 has no name
>    WW Region place_village 32925973 has no name
>    WW Region place_village 32928401 has no name
>    WW Region place_village 32928427 has no name
>    WW Region place_village 36160460 has no name
>    WW Region place_hamlet 41385605 has no name
>    WW Region place_village 42014943 has no name
>    WW Region place_suburb 43625429 has no name
>    WW Region place_suburb 54604951 has no name
>    WW Region place_suburb 54604977 has no name
>    WW Region place_suburb 54605744 has no name
>    % 42.76 (638649/1493455)
>    % 98.49 (1470888/1493455)
>    Found 341 cities of type 'area'
> - Calculating region tree depth...
>    Area tree depth: 8
> - Sorting regions by levels...
>    Area tree index 0 size: 1
>    Area tree index 1 size: 4976
>    Area tree index 2 size: 3656
>    Area tree index 3 size: 3129
>    Area tree index 4 size: 2032
>    Area tree index 5 size: 1143
>    Area tree index 6 size: 102
>    Area tree index 7 size: 3
> - Index regions...
> terminate called after throwing an instance of 'St9bad_alloc'
>   what():  std::bad_alloc
> 
> This application has requested the Runtime to terminate it in an unusual way.
> 
> The funny thing is that at this point the program was consuming only 2Gb. I am running it on a i7 with 8Gb of RAM memory. My computer is (Windows 10) 64bits but I habe to make it in 32 because it was one of my client's requirements.
> 
> Could anyone help me with that ? 
> 
> also my command to import is : ./libosmscoutimport --destinationDirectory "..\brazil" "..\..\..\brazil.osm.pbf"
> 
> Thank you in advance !
> 
> Augusto de Paula
> ------------------------------------------------------------------------------
> _______________________________________________
> Libosmscout-development mailing list
> Lib...@li...
> https://lists.sourceforge.net/lists/listinfo/libosmscout-development