From: b4m <bes...@gm...> - 2013-02-15 15:07:46
|
I am interested in applying latitude and longitude coordinates to my Location data. I have found a set of databases for non-USA locations here: http://earth-info.nga.mil/gns/html/namefiles.htm and I believe this is what the Place Completion Tool Wiki refers to as GeoNet. At least, that's where the links send me when I do a Google search for GeoNet! I've downloaded the UK data file and unzipped it (uk.txt). I've pointed the "Look up latitude and longitude" to the uk.txt file and have tried running the Place Completion tool over a small subset of my place data, using "GNS Geonet country file, city search" and "GNS Geonet country file, title begin, general search" but neither of them seem to be picking up any data from the uk.txt file. Am I doing something wrong, or does the tool not yet work for this data set? If not, but there IS a data set it will work with for UK data, where do I find it, please? Thanks. |
From: Nick H. <nic...@ho...> - 2013-02-15 23:03:20
|
I tried to use the Place Completion Tool to add latitude and longitude to UK places, but got very poor results. I ended up adding the co-ordinates manually. Nick. On 15/02/13 15:07, b4m wrote: > I am interested in applying latitude and longitude coordinates to my > Location data. > > I have found a set of databases for non-USA locations here: > http://earth-info.nga.mil/gns/html/namefiles.htm and I believe this is > what the Place Completion Tool Wiki refers to as GeoNet. At least, > that's where the links send me when I do a Google search for GeoNet! > > I've downloaded the UK data file and unzipped it (uk.txt). > > I've pointed the "Look up latitude and longitude" to the uk.txt file > and have tried running the Place Completion tool over a small subset > of my place data, using "GNS Geonet country file, city search" and > "GNS Geonet country file, title begin, general search" but neither of > them seem to be picking up any data from the uk.txt file. > > Am I doing something wrong, or does the tool not yet work for this > data set? If not, but there IS a data set it will work with for UK > data, where do I find it, please? > > Thanks. > > > ------------------------------------------------------------------------------ > Free Next-Gen Firewall Hardware Offer > Buy your Sophos next-gen firewall before the end March 2013 > and get the hardware for free! Learn more. > http://p.sf.net/sfu/sophos-d2d-feb > > > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users |
From: doug <do...@o2...> - 2013-02-16 12:26:40
|
On 15/02/13 23:03, Nick Hall wrote: > I tried to use the Place Completion Tool to add latitude and > longitude to UK places, but got very poor results. I ended > up adding the co-ordinates manually. > > Nick Likewise. In most cases the database localised the place rather poorly when checked against its situation on a reasonably detailed map on, say, Google Map. Where I found Place Completion Tool *really* useful was in parsing Place Titles from IGI records. Doug > > On 15/02/13 15:07, b4m wrote: >> I am interested in applying latitude and longitude >> coordinates to my Location data. <snip> |
From: b4m <bes...@gm...> - 2013-02-16 13:20:28
|
Many thanks for your replies, Nick and Doug. However, what you seem to be saying (if I understand you correctly) is that the place completion tool extracted some lat/long data from the database but you found that the lat/long it had supplied was not accurate enough to be useful to you. My problem is that the tool is not extracting ANY data, and I wonder what I am doing wrong. I have used custom filters to help me fill in the town, county, postcode and country details (because my GEDCOM import only supplies location data as a text string in the Description field (thanks a bunch, Ancestry!)), so the necessary information should be present for it to use for its Lat/Long lookup, but it doesn't do anything. On 16 February 2013 13:26, doug <do...@o2...> wrote: > On 15/02/13 23:03, Nick Hall wrote: > > I tried to use the Place Completion Tool to add latitude and > > longitude to UK places, but got very poor results. I ended > > up adding the co-ordinates manually. > > > > Nick > > Likewise. In most cases the database localised the place > rather poorly when checked against its situation on a > reasonably detailed map on, say, Google Map. > Where I found Place Completion Tool *really* useful was in > parsing Place Titles from IGI records. > > Doug > > > > > > > On 15/02/13 15:07, b4m wrote: > >> I am interested in applying latitude and longitude > >> coordinates to my Location data. > > <snip> > > > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly > thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. > http://goparallel.sourceforge.net/ > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users > |
From: Nick H. <nic...@ho...> - 2013-02-16 23:23:06
|
I got the poor results using GeoNames data. You can download a GB.zip file from: http://download.geonames.org/export/dump/ I downloaded the GNS Geonet file, but it didn't match anything. The data looks reasonable, so i would expect the the regular expression used for matching is not quite right. I'll have a look at the code if I have time. Nick. On 16/02/13 13:19, b4m wrote: > Many thanks for your replies, Nick and Doug. However, what you seem > to be saying (if I understand you correctly) is that the place > completion tool extracted some lat/long data from the database but you > found that the lat/long it had supplied was not accurate enough to be > useful to you. My problem is that the tool is not extracting ANY > data, and I wonder what I am doing wrong. > > I have used custom filters to help me fill in the town, county, > postcode and country details (because my GEDCOM import only supplies > location data as a text string in the Description field (thanks a > bunch, Ancestry!)), so the necessary information should be present for > it to use for its Lat/Long lookup, but it doesn't do anything. > > On 16 February 2013 13:26, doug <do...@o2... > <mailto:do...@o2...>> wrote: > > On 15/02/13 23:03, Nick Hall wrote: > > I tried to use the Place Completion Tool to add latitude and > > longitude to UK places, but got very poor results. I ended > > up adding the co-ordinates manually. > > > > Nick > > Likewise. In most cases the database localised the place > rather poorly when checked against its situation on a > reasonably detailed map on, say, Google Map. > Where I found Place Completion Tool *really* useful was in > parsing Place Titles from IGI records. > > Doug > > > > > > > On 15/02/13 15:07, b4m wrote: > >> I am interested in applying latitude and longitude > >> coordinates to my Location data. > > <snip> > > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with > Geeknet, > is your hub for all things parallel software development, from > weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the > most > recent posts - join the conversation now. > http://goparallel.sourceforge.net/ > _______________________________________________ > Gramps-users mailing list > Gra...@li... > <mailto:Gra...@li...> > https://lists.sourceforge.net/lists/listinfo/gramps-users > > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > > > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users |
From: Jérôme <rom...@ya...> - 2013-02-17 09:28:15
|
Some months ago, one get it working for french places. She said that it was working better by setting 'Country' (or whatever fields into top section) and by setting 'Parse as' field. Also, someone else get it working for the same country[2]. Should also work fine for 'GB'? Some years ago, I merged most of my data with others public XML places databases. Today, I suppose some tools[3] might be very useful for re-doing something like that and getting more accurate dataset. http://wiki.dbpedia.org/Interlinking http://wiki.dbpedia.org/Datasets http://wiki.dbpedia.org/Datasets#h18-17 http://logiciels.ign.fr/?Presentation,14 http://logiciels.ign.fr/?maDiffXML etc ... [1] http://www.geneanet.org/forum/index.php?topic=447383.0 It seems that we need to force 'French' lang on top right corner for passing over web navigator detection and to see this post on the french forum[1]! [2] http://www.asavar.net/blog/2012/03/07/genealogie-gestion-des-lieux-dans-gramps/ [3] http://www.gramps-project.org/bugs/view.php?id=5742#c26532 Le 17/02/2013 00:22, Nick Hall a écrit : > I got the poor results using GeoNames data. You can download a GB.zip > file from: > > http://download.geonames.org/export/dump/ > > I downloaded the GNS Geonet file, but it didn't match anything. The data > looks reasonable, so i would expect the the regular expression used for > matching is not quite right. I'll have a look at the code if I have time. > > Nick. > > > On 16/02/13 13:19, b4m wrote: >> Many thanks for your replies, Nick and Doug. However, what you seem >> to be saying (if I understand you correctly) is that the place >> completion tool extracted some lat/long data from the database but you >> found that the lat/long it had supplied was not accurate enough to be >> useful to you. My problem is that the tool is not extracting ANY >> data, and I wonder what I am doing wrong. >> >> I have used custom filters to help me fill in the town, county, >> postcode and country details (because my GEDCOM import only supplies >> location data as a text string in the Description field (thanks a >> bunch, Ancestry!)), so the necessary information should be present for >> it to use for its Lat/Long lookup, but it doesn't do anything. >> >> On 16 February 2013 13:26, doug <do...@o2... >> <mailto:do...@o2...>> wrote: >> >> On 15/02/13 23:03, Nick Hall wrote: >> > I tried to use the Place Completion Tool to add latitude and >> > longitude to UK places, but got very poor results. I ended >> > up adding the co-ordinates manually. >> > >> > Nick >> >> Likewise. In most cases the database localised the place >> rather poorly when checked against its situation on a >> reasonably detailed map on, say, Google Map. >> Where I found Place Completion Tool *really* useful was in >> parsing Place Titles from IGI records. >> >> Doug >> >> >> >> > >> > On 15/02/13 15:07, b4m wrote: >> >> I am interested in applying latitude and longitude >> >> coordinates to my Location data. >> >> <snip> >> >> >> >> >> ------------------------------------------------------------------------------ >> The Go Parallel Website, sponsored by Intel - in partnership with >> Geeknet, >> is your hub for all things parallel software development, from >> weekly thought >> leadership blogs to news, videos, case studies, tutorials, tech docs, >> whitepapers, evaluation guides, and opinion stories. Check out the >> most >> recent posts - join the conversation now. >> http://goparallel.sourceforge.net/ >> _______________________________________________ >> Gramps-users mailing list >> Gra...@li... >> <mailto:Gra...@li...> >> https://lists.sourceforge.net/lists/listinfo/gramps-users >> >> >> >> >> ------------------------------------------------------------------------------ >> The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, >> is your hub for all things parallel software development, from weekly thought >> leadership blogs to news, videos, case studies, tutorials, tech docs, >> whitepapers, evaluation guides, and opinion stories. Check out the most >> recent posts - join the conversation now.http://goparallel.sourceforge.net/ >> >> >> _______________________________________________ >> Gramps-users mailing list >> Gra...@li... >> https://lists.sourceforge.net/lists/listinfo/gramps-users > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > > > > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users > |
From: Benny M. <ben...@gm...> - 2013-02-18 09:22:16
|
2013/2/17 Nick Hall <nic...@ho...> > I got the poor results using GeoNames data. You can download a GB.zip > file from: > > http://download.geonames.org/export/dump/ > > I downloaded the GNS Geonet file, but it didn't match anything. The data > looks reasonable, so i would expect the the regular expression used for > matching is not quite right. I'll have a look at the code if I have time. > The regex was based on the files as they looked like some years ago. Every small change since will cause problems. If you add a new regex, rename the old one to "blablabla- pre 2011 version", as people might have downloaded the set and use it since. Benny > > Nick. > > > > On 16/02/13 13:19, b4m wrote: > > Many thanks for your replies, Nick and Doug. However, what you seem to be > saying (if I understand you correctly) is that the place completion tool > extracted some lat/long data from the database but you found that the > lat/long it had supplied was not accurate enough to be useful to you. My > problem is that the tool is not extracting ANY data, and I wonder what I am > doing wrong. > > I have used custom filters to help me fill in the town, county, postcode > and country details (because my GEDCOM import only supplies location data > as a text string in the Description field (thanks a bunch, Ancestry!)), so > the necessary information should be present for it to use for its Lat/Long > lookup, but it doesn't do anything. > > On 16 February 2013 13:26, doug <do...@o2...> wrote: > >> On 15/02/13 23:03, Nick Hall wrote: >> > I tried to use the Place Completion Tool to add latitude and >> > longitude to UK places, but got very poor results. I ended >> > up adding the co-ordinates manually. >> > >> > Nick >> >> Likewise. In most cases the database localised the place >> rather poorly when checked against its situation on a >> reasonably detailed map on, say, Google Map. >> Where I found Place Completion Tool *really* useful was in >> parsing Place Titles from IGI records. >> >> Doug >> >> >> >> > >> > On 15/02/13 15:07, b4m wrote: >> >> I am interested in applying latitude and longitude >> >> coordinates to my Location data. >> >> <snip> >> >> >> >> >> >> ------------------------------------------------------------------------------ >> The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, >> is your hub for all things parallel software development, from weekly >> thought >> leadership blogs to news, videos, case studies, tutorials, tech docs, >> whitepapers, evaluation guides, and opinion stories. Check out the most >> recent posts - join the conversation now. >> http://goparallel.sourceforge.net/ >> _______________________________________________ >> Gramps-users mailing list >> Gra...@li... >> https://lists.sourceforge.net/lists/listinfo/gramps-users >> > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > > > > _______________________________________________ > Gramps-users mailing lis...@li...https://lists.sourceforge.net/lists/listinfo/gramps-users > > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly > thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. > http://goparallel.sourceforge.net/ > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users > > |
From: Nick H. <nic...@ho...> - 2013-02-18 22:40:10
|
On 18/02/13 09:22, Benny Malengier wrote: > The regex was based on the files as they looked like some years ago. > Every small change since will cause problems. > If you add a new regex, rename the old one to "blablabla- pre 2011 > version", as people might have downloaded the set and use it since. There were two problems: 1. Some extra columns have been added to the end of the record, and the regexp matched the end of line. Removing the match on the last few columns should work for both new and old format files. 2. The match for latitude and longitude assumed that the fields would start with +, - or a digit. Some fields started with a decimal point. Changing this should not affect matching against the old file format either (and may improve it). I don't actually know what the old file format looked like or when it changed though. Nick. |
From: Benny M. <ben...@gm...> - 2013-02-18 22:55:15
|
2013/2/18 Nick Hall <nic...@ho...> > On 18/02/13 09:22, Benny Malengier wrote: > >> The regex was based on the files as they looked like some years ago. >> Every small change since will cause problems. >> If you add a new regex, rename the old one to "blablabla- pre 2011 >> version", as people might have downloaded the set and use it since. >> > > There were two problems: > > 1. Some extra columns have been added to the end of the record, and the > regexp matched the end of line. Removing the match on the last few columns > should work for both new and old format files. > > 2. The match for latitude and longitude assumed that the fields would > start with +, - or a digit. Some fields started with a decimal point. > Changing this should not affect matching against the old file format > either (and may improve it). > > I don't actually know what the old file format looked like or when it > changed though. > You are right that those changes should work ok, so no need to support the old specific then. Keep it as a comment in the code I would say. I downloaded the formats when I wrote this tool so many years ago. But that was on another PC which since crashed it's hard disk, so I will not have them around anymore (perhaps on an old backup, but not worth going to the attic for that I think). Benny > > Nick. > > |
From: Jérôme <rom...@ya...> - 2013-02-20 09:20:49
|
Only for info, some months ago, there was some testing and reviews on this addon: http://sourceforge.net/p/gramps-addons/code/1644/log/?path=/trunk/contrib/PlaceCompletion/PlaceCompletion.py I have added a small improvement/contribution for common place scheme used in France[1] on rev1299[2] and minor related fix, later. I also fixed[3] one issue with long & lat keys on rev1407 http://sourceforge.net/p/gramps-addons/code/1407/ [1] http://www.geneanet.org/forum/index.php?topic=435765.0 [2] http://gramps-addons.svn.sourceforge.net/viewvc/gramps-addons?view=revision&revision=1299 [3] http://www.gramps-project.org/bugs/view.php?id=5980 Le 18/02/2013 23:55, Benny Malengier a écrit : > > > > 2013/2/18 Nick Hall <nic...@ho... <mailto:nic...@ho...>> > > On 18/02/13 09:22, Benny Malengier wrote: > > The regex was based on the files as they looked like some years > ago. Every small change since will cause problems. > If you add a new regex, rename the old one to "blablabla- pre > 2011 version", as people might have downloaded the set and use > it since. > > > There were two problems: > > 1. Some extra columns have been added to the end of the record, and > the regexp matched the end of line. Removing the match on the last > few columns should work for both new and old format files. > > 2. The match for latitude and longitude assumed that the fields > would start with +, - or a digit. Some fields started with a > decimal point. Changing this should not affect matching against the > old file format either (and may improve it). > > I don't actually know what the old file format looked like or when > it changed though. > > > You are right that those changes should work ok, so no need to support > the old specific then. Keep it as a comment in the code I would say. > I downloaded the formats when I wrote this tool so many years ago. But > that was on another PC which since crashed it's hard disk, so I will not > have them around anymore (perhaps on an old backup, but not worth going > to the attic for that I think). > > Benny > > > Nick. > > > > > ------------------------------------------------------------------------------ > The Go Parallel Website, sponsored by Intel - in partnership with Geeknet, > is your hub for all things parallel software development, from weekly thought > leadership blogs to news, videos, case studies, tutorials, tech docs, > whitepapers, evaluation guides, and opinion stories. Check out the most > recent posts - join the conversation now. http://goparallel.sourceforge.net/ > > > > _______________________________________________ > Gramps-users mailing list > Gra...@li... > https://lists.sourceforge.net/lists/listinfo/gramps-users > |