Country name reconciliation
![](https://secure.gravatar.com/avatar/537c198aec2e7e1a3af991a463495e45.jpg?s=120&d=mm&r=g)
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau
![](https://secure.gravatar.com/avatar/c0083bf39cc11e398b510aab82193bd4.jpg?s=120&d=mm&r=g)
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes:
http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David < davidpshorthouse@gmail.com> wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/eebfe70782eddbd0e4c77a144ef6b9d6.jpg?s=120&d=mm&r=g)
Hi David,
You've built your other libraries using GBIF parsers. Have you looked at how the GBIF country names interpretation works? It would be helpful to know why it is not suitable for your use.
The GBIF library concatenates known lists (such as ISO) along with about 2500 variations we've collected through period review of what we observe while indexing, and then using google refine we've mapped them to the ISO codes and we follow the ISO code changes as best we can. Your narwhal-processor already has a software dependency on the GBIF code.
Please remember that patches and additions are always welcome to the GBIF code, if you felt it could be improved. I'm biased of course, but I'd rather see something that is broken fixed than watching a recreation of something that already exists.
Cheers, Tim
On May 17, 2013, at 4:39 PM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes: http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote: Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/eebfe70782eddbd0e4c77a144ef6b9d6.jpg?s=120&d=mm&r=g)
Sorry, for the benefit of others who may not know the GBIF code SVN sites, this particular code is all in the GBIF common resources svn: https://code.google.com/p/gbif-common-resources/source/browse/#svn%2Fgbif-pa...
And is a mavenized release on the GBIF maven repository: http://repository.gbif.org/index.html#nexus-search;quick~gbif-parsers
And the list mapping all the variations we see is: https://code.google.com/p/gbif-common-resources/source/browse/gbif-parsers/t...
I hope this helps, Tim
Hi David,
You've built your other libraries using GBIF parsers. Have you looked at how the GBIF country names interpretation works? It would be helpful to know why it is not suitable for your use.
The GBIF library concatenates known lists (such as ISO) along with about 2500 variations we've collected through period review of what we observe while indexing, and then using google refine we've mapped them to the ISO codes and we follow the ISO code changes as best we can. Your narwhal-processor already has a software dependency on the GBIF code.
Please remember that patches and additions are always welcome to the GBIF code, if you felt it could be improved. I'm biased of course, but I'd rather see something that is broken fixed than watching a recreation of something that already exists.
Cheers, Tim
On May 17, 2013, at 4:39 PM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes: http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote: Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/684f21783b8bff026545a86d979dc980.jpg?s=120&d=mm&r=g)
Tim,
Indeed, the GBIF country parser is an extremely valuable contribution and as you mention, is a dependency in the processing library we made available on Github. We use it to help reconcile country names and it works great. Nonetheless, it also appears that folks have been collecting misspelled Country names with the ultimate goal of standardizing data before they get incorporated into products or repositories, http://bit.ly/Z1wQmC.
John Deck's recent reply to this thread is a much more coherent phrasing of what I had intended to express. We have an an interested party wishing to access our aggregated occurrence data as RDF. Doing so effectively requires layering parsed & reconciled strings with their URI representations. And, having done so, I hope that this approach would open the door to interesting multi-field validations (eg Nouveau-Brunswick is in fact a province in 加拿大), which is of interest to FilteredPush workflows, the validation work that ALA has done, and may others. So, we need a well documented and advertised process by which all this work can be harmonized AND be baked with the ingredients necessary for eventual semantic reasoning, independent of what step throughout the data publication process such a reconciliation/validation library might be used.
I see several parts to this:
1. What is the mechanism by which we should pool the dirt and their (possibly ambiguous) mappings to authoritative lists (eg should we all use Google refine to dump these?) 2. What is the source and structure of those authoritative lists, who maintains them, and how do we make sure we don't break older mappings created at #1 3. How do we provide a common interface & suite of APIs to the above, agnostic to domain or data publication pipeline 4. Who should take the lead?
And, as a last practical recommendation, this is a more modern home for GBIF code, https://github.com/gbif.
Dave
On Fri, May 17, 2013 at 10:48 AM, Tim Robertson [GBIF] trobertson@gbif.org wrote:
Hi David,
You've built your other libraries using GBIF parsers. Have you looked at how the GBIF country names interpretation works? It would be helpful to know why it is not suitable for your use.
The GBIF library concatenates known lists (such as ISO) along with about 2500 variations we've collected through period review of what we observe while indexing, and then using google refine we've mapped them to the ISO codes and we follow the ISO code changes as best we can. Your narwhal-processor already has a software dependency on the GBIF code.
Please remember that patches and additions are always welcome to the GBIF code, if you felt it could be improved. I'm biased of course, but I'd rather see something that is broken fixed than watching a recreation of something that already exists.
Cheers, Tim
On May 17, 2013, at 4:39 PM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes:
http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/1c2f594b3e1a6501e6f47469440b403a.jpg?s=120&d=mm&r=g)
David,
You might like to use the GBIF vocabulary server. It has a multi-lingual country name thesaurus based on ISO 3166 and has over 23K terms for 226 ISO countries. You can download the data or use the service. It may have some lexical variants and misspellings. You can also get an account and add any you might know of. And all presented to you in your old friend Drupal. Perhaps you might like to serve as curator. Maybe? Diamond in the rough here, I'm sure of it.
http://vocabularies.gbif.org/vocabularies/country
Best, Dave
---------------------------------------------------------------------------- David Remsen Global Biodiversity Information Facility Secretariat Universitetsparken 15, DK-2100 Copenhagen, Denmark Tel: +1 508 289 7477 Fax: +1 508 289 7900 Mobile +1 508 274 4055 Skype: dremsen ----------------------------------------------------------------------------
On May 17, 2013, at 10:39 AM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes: http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote: Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/de7246b17ef0a3f9d9037807fbc96309.jpg?s=120&d=mm&r=g)
http://www.seco.tkk.fi/publications/2011/hyvonen-et-al-sapo-2011.pdf
Here a chapter of a book discussing many of the aspects we need to solve for biodiversity informatics. The example is from Finland (smaller scale) and used for cultural museums, but the the ideas might be worth investigating for our field as well.
Hanna
On Sun, May 19, 2013 at 3:50 AM, David Remsen dremsen@gbif.org wrote:
David,
You might like to use the GBIF vocabulary server. It has a multi-lingual country name thesaurus based on ISO 3166 and has over 23K terms for 226 ISO countries. You can download the data or use the service. It may have some lexical variants and misspellings. You can also get an account and add any you might know of. And all presented to you in your old friend Drupal. Perhaps you might like to serve as curator. Maybe? Diamond in the rough here, I'm sure of it.
http://vocabularies.gbif.org/vocabularies/country
Best, Dave
David Remsen Global Biodiversity Information Facility Secretariat Universitetsparken 15, DK-2100 Copenhagen, Denmark Tel: +1 508 289 7477 Fax: +1 508 289 7900 Mobile +1 508 274 4055 Skype: dremsen
On May 17, 2013, at 10:39 AM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes:
http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David < davidpshorthouse@gmail.com> wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/537c198aec2e7e1a3af991a463495e45.jpg?s=120&d=mm&r=g)
Dave & Tim,
Can you describe the linkage between the Drupal-based GBIF vocabulary server and the dictionaries in your parsers? Is the former used to seed the latter? How often does the latter get refreshed from data produced in the former? Does all that work take place in Refine? If you have published a white paper on this workflow already, could you point me to it so I can better understand the depth of the maintenance costs?
Cheers,
David
On Sat, May 18, 2013 at 8:50 PM, David Remsen dremsen@gbif.org wrote:
David,
You might like to use the GBIF vocabulary server. It has a multi-lingual country name thesaurus based on ISO 3166 and has over 23K terms for 226 ISO countries. You can download the data or use the service. It may have some lexical variants and misspellings. You can also get an account and add any you might know of. And all presented to you in your old friend Drupal. Perhaps you might like to serve as curator. Maybe? Diamond in the rough here, I'm sure of it.
http://vocabularies.gbif.org/vocabularies/country
Best, Dave
David Remsen Global Biodiversity Information Facility Secretariat Universitetsparken 15, DK-2100 Copenhagen, Denmark Tel: +1 508 289 7477 Fax: +1 508 289 7900 Mobile +1 508 274 4055 Skype: dremsen
On May 17, 2013, at 10:39 AM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes:
http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/eebfe70782eddbd0e4c77a144ef6b9d6.jpg?s=120&d=mm&r=g)
Hi David S,
The short answer is that there is no linkage currently, and the dictionaries in the parser we periodically maintain using google refine.
John W. and I are discussing merging our separate dictionaries to benefit all downstream dependencies (Canadensys for example) - we're only talking about the tab file dictionaries, so the GBIF parser API won't change. I'll pull in the Drupal content as well.
Cheers, Tim
On May 22, 2013, at 7:12 PM, Shorthouse, David wrote:
Dave & Tim,
Can you describe the linkage between the Drupal-based GBIF vocabulary server and the dictionaries in your parsers? Is the former used to seed the latter? How often does the latter get refreshed from data produced in the former? Does all that work take place in Refine? If you have published a white paper on this workflow already, could you point me to it so I can better understand the depth of the maintenance costs?
Cheers,
David
On Sat, May 18, 2013 at 8:50 PM, David Remsen dremsen@gbif.org wrote:
David,
You might like to use the GBIF vocabulary server. It has a multi-lingual country name thesaurus based on ISO 3166 and has over 23K terms for 226 ISO countries. You can download the data or use the service. It may have some lexical variants and misspellings. You can also get an account and add any you might know of. And all presented to you in your old friend Drupal. Perhaps you might like to serve as curator. Maybe? Diamond in the rough here, I'm sure of it.
http://vocabularies.gbif.org/vocabularies/country
Best, Dave
David Remsen Global Biodiversity Information Facility Secretariat Universitetsparken 15, DK-2100 Copenhagen, Denmark Tel: +1 508 289 7477 Fax: +1 508 289 7900 Mobile +1 508 274 4055 Skype: dremsen
On May 17, 2013, at 10:39 AM, Matt Jones wrote:
A good official list of countries is available from the Library of Congress: http://www.loc.gov/standards/codelists/countries.xml For background, see: http://www.loc.gov/marc/countries/
And of course there's ISO 3166, the list of country codes:
http://www.iso.org/iso/home/standards/country_codes/country_names_and_code_e... http://www.iso.org/iso/country_codes
Not sure about the alternate representations and misspellings, though.
Matt
On Fri, May 17, 2013 at 5:57 AM, Shorthouse, David davidpshorthouse@gmail.com wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
![](https://secure.gravatar.com/avatar/3fa49a79150831ffc6ba05fd02972104.jpg?s=120&d=mm&r=g)
Hi David,
You might want to look at GeoNames - you can download the data and import it onto your own app pretty easily.
Han did this pretty quickly last summer.
If it not perfect for your needs you might find it useful since it contains useful language variations for locations.
http://www.geonames.org/export/
http://download.geonames.org/export/dump/
- Pete
On Fri, May 17, 2013 at 9:57 AM, Shorthouse, David < davidpshorthouse@gmail.com> wrote:
Folks,
The Canadensys development team, http://www.canadensys.net is looking for efficient, low-maintenance ways to validate and reconcile data in its National cache of occurrence data. We are working on a Java library to initially tackle single-field Darwin Core validations, https://github.com/Canadensys/narwhal-processor. We hope this library is sufficiently generalized for uses outside our project.
Our current challenge is to reconcile country names, which requires access to an up-to-date, well-maintained knowledge base of country names, their alternative representations (possibly multilingual), and mappings to known misspellings. For performance reasons, we'd like this thesaurus to be embedded in the library, but with the capacity to be periodically refreshed with data pulled from external resources such as dbpedia.org. This clearly has ties to semantic web thinking and, because we're new to the tools and services in this space, we'd like to solicit pointers and feedback such that we build this part of our library with maximal benefit to other projects. We started collecting thoughts here: https://github.com/Canadensys/narwhal-processor/issues/14.
Cheers,
David P. Shorthouse Christian Gendreau _______________________________________________ tdwg mailing list tdwg@lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg
participants (7)
-
David Remsen
-
Hanna Koivula
-
Matt Jones
-
Peter DeVries
-
Shorthouse, David
-
Shorthouse, David
-
Tim Robertson [GBIF]