<div dir="ltr"><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Mar 19, 2014 at 5:35 AM, Markus Döring <span dir="ltr"><<a href="mailto:m.doering@mac.com" target="_blank">m.doering@mac.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Hilmar,<br>
<br>
to include synonyms in the core file they technically do not have to have ids on their own.</blockquote><div><br></div><div>How would you recommend I do this then, i.e., which column header should be used for that? (I'm assuming you are not requiring that I make up IDs, which to me seems a non-starter, see below.)</div>
<div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">Said that there is the desire in dwc archives though to require an identifier for a record, see last years occurrenceID discussion. The best would be if you could make up some identifier, for example by adding a -synX suffix to the accepted taxonID or even just using the name alone if its known to be unique within your dataset.</blockquote>
<div><br></div><div>It is not necessarily unique. And making up identifiers can lead to all kinds of awkward problems downstream (how do consuming applications distinguish real identifiers that can be linked to and/resolved from those that are simply hacks and otherwise bogus), so I agree it's possibility but it strikes me as a last resort; we ought to be able to do better than that.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> Using an extension for synonyms would probably be useful and feel natural for many datasets, but I am concerned we introduce more and more alternative ways of expressing the same kind of data and that becomes a huge burden on the consumer side.<br>
</blockquote><div><br></div><div>I share that concern in principle. However, DwCA made a deliberate choice to flatten out its core taxon table and force a 1:1 relationship between row and <taxon or whatever other designated type> record. Since there may be multiple synonyms for a taxon, of different types, I'm not sure how you would do this in the core table unless you mint an identifier for each one that doesn't have one from the nomenclator, and cast all records into type Taxon, whether that's what they are or not.</div>
<div><br></div><div>All - to come back to my original question, I fully agree with the concerns re: proper treatment of synonyms for nomenclatural applications. But we also shouldn't forget that there's a wide area of application for taxonomies as an informatics tool, to discover and connect data linked to taxon. One of the key requirements for such applications when finding data by taxon is to find it by all names that were or are being potentially used to label the taxon, including basionyms, invalid names, misspellings, vernacular names. This may turn up false positives, and I agree the more provenance one has for the synonyms the better the ability to weed those out subsequently. But having an extensive list of synonyms is still critical, even if all one can say is that it's "related". Having a rich set of synonyms was one of the driving use-cases for synthesizing the Vertebrate Taxonomy Ontology [1] (and it's predecessor, the Teleost Taxonomy Ontology); it was enough of a pain that we would have gladly used an existing nomenclator's taxonomy.</div>
<div><br></div><div>What has brought me to this in the first place is the use-case of taxonomy synthesis, and the recognition that not only have we not managed in 300 years to converge on a universal taxonomy, also there is no generally accepted format for exchanging taxonomies. There are several dozens of taxonomies each of which comes in its own idiosyncratic format, often enough a straight database dump. Perhaps there's an opportunity here for the community as a whole to converge on DwCA as a universal taxonomy exchange format. I was going to write up some thoughts on that as a blog post; hopefully I get to that over the next few days, as I think we're really not far away in terms of what's missing.</div>
<div><br></div><div> -hilmar</div><div><br></div><div>[1] Midford, Peter, Thomas Dececchi, James Balhoff, Wasila Dahdul, Nizar Ibrahim, Hilmar Lapp, John Lundberg, et al. 2013. “The Vertebrate Taxonomy Ontology: A Framework for Reasoning across Model Organism and Species Phenotypes.” <i>Journal of Biomedical Semantics</i> 4 (1): 34.</div>
<div><a href="http://dx.doi.org/10.1186/2041-1480-4-34">http://dx.doi.org/10.1186/2041-1480-4-34</a><br></div><div> </div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<br>
<br>
Here are links to the documents I mentioned before:<br>
<br>
Publishing Species Checklists, Best Practices<br>
<a href="http://www.gbif.org/resources/2548" target="_blank">http://www.gbif.org/resources/2548</a><br>
<br>
GBIF GNA Profile Reference Guide for Darwin Core Archive, Core Terms and Extensions:<br>
<a href="http://www.gbif.org/resources/2562" target="_blank">http://www.gbif.org/resources/2562</a><br>
<br>
<br>
The GBIF documents are from 2011 and likely in need for some update in specific areas, but they still provide a good overview and lots of details.<br>
<br>
In addition there is a Catalog of Life document that I cannot find online anymore so I have uploaded the last version I have here:<br>
i4Life Darwin Core Archive Profile<br>
<a href="https://dl.dropboxusercontent.com/u/457027/ChecklistExchangeFormat-v1.6.pdf" target="_blank">https://dl.dropboxusercontent.com/u/457027/ChecklistExchangeFormat-v1.6.pdf</a><br>
<span><font color="#888888"><br>
<br>
Markus<br>
</font></span><div><div><br>
<br>
<br>
> Markus and all - yes, I realized after I emailed how GBIF does this. I agree that this has advantages. However, this way of doing synonyms requires that there is an identifier for the synonym. For the core use-case I'm interested in synonyms are metadata of taxon records and do not have their own identifier. For example, synonyms in NCBI don't have identifiers, and they don't in Catalog of Fishes. (I'm not sure they do in PaleoDB.)<br>
><br>
> One could of course invent identifiers on behalf of the taxonomy providers in these cases, but that's a hack. I think if there is an extension for vernacularNames, there ought to be one as well for synonyms that are simply names.<br>
><br>
> -hilmar<br>
><br>
><br>
> On Tue, Mar 18, 2014 at 6:35 PM, Markus Döring <<a href="mailto:m.doering@mac.com" target="_blank">m.doering@mac.com</a>> wrote:<br>
> Hi Hilmar,<br>
><br>
> GBIF, Catalog of life and others have produced guidelines for how to express taxonomies with synonyms and these are in widespread use already since over a year. I will forward links tomorrow when Im back at my desk.<br>
><br>
> The common idea is to include synonyms together with accepted taxa in the core file. This allows one to also add extension data to synonyms, for example bibliographic references, types data, etc. The term acceptedNameUsageID is used to link to the accepted record in the core file (targeting taxonID), originalNameUsageiD for the basionym and taxonomicStatus to declare a specific type of synonym such as homo/heterotypic or later/junior synonym. The scientificName is used both for accepted and synonym records.<br>
><br>
> You should be able to find many dwca examples in the gbif dataset search when filtered for checklists: <a href="http://www.gbif.org/dataset/search?type=CHECKLIST" target="_blank">http://www.gbif.org/dataset/search?type=CHECKLIST</a><br>
><br>
> For example try these:<br>
> <a href="http://data.canadensys.net/ipt/archive.do?r=vascan" target="_blank">http://data.canadensys.net/ipt/archive.do?r=vascan</a><br>
> <a href="http://ipt.speciesfile.org:8080/archive.do?r=orthoptera" target="_blank">http://ipt.speciesfile.org:8080/archive.do?r=orthoptera</a><br>
><br>
><br>
> Cheers,<br>
> Markus<br>
><br>
> Am 18.03.2014 um 22:44 schrieb Chuck Miller <<a href="mailto:Chuck.Miller@mobot.org" target="_blank">Chuck.Miller@mobot.org</a>>:<br>
><br>
>> Hilmar,<br>
>><br>
>> Sticking strictly to Darwin Core and not adding RDF, I think there are a couple of DwC terms that are attributes that can be used to identify a synonym:<br>
>><br>
>><br>
>><br>
>> taxonomicStatus - The status of the use of the scientificName as a label for a taxon. Requires taxonomic opinion to define the scope of a taxon. Rules of priority then are used to define the taxonomic status of the nomenclature contained in that scope, combined with the experts opinion. It must be linked to a specific taxonomic reference that defines the concept. Recommended best practice is to use a controlled vocabulary. Examples: "invalid", "misapplied", "homotypic synonym", "accepted".<br>
>><br>
>><br>
>><br>
>> relationshipofResource - The relationship of the resource identified by relatedResourceID to the subject (optionally identified by the resourceID). Recommended best practice is to use a controlled vocabulary. Examples: "duplicate of", "mother of", "endoparasite of", "host to", "sibling of", "valid synonym of", "located within".<br>
>><br>
>><br>
>><br>
>> There’s also acceptedNameUsage and acceptedNameUsageID, which if used infer that the name the terms are associated with is a synonym of the AcceptedName.<br>
>><br>
>><br>
>><br>
>> But, so far there is no guideline for how to organize synonyms in a Darwin Core Archive. They can be embedded in the core file using relationshiopofResource from a synonym name to an accepted name in the same file. Or they can be in an extension file, where the extension file may be called Synonyms and thus define a one-to-many “synonym relationship” from the taxonID in the core file to synonym names in the extension file. There are probably other ways. RDF adds the ability to be more explicit about the relationships.<br>
>><br>
>><br>
>><br>
>> Rich Pyle has lectured prolifically on this so I’m sure he has good advice to offer.<br>
>><br>
>><br>
>><br>
>> Chuck<br>
>><br>
>><br>
>><br>
>> From: <a href="mailto:tdwg-content-bounces@lists.tdwg.org" target="_blank">tdwg-content-bounces@lists.tdwg.org</a> [mailto:<a href="mailto:tdwg-content-bounces@lists.tdwg.org" target="_blank">tdwg-content-bounces@lists.tdwg.org</a>] On Behalf Of Hilmar Lapp<br>
>> Sent: Tuesday, March 18, 2014 2:55 PM<br>
>> To: TDWG Content Mailing List<br>
>> Cc: Dan Leehr<br>
>> Subject: [tdwg-content] synonyms in DwC Archives<br>
>><br>
>><br>
>><br>
>> I'm looking for recommendations on how best to put synonyms for taxon records into DwC Archive format.<br>
>><br>
>><br>
>><br>
>> I'm assuming that these would go into an extension file. Do I have this right? What I'm having more trouble with is determining the right column term. there's dwc:vernacularName, which is also in the examples, but what about synonyms of different types that come with taxonomies (such as NCBI's) or that result from merging taxonomies. There isn't an obvious candidate in DwC, and the list at <a href="http://rs.gbif.org/core/dwc_taxon.xml" target="_blank">http://rs.gbif.org/core/dwc_taxon.xml</a> doesn't have a suggestion either that would seem pertinent.<br>
>><br>
>><br>
>><br>
>> Any suggestions, pointers to documentation or examples?<br>
>><br>
>><br>
>><br>
>> -hilmar<br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Hilmar Lapp -:- <a href="http://informatics.nescent.org/wiki" target="_blank">informatics.nescent.org/wiki</a> -:- <a href="http://lappland.io" target="_blank">lappland.io</a><br>
>><br>
>><br>
>><br>
>> _______________________________________________<br>
>><br>
>> tdwg-content mailing list<br>
>> <a href="mailto:tdwg-content@lists.tdwg.org" target="_blank">tdwg-content@lists.tdwg.org</a><br>
>> <a href="http://lists.tdwg.org/mailman/listinfo/tdwg-content" target="_blank">http://lists.tdwg.org/mailman/listinfo/tdwg-content</a><br>
><br>
><br>
><br>
> --<br>
> Hilmar Lapp -:- <a href="http://informatics.nescent.org/wiki" target="_blank">informatics.nescent.org/wiki</a> -:- <a href="http://lappland.io" target="_blank">lappland.io</a><br>
><br>
<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div>Hilmar Lapp -:- <a href="http://informatics.nescent.org/wiki" target="_blank">informatics.nescent.org/wiki</a> -:- <a href="http://lappland.io" target="_blank">lappland.io</a><br>
</div><br></div>
</div></div>