- tdwg-content - lists.tdwg.org

terms for sample data in DwC
by Éamonn Ó Tuama [GBIF] 12 Dec '14

12 Dec '14

In compliance with the directions for requesting changes to the Darwin Core (DwC) vocabulary, we hereby submit to the TDWG Content list a proposal for five new terms to express information on sample-based data. Sample-based data is a type of data available from thousands of environmental, ecological, and natural resource investigations. These can be one-off studies or monitoring programmes. Such data are usually quantitative, calibrated, and follow certain protocols so that changes and trends of populations can be detected. This is in contrast to opportunistic observation and collection data which today form a significant proportion of openly accessible biodiversity data. Sample-based data are often not shared because the underlying protocols have been hard to encode in a standardised way. For further background information and examples, please consult the sample data primer document [1]. We cannot emphasise enough that our intention here is not to establish how data should be captured or modelled but rather demonstrate one way data can be exposed to maximize discoverability and reuse. In particular, GBIF, in association with EU BON [2] project partners, is exploring how the IPT and Darwin Core Archives can enable the flow of sample based data in support of GEO BON Essential Biodiversity Variables (EBVs) [3]. While DwC already provides many terms that are relevant for describing sample-based data, based on several inputs (GBIF organised workshop on sample data, May 2013 ; previous discussions on the TDWG mailing list; discussions on the EU BON mailing list), we have identified a need for five new terms. These are: sampleSize <https://github.com/tdwg/dwc/issues/10> https://github.com/tdwg/dwc/issues/10 #Justification Required for sharing organism abundance data from controlled sampling and monitoring surveys (i.e., sampling events). For an introduction to the sampling proposal please see <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer. #Definition A numeric value for the time duration, length, area or volume involved in the sampling event. #Comment The terms sampleSize and sampleSizeUnit are required to be used as a pair. The value of sampleSize is a number. Example: 5 for the value part of 5m. #Term group Event sampleSizeUnit <https://github.com/tdwg/dwc/issues/11> https://github.com/tdwg/dwc/issues/11 #Justification Required for sharing organism abundance data from controlled sampling and monitoring surveys (i.e., sampling events). For an introduction to the sampling proposal please see <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer. #Definition The unit of measurement used in the sampling event. #Comment The terms sampleSize and sampleSizeUnit are required to be used as a pair, e.g., 5 metre. Example values of sampleSizeUnit include minute, hour, day, metre, square metre, cubic metre. Recommended best practice is to use a controlled vocabulary such as the Ontology of Units of Measure <http://www.wurvoc.org/vocabularies/om-1.8/> http://www.wurvoc.org/vocabularies/om-1.8/ of SI units, derived units or other non-SI units accepted for use within the SI (e.g. minute, hour, day, litre). Example: metre for the unit part of 5m. #Term group Event quantity <https://github.com/tdwg/dwc/issues/12> https://github.com/tdwg/dwc/issues/12 #Justification Required for sharing organism abundance data from controlled sampling and monitoring surveys (i.e. sampling events). For an introduction to the sampling proposal please see <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer. #Definition The quantity, per sampling event, given as a number or enumeration value for the quantityType. #Comment The terms quantity and quantityType are required to be used as a pair. The value of quantity is a number or enumeration. Examples: 12.5, r #Term group Occurrence quantityType <https://github.com/tdwg/dwc/issues/13> https://github.com/tdwg/dwc/issues/13 #Justification Required for sharing organism abundance data from controlled sampling and monitoring surveys (i.e., sampling events). For an introduction to the sampling proposal please see <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer. #Definition The entity to which the number or enumeration reported in quantity refers. #Comment The terms quantity and quantityType are required to be used as a pair, e.g., 14 individuals. The value of quantityType (i.e., the entity being measured) is expected to be drawn from a small controlled vocabulary. Examples: Individuals, % Biomass, % Biovolume, % species, % coverage, BraunBlanquetScale, DominScale. #Term group Occurrence parentEventID <https://github.com/tdwg/dwc/issues/9> https://github.com/tdwg/dwc/issues/9 #Justification Allows arbitrary linking of sub sampling events, e.g., for nested sampling plots. This was demanded by several people during the discussion of the TDWG sample based data session. For an introduction to the sampling proposal please see <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer. #Definition An event identifier for the super event which is composed of one or more sub-sampling events. #Comment The value must refer to an existing eventID. If the identifier is local it must exist within the given dataset. Example: A1 identifying the main Whittaker Plot in nested samples, each with their own eventID (e.g., A1:1, A1:2). #Term group Event None of the existing DwC terms is sufficient for any of the proposed terms although two are somewhat related: sampleEffort ("The amount of effort expended during an Event") and individualCount ("The number of individuals represented present at the time of the Occurrence"). Neither are adequate sampleEffort just provides a free text statement so is hard to parse in comparison to sampleSize and sampleSizeUnit and individualCount refers exclusively to individuals and not percentages or entities like biomass, biovolume, etc. [1] <http://links.gbif.org/ipt-sample-data-primer> http://links.gbif.org/ipt-sample-data-primer [2] <http://eubon.eu/> http://eubon.eu [3] <http://www.earthobservations.org/documents/cop/bi_geobon/ebvs/201301_ebv_pa per_pereira_et_al.pdf> http://www.earthobservations.org/documents/cop/bi_geobon/ebvs/201301_ebv_pap er_pereira_et_al.pdf ____________________________________________________ Éamonn Ó Tuama, Markus Döring, GBIF Secretariat

3 4

Fwd: NIH Frameworks for Community-based Standards Efforts Workshop Report Released!
by Ramona Walls 11 Dec '14

11 Dec '14

FYI ------------------------------------------------------ Ramona L. Walls, Ph.D. Scientific Analyst, The iPlant Collaborative, University of Arizona Research Associate, Bio5 Institute, University of Arizona Laboratory Research Associate, New York Botanical Garden -------- Forwarded Message -------- Subject: Frameworks for Community-based Standards Efforts Workshop Report Released! Date: Thu, 4 Dec 2014 20:54:23 +0000 From: Russell, Beth (NIH/OD) [E] <beth.russell(a)NIH.GOV> <beth.russell(a)NIH.GOV> Reply-To: Russell, Beth (NIH/OD) [E] <beth.russell(a)NIH.GOV> <beth.russell(a)NIH.GOV> To: BD2KUPDATES(a)LIST.NIH.GOV Greetings Everyone, We would like to invite all of you to review a report generated as a result of the NIH BD2K workshop "Frameworks for Community-based Standards Efforts", held last year. The workshop aimed at gaining a clearer understanding of the community-based data and metadata standards efforts, in particular, and how NIH might best relate to them. In this report the authors, who are the lead organizers and co-chairs, elaborate on the findings and indicate future directions. In conjunction with related efforts already under way at NIH, including the development of a Data Discovery Index Consortium (bioCADDIE: http://biocaddie.org) the final document will assist the NIH Office of the Associate Director (ADDS) to help move forward the NIH BD2K vision on how data, metadata and other digital research products can interact and work with each other. We invite all users, software developers and publishers to review our report. Please, post *comments by January 20, 2015*. The link to the report is: *http://www.communitybasedstandards.org <http://www.communitybasedstandards.org> * On behalf of the organizing committee and the participants, thank you for your assistance! * Michael F. Huerta* (NIH National Library of Medicine) * Leslie K. Derr* (NIH Office of Strategic Coordination Division of Program Coordination, Planning, and Strategic Initiatives) * Susanna-Assunta Sansone* (University of Oxford, Oxford e-Research Centre) * David N. Kennedy* (Department of Psychiatry, University of Massachusetts Medical Center) ------------------------------ To unsubscribe from the BD2KUPDATES list, click the following link: http://list.nih.gov/cgi-bin/wa.exe?SUBED1=BD2KUPDATES&A=1

1 0

Re: [tdwg-content] RFC 2119: Re: Public comment on the Darwin Core RDF Guide
by Paul J. Morris 30 Nov '14

30 Nov '14

On Sat, 29 Nov 2014 17:08:36 -0500 Jonathan A Rees <rees(a)mumble.net> wrote: > Do you know of any precedent for 2119 language to be used in a > vocabulary specification? I'd be very interested to see that... http://www.w3.org/Submission/sioc-related/ http://rdfs.org/resume-rdf/ http://www.openarchives.org/ore/1.0/vocabulary https://dvcs.w3.org/hg/gld/raw-file/default/people/index.html http://www.openannotation.org/spec/alpha2/ http://socsem.open.ac.uk/ontologies/curio/ http://www.w3.org/community/odrl/two/vocab/ http://www.w3.org/TR/HTTP-in-RDF10/ http://www.w3.org/TR/vocab-people/ http://www.w3.org/TR/vocab-data-cube/ http://www.w3.org/TR/EARL10-Guide/ -Paul -- Paul J. Morris Biodiversity Informatics Manager Harvard University Herbaria/Museum of Comparative Zoölogy mole(a)morris.net AA3SD PGP public key available

1 0

Public comment on the Darwin Core RDF Guide
by Steve Baskauf 26 Nov '14

26 Nov '14

The Darwin Core standard contains several non-normative documents that describe how Darwin Core terms can be used in various contexts such as simple text [1] and XML [2]. Members of the RDF/OWL Task Group [3] have authored a guide describing how Darwin Core terms can be used in RDF. This guide has been subjected to extensive review by the Task Group and has been recommended by the Task Group as an addition to the Darwin Core standard under the Darwin Core Namespace Policy [4]. If ratified, the guide will be another non-normative document that is part of the standard, and a parallel guide to the existing text and RDF guides. The purpose of this email is to initiate the required 30 day public comment period before the proposed addition advances to the Executive Committee for ratification. Before commenting on the proposal, please begin by reading the cover page at https://code.google.com/p/tdwg-rdf/wiki/DwcRdf . The cover page includes the rationale for the guide, links to the proposed guide itself, supporting ancillary documents, and a history of the development of the guide. To comment, post to the tdwg-content email list (tdwg-content(a)lists.tdwg.org) Please use a descriptive subject line that differentiates your comment from other comments that deal with different aspects of the proposal. Comments will be tracked on the RDF/OWL Task Group's issue tracker [5]. The comment period will continue through at least 2014-12-26, but may be extended if discussion is ongoing. Steve Baskauf TDWG RDF/OWL Task Group co-convener [1] http://rs.tdwg.org/dwc/terms/guides/text/index.htm [2] http://rs.tdwg.org/dwc/terms/guides/xml/index.htm [3] https://code.google.com/p/tdwg-rdf/ [4] http://rs.tdwg.org/dwc/terms/namespace/index.htm [5] https://code.google.com/p/tdwg-rdf/issues/list -- Steven J. Baskauf, Ph.D., Senior Lecturer Vanderbilt University Dept. of Biological Sciences postal mail address: PMB 351634 Nashville, TN 37235-1634, U.S.A. delivery address: 2125 Stevenson Center 1161 21st Ave., S. Nashville, TN 37235 office: 2128 Stevenson Center phone: (615) 343-4582, fax: (615) 322-4942 If you fax, please phone or email so that I will know to look for it. http://bioimages.vanderbilt.edu http://vanderbilt.edu/trees

1 0

NIH Request for Information on Making Big Data Usable
by Ramona Walls 19 Nov '14

19 Nov '14

Hi everyone, The NIH currently has an RFI on making big data usable: http://grants.nih.gov/grants/guide/notice-files/NOT-ES-15-002.html. "The NIH is interested in exploring how the BD2K initiative can contribute to the improvement of policies, governance, administrative procedures, and funding to support community-based standards (CBS) efforts to develop and/or extend data and/or metadata standards, and how these activities relate to other ongoing or nascent biomedical research activities. Within this context, ‘community’ encompasses a broad range of stakeholders who may be engaged in the process of data standards development and use, including technical developers, librarians, science domain experts, researchers, information scientists, vendors, funders, publishers, and other end users. - See more at: http://grants.nih.gov/grants/guide/notice-files/NOT-ES-15-002.html#sthash.S… " I know most of us do NSF, not NIH funded research, but I think that the work we do on biodiversity informatics has a lot of relevance to NIH research (particularly documentation of microbial biodiversity), and the lessons learned about community by TDWG are worth sharing and promoting. I was planning to draft a response from the point of view of the biodiversity ontology development, but we could also make it a larger biodiversity informatics response, and include all of TDWG. Alternatively, there could be one response from TDWG and one from the BCO/PCO groups, if someone is interested in taking the lead on a TDWG response. Ramona ------------------------------------------------------ Ramona L. Walls, Ph.D. Scientific Analyst, The iPlant Collaborative, University of Arizona Research Associate, Bio5 Institute, University of Arizona Laboratory Research Associate, New York Botanical Garden

1 0

New Darwin Core Release
by John Wieczorek 10 Nov '14

10 Nov '14

Dear all, Congratulations to our community for advancing the Darwin Core standard! The TDWG Executive Committee recently ratified various changes [1] to the Darwin Core, resulting in a new release that incorporates consensus in public commentary on proposed ideas, some of which have been under discussions for several years. The highlights of the changes are as follow: 1) A new class Organism [2] has been added, with associated terms and with a rearrangement of some terms from the Occurrence class. This change also resulted in the depracation of the individualID term in favor of the new organismID term. 2) The terms in the Darwin Core type vocabulary have been removed in favor of equivalent terms in the normal Darwin Core namespace. For those of you who care about namespaces, this is much cleaner than what we had before. For those of you who don't care about namespaces, you still benefit from cleaned up definitions of the Darwin Core classes, as well as not having to look on an obscure page to find out what a MachineObservation [3] is, for example. 3) Best practice recommendations have been added for how to populate the content of Darwin Core terms that support lists, such as higherClassification [4] and higherGeography [5]. The format of the content of the dynamicProperties [6] term is now recommended to be JSON on a single line. 4) The Dublin Core term "license" [7] is now recommended for use in Darwin Core in place of the "rights" term. In cases where a legal document proferring rights, such as the CC0 Public Domain Dedication [8], can be cited, license is the term in which that information should be captured, while the agent granting those rights would go in the rightsHolder term and any non-legally binding documentation about the expected behavior with respect to the information (community norms, for example - see those for Canadensys [9] and VertNet [10]) would go in the accessRights term. All of the documentation within the standard has been updated. Maintainers of tools and further documentation (including translations) should be aware of these changes and make updates accordingly. In an effort to facilitate more open maintenance of Darwin Core, the standard will be maintained on Github [11], while related documentation for the the terms and their translations will be maintained on the GBIF Semantic Media/Wiki [12], and further documentation will be moved from the Google Code development site [13] to a Darwin Core documentation repository in Github [14]. Issues related to the Darwin Core standard, including requests for clarification, changes, or additions, should be entered in the Github issue tracker for the Darwin Core Standard [15]. If you have any doubt about where to find Darwin Core documentation or tools, refer to the References section [16] of the Darwin Core Introduction. Now that the new release has been published, the Darwin Core Task Group, charged with the maintenance of the standard, will turn toward the following activities: 1) Complete the move to Github. 2) Generate more documentation with numerous examples of how to construct Simple Darwin Core for various types of data records. 3) Facilitate updates to profiles and software affected by these changes such as the Occurrence Core extension [17], the Darwin Core Archive Reader[18], and the Darwin Core API[19] ) 4) Facilitate the updates to the Darwin Core RDF Guide and integrate it into the body of the standard. 5) Facilitate the processing of new and outstanding proposals for changes to the Darwin Core. Broad topics currently include additions or changes for terms related to the classes Taxon (ranks and a ScientifName class), Event (sampling), MaterialSample (preparations and sequences), and Occurrence (environment). 6) Work with the Executive Committee to define the TDWG Standards maintenance process. 7) Update the archived release on the TDWG site as soon as the site reorganization is done. I hope this all comes as good news and that the efforts to accommodate the changes are painless, swift, and worthwhile. Cheers, John [1] http://rs.tdwg.org/dwc/terms/history/decisions/#Decision-2014-10-26_14 [2] http://rs.tdwg.org/dwc/terms/index.htm#organismindex [3] http://rs.tdwg.org/dwc/terms/index.htm#machineobservationindex [4] http://rs.tdwg.org/dwc/terms/index.htm#higherClassification [5] http://rs.tdwg.org/dwc/terms/index.htm#higherGeography [6] http://rs.tdwg.org/dwc/terms/index.htm#dynamicProperties [7] http://rs.tdwg.org/dwc/terms/index.htm#dcterms:license [8] http://creativecommons.org/publicdomain/zero/1.0/legalcode [9] http://www.canadensys.net/about/norms [10] http://www.vertnet.org/resources/norms.html [11] https://github.com/tdwg/dwc [12] http://kos.gbif.org/wiki/DarwinCore [13] https://code.google.com/p/darwincore/ [14] https://github.com/tdwg/dwc-documentation [15] https://github.com/tdwg/dwc/issues [16] http://rs.tdwg.org/dwc/index.htm#references [17] http://tools.gbif.org/dwca-validator/extension.do?id=http://rs.tdwg.org/dwc… [18] https://github.com/gbif/dwca-reader [19] https://github.com/gbif/dwc-api

1 0

Floristic regions of the world
by Markus Döring 06 Nov '14

06 Nov '14

Hello, TDWG lists as one of its prior standard the "Floristic regions of the world”: http://www.tdwg.org/standards/104/ Unfortunately we do not give any information about it at all. It seems to me that the work of Takhtajan, A. 1986 is the actual endorsed standard. Can someone verfiy this? Takhtajan, A. 1986. Floristic regions of the world, pp. vii-xiii. University of California Press http://www.isbnsearch.org/isbn/0520040279 http://en.wikipedia.org/wiki/Phytochorion#Takhtajan.27s_floristic_regionali… Thanks, Markus

5 5

Knowledge Representation in Systematic Biology - Edited book proposal
by Nico Franz 05 Nov '14

05 Nov '14

Looking for comments, ideas, potential contributors. Cheers, Nico http://taxonbytes.org/knowledge-representation-systematic-biology-edited-bo… *Nico M. Franz, Ph.D.* Associate Professor & Curator of Insects School of Life Sciences PO Box 874501 Arizona State University Tempe, AZ 85287-4501 Lab: (480) 965-2850 Collection:(480) 965-2036 Fax: (480) 965-6899 E-mail: nico.franz(a)asu.edu Website: http://taxonbytes.org Twitter: https://twitter.com/taxonbytes ASUHIC: http://symbiota4.acis.ufl.edu/scan/portal/collections/misc/collprofiles.php… WoNA: http://symbiota4.acis.ufl.edu/scan/portal/checklists/checklist.php?cl=1

1 0

Wrapping up public comment on 204 - 226
by joel sachs 16 Oct '14

16 Oct '14

Hi Everyone, The following is a summary of the comments received since announcing the proposals encapsulated in Issues 204 - 226 [1]. Comment came in two forms - posts to tdwg-content, and comments in the Darwin Core Issue Tracker [2]. Only one issue attracted comment on tdwg-content, and five issues attracted (mostly clarifying) comments in the Tracker. (This is encouraging, since the proposals were the result of a years-long consensus building process.) The issue that was the subject of discussion on this list was Issue 205, the proposal to add a dwc:Organism class. The first comment came from Rob Guralnick, who did not see the need for this new class [3]. In reply, Steve Baskauf pointed out that we already have an Organism class, implied by the existing term dwc:individualID, and that the proposal simply describes what kinds of things could reasonably have their identifier be the value of dwc:individualID. There was concurrence with Steve from Rich Pyle and Bob Morris, with no further comment. The other comments on this issue were related to my suggestion [4] that the proposal be amended to i) remove the reference to OBI in our definition, and ii) to give the new class an opaque identifier. In regards (i), Rich, Bob, and Steve were in favour, and Hilmar opposed. In regards (ii), Bob was in favour, while Rich and Hilmar were initially opposed. After some conversation, however, it seemed acceptable to them that the term be given an opaque identifier, with organism as the label. Eamonn also seemed on board with an opaque identifier. Meanwhile, the Issue Tracker saw the following: Issue 204, the umbrella Issue for all the changes Bob wondered how we might notify those whose DwC Archives would be affected by the proposed changes. Steve and Markus argued that existing DwCAs would not be affected, for reasons they explain in their comments Issue 211, dwc:NomenclaturalChecklist JohnW pointed out that dwctype:NomenclaturalChecklist was to be replaced by dwctype:Nomen, which suggests that the correct label for the new term is dwc:Nomen. Issue 212, dwc:Occurrence I suggested expanding the definition of occurrence to include non-organismal things like genes, rocks, and metagenomic samples. For reasons I explain in my comment, I dont think we need to do this now. Issue 214, dwc:Event Some clarifying remarks from Bob and Steve. Issue 222, organismID Clarification from Steve (and an indication of support from Bob). Issue 226, AssociatedOrganisms Some questions from Bob, answered by Steve. --- If I have mischaracterized anything above, please let me know. Thanks! Joel.

2 1

Audubon Core for STL media type?
by Stoner, Dan 08 Oct '14

08 Oct '14

The STL media type is used to store 3d geometry information (consumable by CAD software and 3D printing systems). iDigBio has one or more providers who are (or will be) generating STL files by scanning (stereolithography?) museum specimens to generate a 3D model. The 3D model is an example of digital media that is related to a physical specimen. I am attempting to determine the proper way to reference this "new" type of media in Audubon Core (dc:format). Wolfram Alpha suggests "application/sla": http://reference.wolfram.com/language/ref/format/STL.html However, other 3d model formats are listed in IANA as "model" types such as "model/x3d-vrml". The STL format is not listed as an IANA Media Type: http://www.iana.org/assignments/media-types/media-types.xhtml Is there a place to see pending types or those that are under future consideration? Any advice or pointers would be appreciated. Dan Stoner iDigBio / ACIS Laboratory University of Florida

2 1