Hi Joel,

I completely agree about the need to unpack the multiple dimensions of "habitat" in DWC, while not making DWC into an ontology. I suggest the discussion of ENVO terms should probably move to the ENVO list (then come back here, if/when we are ready to deal with adding them to DWC.

I'd be very happy to work with you on BCO/DWC stuff and here your needs. Please feel free to just email me off list or email bco-discuss@googlegroups.com. We have bi-weekly calls that are open to anyone who wants to participate.

Ramona

------------------------------------------------------
Ramona L. Walls, Ph.D.
Scientific Analyst, The iPlant Collaborative, University of Arizona
Research Associate, Bio5 Institute, University of Arizona
Laboratory Research Associate, New York Botanical Garden

On Mon, May 18, 2015 at 5:50 AM, joel sachs <jsachs@csee.umbc.edu> wrote:
Ramona,

Thanks for engaging. My thinking is this:

Our goal is to address the mess that is “habitat”. So much - environmental conditions, associated taxa, geography, geology - gets crammed into that one poor term.

We want to either replace or augment or subclass “habitat” with some new terms, with each new term capturing some key dimension of information that “people” are interested in. Before talking specifically about the terms under consideration, let me disclose some of my biases:

<statement of biases>
i. I’d like to see terms that will help organize the thousands of habitat terms used by the authors of taxonomic treatments in the Flora of North America. You can see some of these terms here - http://bit.ly/1Fnow3E

We’re currently categorizing these terms to enable semantic search over habitat; as we do so, we are also thinking about the user interface of treatment templates for future contributors. Our opinion is that we should look at existing habitat terms, answer the question “what have authors been trying to tell us?”, and then design interfaces that make it easier for them to tell us those things. (This isn’t to say that we shouldn’t also coax new types of information out of treatment authors, based on our understanding of what data consumers want to know.)

The habitat dimensions that, for plants, keep coming up are: wet vs dry; open canopy vs closed canopy; soil type; sloped vs. flat; and associated taxa. We also see a range of geography/geology related dimensions.

ii. I think the semantics of Darwin Core terms should be clear from their natural language definitions. Ontologies that can be used to provide values for the terms should not be relied upon as documentation for the terms themselves.

iii. I’ve long argued that Darwin Core should not make commitments to any particular upper ontologies. I explained some of my reasons in my 2013 TDWG talk (http://bit.ly/1FjCimJ). I recall that you spoke with me about this last year, and expressed support for the idea of creating ontological layers on top of Darwin Core. I’ve since tried to do this for BCO, but struggled. I’ve been meaning to ask for your help with this.
</statement of biases>

Back to the proposed terms:

        Biome. As has been noted by others, the currently proposed definition is at odds with common understanding of the term, and is somewhat confusing due to its dependance on evolution. I think I understand what the definition is getting at - namely, expanding the traditional notion of biome to include microbiomes.

        Environmental feature. We often see habitat terms such as “rocky outcrops”; “arroyos”; “bogs”; etc. So I can see a lot of utility in a “feature” term. My preference would be to call it “geographic feature” or “geologic feature”, since I think that’s how most people think of such features (see, e.g. geonames). The currently proposed definition is “A material entity which determines an environmental system.” This requirement that the feature “determine” the environmental system strikes me as too strong.

        Environmental material. The currently proposed definition is “A portion of environmental material is a fiat object which forms the medium or part of the medium of an environmental system.”  A much clearer definition is one that I’ve heard Pierre give, which was along the lines of “The substance that was displaced by the sample prior to its being removed from its environment”. In addition to being clearer, this second definition has the advantage of not relying on the BFO notion of “fiat object”.


Happy Victoria Day to all my fellow British subjects!
Joel.



On Wed, 13 May 2015, Ramona Walls wrote:

This is my first chance to reply to this thread, but I think several of
Joel's comments need to be addressed.

1. re.: ENVO terms: "As far as I can tell, no one knows how to use these
them."
 -- I know how to use them, and I know a community of people who know how to
use them. True, that just like Darwin Core, they are often used incorrectly,
but further documentation and outreach can help with that.

2. "There was a lot of confusion over whether particular aspects of an
environment constituted an environmental feature, an environmental material,
or a biome. The correct answer was often dependent on context. For example
if a small mammal were found in leaf litter, then "leaf litter" would be the
environmental material, and
the biome would be "forest". But if a microbe were sampled from the same
leaf litter, then "leaf litter" would be the biome, and I'm not sure what
the environmental material would be."
 -- ENVO very clearly distinguishes between a biome, a feature, and a
material. It is never the case that the same ENVO class can be use as both a
biome and a feature or a feature and a material. Although the same entity,
depending on its role, may serve as either a biome or material (or feature
for that matter), in that case, it would be an instance of two different
classes in ENVO. Take the leaf litter example. A correct annotation would
need to point to both a "leaf litter biome" class and a "leaf litter
material" class. It is really crucial not to confuse material entities in
world with the roles they take on as instances of classes in ENVO.
 -- Joel and I seem to remember outcomes of that RCN meeting quite
differently (probably we were in different break-out groups). As I recall,
the major problem was that people couldn't use ENVO because the classes they
needed were not in there, not because they didn't know how. This is a
problem that would actually be helped by DwC adopting ENVO, because it would
create more users, and therefore more contributors to the ontology. Another
major problem was that people often want to describe environments in terms
of parameters like light level, salinity, temperature, etc. ENVO does not
currently include classes like this, but a movement is underfoot to perhaps
add such a branch to ENVO.

3. "Creating tripartite (biome/feature/material) decompositions of habitats
sometimes makes sense. Certainly, it made sense for some of the early
metagenomic assays that gave rise to ENVO. But it doesn't always make
sense, and there are often better ways to characterize an environment."
 -- True, there are cases when you cannot specify a biome, feature, and
material for an organism, but usually you can provide at least one of two of
them, which goes a long way toward standardizing environmental records and
making large-scale queries possible. I have not yet seen a better way to
classify environment on this scale. As I mentioned above, when it comes to
describing environments in terms of their physico-chemical paramaters, ENVO
does not serve, but that does not negate the utility of ENVO-style
descriptions. Furthermore, as with most DwC terms, these are optional, and
people/institutions who don't have to provide them if they are not relevant.

4. "The terms "env_biome", "env_feature", and "env_material" already exist
in
the MIxS Sample extension to Darwin Core (along with "submitted to INSDC",
etc.). Why do they need to be moved into the core?"
 -- The main reason I can see is that they have a lot of applicability
outside of MIXS, that is, for occurrences that do not have any sequences
associated with them, and should not be hidden away in a place that suggests
they can only be applied to sequence data.

Ramona

------------------------------------------------------
Ramona L. Walls, Ph.D.
Scientific Analyst, The iPlant Collaborative, University of Arizona
Research Associate, Bio5 Institute, University of Arizona
Laboratory Research Associate, New York Botanical Garden

On Fri, Apr 24, 2015 at 3:00 AM, <tdwg-content-request@lists.tdwg.org>
wrote:
      Send tdwg-content mailing list submissions to
              tdwg-content@lists.tdwg.org



      Today's Topics:

         1. Re: Darwin Core Proposal - environment terms (joel sachs)
        
      ----------------------------------------------------------------------

      Message: 1
      Date: Thu, 23 Apr 2015 13:29:47 -0400 (EDT)
      From: joel sachs <jsachs@csee.umbc.edu>
      Subject: Re: [tdwg-content] Darwin Core Proposal - environment
      terms
      To: John Wieczorek <tuco@berkeley.edu>
      Cc: TDWG Content Mailing List <tdwg-content@lists.tdwg.org>
      Message-ID:
             
      <Pine.LNX.4.64.1504231321240.18117@linuxserver1.cs.umbc.edu>
      Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed

      John,

      I have some concerns with these terms. As far as I can tell, no
      one knows
      how to use these them. I was at a phenotype RCN meeting last
      year where
      the theme was environmental ontologies. The attendees were
      pretty savvy in
      terms of both ontologies, and environmental terminology. We were
      given an
      overview of ENVO, and then, as an experiment, we broke into
      groups, and
      each group tried to use ENVO to describe particular
      environments. I don't
      recall any group being successful. There was a lot of confusion
      over
      whether particular aspects of an environment constituted an
      environmental
      feature, an environmental material, or a biome. The correct
      answer was
      often dependent on context. For example if a small mammal were
      found in
      leaf litter, then "leaf litter" would be the environmental
      material, and
      the biome would be "forest". But if a microbe were sampled from
      the same
      leaf litter, then "leaf litter" would be the biome, and I'm not
      sure what
      the environmental material would be.

      Due to the confusion, Pier Luigi gave us a more in-depth
      tutorial when we
      re-convened. We didnt break back out into groups, but I wish we
      had,
      because I wonder if we would have had much more success.

      Creating tripartite (biome/feature/material) decompositions of
      habitats
      sometimes makes sense. Certainly, it made sense for some of the
      early
      metagenomic assays that gave rise to ENVO. But it doesn't always
      make
      sense, and there are often better ways to characterize an
      environment. I
      think it was a mistake for these terms to be made mandatory in
      MIxS/MIMARKS.

      But the question isn't "What should MIxS do four years ago?",
      but "What
      should TDWG do now?". One wrinkle is that dwc:Habitat already
      exists. Will it stay in the core? Is the idea to create usage
      guides that
      explain when to use dwc:Habitat and when and how to use biome,
      feature,
      and material? Such an approach could work, but I'd like to see
      our usage
      guides differ from current ENVO/MIxS guidelines which mandate
      one and only
      one value for each of the terms. "Environmental feature", in
      particular,
      often merits multiple uses within the same record, and I think
      disallowing
      such usage would impede uptake of the term set. (As far as I can
      see
      from browsing metagenomic sampling metadata, it *has* impeded
      uptake of the term set.)

      So I'm not necessarily opposed to the addition of these terms,
      but I do
      wonder why we need them.

      You wrote that "there is currently no possibility of a Darwin
      Core
      PreservedSpecimen or MaterialSample record to meet the minimum
      requirements of a Mimarks Specimen record[6], as there is
      currently no way
      to share required environment terms." But MIMARKS specimen
      records are
      also required to have the fields "Submitted to INSDC",
      "Investigation-type", "Project name", "Nucleic acid sequence
      source",
      "Target gene or locus", and "Sequencing method". So won't it
      still be the
      case that there will be no possibility of a Darwin Core record
      being MIMARKS compliant, without appropriate
      augmentation?

      The terms "env_biome", "env_feature", and "env_material" already
      exist in
      the MIxS Sample extension to Darwin Core (along with "submitted
      to INSDC",
      etc.). Why do they need to be moved into the core?

      Cheers,
      Joel.



      On Thu, 26 Mar 2015, John Wieczorek wrote:

      > Dear all,
      >
      > This message pertains to a proposal[1] set forth in September
      2013
      > concerning the environment terms biome, environmentalFeature,
      and
      > environmentalMaterial. I'm renewing the proposal because so
      much time has
      > passed and the original proposal was not carried through to
      completion.
      > There were no objections to the addition of those terms during
      the initial
      > public commentary. Discussion revolved around how the
      recommendations for
      > how to populate them.
      >
      > The recommendations for all three terms will suggest using a
      controlled
      > vocabulary such as ENVO. The examples will be based on the set
      of
      > subclasses of the corresponding ENVO terms for biome[2],
      > environmentalFeature[3], and environmentalMaterial[4]. As with
      all Darwin
      > Core terms, the constraints on content are not part of the
      definition -
      > they are only illustrative recommendations.
      >
      > The importance of these terms was recognized anew at a Darwin
      Core and MIxS
      > Hackathon in Florence in Sep 2014[5]. One important outcome of
      that
      > workshop was the the realization that there is currently no
      possibility of
      > a Darwin Core PreservedSpecimen or MaterialSample record to
      meet the
      > minimum requirements of a Mimarks Specimen record[6], as there
      is currently
      > no way to share required environment terms. This creates a
      huge and easy to
      > solve barrier to integration of data across the collection,
      sample, and
      > sequence realms.
      >
      > This proposal is not substantively different from the one
      discussed in
      > 2013. It differs from the final amended previous proposal in
      two ways, 1)
      > only the three terms biome, environmentalFeature, and
      environmentalMaterial
      > are proposed here (the proposal to change to the term
      'habitat' has been
      > dropped), and 2) the term definitions have been updated to
      agree with those
      > in ENVO. The terms will be in the Darwin Core namespace
      (following the TDWG
      > community consensus in the previous discussion as well the
      consensus to
      > coin the MaterialSample class in the Darwin Core namespace
      rather than use
      > obi:specimen, with the equivalency being made on the ontology
      side in
      > BCO[7]).
      >
      > The complete definitions of the three proposed terms is given
      below the
      > following references. This reopens the 30-day public
      commentary period for
      > the addition of new terms as described in the Darwin Core
      Namespace
      > Policy[8].
      >
      > [1] Original tdwg-content proposal for environment terms.
      >
      http://lists.tdwg.org/pipermail/tdwg-content/2013-September/003066.html
      > [2] ENVO biome. http://purl.obolibrary.org/obo/ENVO_00000428
      > [3] ENVO environmentalFeature.
      http://purl.obolibrary.org/obo/ENVO_00002297
      > [4] ENVO environmentalMaterial.
      http://purl.obolibrary.org/obo/ENVO_00010483
      > [5] DwC MIxS Meeting Notes.
      >https://docs.google.com/document/d/1Zexgsiol6WC83vDzMTCF3uUB7DcFmKL15DFEPbw
      5w6c/edit?usp=sharing
      > [6] Table of the core items of Mimarks checklists.
      >
      http://www.nature.com/nbt/journal/v29/n5/fig_tab/nbt.1823_T1.html
      > [7] Biological Collections Ontology.
      https://github.com/tucotuco/bco
      > [8] Darwin Core Namespace Policy.
      >
      http://rs.tdwg.org/dwc/terms/namespace/index.htm#classesofchanges
      >
      >
      > Term Name: biome
      > Identifier: http://rs.tdwg.org/dwc/terms/biome
      > Namespace: http://rs.tdwg.org/dwc/terms/
      > Label: Biome
      > Definition: An environmental system to which resident
      ecological
      > communities have evolved adaptations.
      > Comment: Recommended best practice is to use a controlled
      vocabulary such
      > as defined by the biome class of the Environment Ontology
      (ENVO). Examples:
      > "flooded grassland biome",
      > "http://purl.obolibrary.org/obo/ENVO_01000195".
      > Type of Term:
      http://www.w3.org/1999/02/22-rdf-syntax-ns#Property
      > Refines:
      > Status: proposed
      > Date Issued: 2013-09-26
      > Date Modified: 2015-03-26
      > Has Domain:
      > Has Range:
      > Refines:
      > Version: biome-2015-03-26
      > Replaces:
      > IsReplaceBy:
      > Class: http://rs.tdwg.org/dwc/terms/Event
      > ABCD 2.0.6: not in ABCD
      >
      > Term Name: environmentalFeature
      > Identifier: http://rs.tdwg.org/dwc/terms/environmentalFeature
      > Namespace: http://rs.tdwg.org/dwc/terms/
      > Label: Environmental Feature
      > Definition: A material entity which determines an
      environmental system.
      > Comment: Recommended best practice is to use a controlled
      vocabulary such
      > as defined by the environmental feature class of the
      Environment Ontology
      > (ENVO). Examples: "meadow",
      > "http://purl.obolibrary.org/obo/ENVO_00000108".
      > Type of Term:
      http://www.w3.org/1999/02/22-rdf-syntax-ns#Property
      > Refines:
      > Status: proposed
      > Date Issued: 2013-09-26
      > Date Modified: 2015-03-26
      > Has Domain:
      > Has Range:
      > Refines:
      > Version: environmentalFeature-2015-03-26
      > Replaces:
      > IsReplaceBy:
      > Class: http://rs.tdwg.org/dwc/terms/Event
      > ABCD 2.0.6: not in ABCD
      >
      > Term Name: environmentalMaterial
      > Identifier: http://rs.tdwg.org/dwc/terms/environmentalMaterial
      > Namespace: http://rs.tdwg.org/dwc/terms/
      > Label: Environmental Material
      > Definition: A portion of environmental material is a fiat
      object which
      > forms the medium or part of the medium of an environmental
      system.
      > Comment: Recommended best practice is to use a controlled
      vocabulary such
      > as defined by the environmental feature class of the
      Environment Ontology
      > (ENVO). Examples: "scum",
      > "http://purl.obolibrary.org/obo/ENVO_00003930".
      > Type of Term:
      http://www.w3.org/1999/02/22-rdf-syntax-ns#Property
      > Refines:
      > Status: proposed
      > Date Issued: 2013-09-26
      > Date Modified: 2015-03-26
      > Has Domain:
      > Has Range:
      > Refines:
      > Version: environmentalMaterial-2015-03-26
      > Replaces:
      > IsReplaceBy:
      > Class: http://rs.tdwg.org/dwc/terms/Event
      > ABCD 2.0.6: not in ABCD
      >