[tdwg-tapir] Tapir protocol - Harvest methods?

Renato De Giovanni renato at cria.org.br
Mon May 5 21:33:00 CEST 2008

Hi Markus,

I would suggest creating new concepts for incremental harvesting, 
either in the data standards themselves or in some new extension. In 
the case of TAPIR, GBIF could easily check the mapped concepts before 
deciding between incremental or full harvesting.

Actually it could be just one new concept such as "recordStatus" or 
"deletionFlag". Or perhaps you could also want to create your own 
definition for dateLastModified indicating which set of concepts 
should be considered to see if something has changed or not, but I 
guess this level of granularity would be difficult to be supported.


On 5 May 2008 at 11:24, Markus Döring wrote:

> Phil,
> incremental harvesting is not implemented on the GBIF side as far as I  
> am aware. And I dont think that will be a simple thing to implement on  
> the current system. Also, even if we can detect only the changed  
> records since the last harevesting via dateLastModified we still have  
> no information about deletions. We could have an arrangement saying  
> that you keep deleted records as empty records with just the ID and  
> nothing else (I vaguely remember LSIDs were supposed to work like this  
> too). But that also needs to be supported on your side then, never  
> entirely removing any record. I will have a discussion with the others  
> at GBIF about that.
> Markus

More information about the tdwg-tag mailing list