August 2007 - tdwg - lists.tdwg.org

Re: [tdwg] Species pages and video
by Wouter Addink 31 Aug '07

31 Aug '07

> (*)As of August 21 2007 there is no Google Scholar published API. > http://groups.google.com/group/google-help-dataapi/browse_thread/thread/96b… > ..would definitely be nice to have one. Probably some screenscraper or webbot techniques could be used to get data out of Google Scholar, but that would be odd..

3 2

Microsoft .NET implementation of TAPIR
by Kevin Richards 30 Aug '07

30 Aug '07

Hi all I have recently completed a project funded by the TIP (TDWG Infrastructure Project) funded project that has resulted in a Microsoft .NET version of the TAPIR protocol. TAPIR (TDWG Access Protocol for Information Retrieval) is a computer protocol designed for discovery, search and retrieval of distributed data over the Internet, see http://www.tdwg.org/activities/tapir/ for more information. The .NET implementation of the TAPIR protocol provides the following functionality: All TAPIR operations (metadata, capabilities, inventory, search and ping). KVP and XML request encodings. Inventories on any mapped concepts. Searches with any output models involving concepts from mapped schemas. Response structures with basicSchemaLanguage. Multiple resources can be exposed from a single TAPIRDotNET instance. A simple client (tapir_client.aspx) for testing. OAI-PMH message handling. After mapping the OAI-PMH structure to the data source, OAI-PMH requests can be handled and valid OAI-PMH responses are retuned from the provider. The OAI-PMH message handling was a result of an investigation into the use of the generic, domain independent, protocol, OAI-PMH (http://www.openarchives.org/OAI/openarchivesprotocol.html) over TAPIR. The investigation proved to be an interesting look at integrating similar data harvesting protocols. TapirDotNET is available from http://sourceforge.net/projects/tapirdotnet/ I have also been looking at returning RDF over TAPIR for the herb IMI specimens. I will be presenting this at TDWG next month. Kevin Richards

1 0

[Fwd: [SciVee: Pioneering New Modes of Scientific Dissemination newsletter] Announcement: New Feature Rollout]
by Timothy M. Jones 30 Aug '07

30 Aug '07

1 0

RE: [tdwg] Species pages and video
by Richard Pyle 29 Aug '07

29 Aug '07

Thanks Bob, I'm still waiting to hear back from them (Google) on related stuff (mostly concerning bulk uploading). I know they prefer that I upload the full-res version, even though they shrink it down when streaming. I'd actually rather them have the full-res versions, so that as future internet bandwidth paradigms allow higher-res streaming, they can automatically step it up without input from me. Of course, uploading a 178MB file compared with a 3.5MB file -- multiplied several thousand times -- is another factor that cannot be completely ignored. The ideal would be a JPEG2K-ish standard as you describe with user-specified resolution. Rather than get Google to build another stand-alone app, I'd rather see them come out with their own browser with built-in support for Earth (and customized/optimized video streaming, Google Base access, Co-op features, etc.) all built in. So far, no NDAs.... Aloha, Rich _____ From: Bob Morris [mailto:morris.bob@gmail.com] Sent: Tuesday, August 28, 2007 5:34 PM To: Richard Pyle Cc: Eamonn O Tuama; Timothy M. Jones; tdwg(a)lists.tdwg.org Subject: Re: [tdwg] Species pages and video JPEG2000 video standards---which are generally mp4--- probably address this problem, because JPEG2K can decompress at arbitrary resolution, that is you can tell the remote server what resolution you want the stuff sent at. I think, but am not certain, that this would be the case for the video standards too, since it should be doable frame at a time. Indeed, I vaguely recall a demo at a JPEG2K meeting in which video was streamed at resolutions which varied with time. There are lots of questions, but apparently few answers, of the form "does Flash support JPEG2000. Of course rendering in the current browsers remains a problem if it doesn't, though people certainly tolerate standalone Google Earth, for example---so why wouldn't they tolerate standalone video viewers. Ask your Google video pals what's up. Preferably not under an NDA. :-) Bob On 8/28/07, Richard Pyle <deepreef(a)bishopmuseum.org> wrote: Dear all, I've been meaning to jump in on this conversation several times, but I keep getting side-tracked. For over two years now, we have been developing a protocol and associated software tools (I use the pronoun "we" loosely as far as the software development goes -- that has been entirely the work of Rob Whitton) to allow us to harness the power of video for our scientific purposes. We conduct surveys of coral-reef fishes in the Pacific, and the use of hi-definition underwater video cameras allow us to make dozens of "video vouchers" (as we call them) of fish species in the context of their natural habitat on every single dive (again, I use the pronoun "we" loosely, as John Earle is the primary videographer on our surveys). Though perhaps not as ideal as specimens, the video is much better than in-situ still photos (especially at hi-def resolution), because it gives us multiple angles on the subject (increasing the probability of capturing that elusive but diagnostic small black spot near the anus), as well as behavior (which can sometimes aid in confirming identifications). And it's a LOT better than just an un-imaged observation record. It also allows us to document many more species on a given dive than we could by collecting alone. The software that Rob Whitton has developed is optimized for field-based capturing of metadata. We ( i.e., John) will generally catalog the video clips on the same day the video was taken. Metadata is robust, with full locality/habitat data (including depth and other parameters), as well as rich content cataloging (multiple identifications of the same imaged organism, etc.) At the moment, we (i.e., John & Rob) have something on the order of 7,000 video clips cataloged -- representing nearly a terabyte of video files (a mix of both standard-resolution DV and HDV). Very soon we will have an initial website online to allow searching/etc., and we have a couple of major regional checklists in the works that will cite these "video vouchers" in addition to more traditional means of documenting species at localities. So...the reason I am posting this now (rather than wait until the site is online) is to ask others who are exploring the use of video content for similar purposes how they plan to implement it. Our current plan is to maintain an archive of full-resolution digital video files on our local SAN, but the files are much too large to stream in real-time over almost any typical internet connection, and moreover would completely choke our bandwidth if the site ever became popular. For this reason, we want to use a video hosting service to stream the content, which we will link to from our own web databases (which themselves will serve only keyframes from the clips). We've been working with Google to sort out a way to do batch uploads onto Google Video. I generally prefer the Google Video environment over YouTube, but I'm not familiar with other video hosting services that are out there. Here is a sample clip: http://video.google.com/videoplay?docid=153611051098248174 Google Video allows me to dump all of the metadata into the Description field. Unfortunately, this is not very structured. However, Google Video allows you to link back to your own web page for each clip, so I can have that link go to an LSID resolver, or some other web interface where more structured metadata can be served. Another feature I like is that you can lay as many subtitle/caption files as you want. For example, if you go to the link above, in the lower right corner you'll see a little "CC" icon. Click on the drop-down button to the right of the "CC" button, and you can choose from any number of subtitle tracks. In the example above, there are two different tracks: "Audio Dialog" transcribes the spoken words you hear on the clip's soundtrack, and "Species List", which names the species as they appear in the clip. Rob Whitton is developing his software to automatically generate the text for the metadata and multiple CC tracks, so that we can (eventually) automate the upload process. The main problem -- which I think will be true of any of these video hosting services -- is the limited resoloution of the clips as they are streamed. For example, here is a frame from the original HDV clip in the above link: http://www2.bishopmuseum.org/testvideo/Frame01.jpg Here is the same frame at the resolution that the video is rendered on Google Video: http://www2.bishopmuseum.org/testvideo/Frame02.jpg Obviously, the full-resolution video contains a LOT more information. The problem is that an MPG (i.e., compressed) copy of the full-resolution HDV clip is 172MB, whereas the compressed version that Google streams is 3.5MB. The problem is not with Google Video -- it's with the internet. Most people will not have access to the badwidth necessary to stream video at the full HDV resolution. So...what we'd like is a service that will allow people to view the clips at a resolution that is reasonable to stream over the internet (Google Video, YouTube, etc.), but then have the option of downloading the full-resolution file (in this case, 178MB) if they want to see it on their own computer, and are willing to wait for the full download. Obviously, we'll have to somehow regulate the downloading so that we don't choke our bandwidth -- but we want to allow people to have access to the full-resolution imagery. My hope is that Google (or whoever) itself would offer the service of streaming content at an appropriate resolution, but then allowing people to download the full resolution clip as a file, if they want (i.e., using Google's or whoever's bandwidth, and not ours). But for the time being, we mostly see Google as a way to: 1) Manage streaming of video content at low resolution, and 2) increase visibility (through Google searches_ of the content we do have. Of course, the latter depends heavily on how well the metadata are fleshed out and structured -- which brings me back to Éamonn's post. Like him, I am very-much looking forward to conversations at the upcoming meeting in Bratislava. Meanwhile, I guess the main point of this message is to ask whether others know of analagous projects, and how they have dealt with issues of bandwidth, bulk uploading to video hosting services, and metadata structure and content. Aloha, Rich Richard L. Pyle, PhD Database Coordinator for Natural Sciences and Associate Zoologist in Ichthyology Department of Natural Sciences, Bishop Museum 1525 Bernice St., Honolulu, HI 96817 Ph: (808)848-4115, Fax: (808)847-8252 email: deepreef(a)bishopmuseum.org http://hbs.bishopmuseum.org/staff/pylerichard.html > -----Original Message----- > From: tdwg-bounces(a)lists.tdwg.org > [mailto:tdwg-bounces@lists.tdwg.org] On Behalf Of Eamonn O Tuama > Sent: Tuesday, August 28, 2007 5:20 AM > To: 'Timothy M. Jones'; tdwg(a)lists.tdwg.org > Subject: RE: [tdwg] Species pages and video > > Dear Timothy, > > I think the use of video is valuable even if there is not > much motion involved - combining a series of stills with > voice over can be very effective - and the many video hosting > services makes it relatively easy to get online. However, > unlike text which can be mined for information, video (and > images) require good metadata to describe what the content is > about - to aid in searches, etc. > > Your species pages with their general facts and interactive > taxonomic keys span the task areas covered by SDD (Structure > of Descriptive Data) and SPM (Species Profile Model) TDWG > interest groups. I look forward to fruitful discussions > between the two at the forthcoming meeting in Bratislava that > will lead to standardised ways of marking up your species > content so that it is more easily discoverable, accessible > and re-usable (assuming permissions > granted) across what GBIF has labelled "The Universal > Biodiversity Data Bus". > > Best regards, > > Éamonn > > -----Original Message----- > From: tdwg-bounces(a)lists.tdwg.org > [mailto:tdwg-bounces@lists.tdwg.org] On Behalf Of Timothy M. Jones > Sent: 10 August 2007 16:48 > To: tdwg(a)lists.tdwg.org > Subject: [tdwg] Species pages and video > > Hello, > > I will not be attending the meeting this fall but thought > that this may be of interest to those interested in species > pages models. > I am working on species pages that include the use of video. > The videos were only added a month ago and are a bit > rudimentary (with budget-conscious equipment) but the > potential now seems truly limitless. > > Examples - > http://utc.usu.edu/factsheets/CarexFSF/new/carex_eburnea_species.htm <http://utc.usu.edu/factsheets/CarexFSF/new/carex_eburnea_species.htm> > > http://utc.usu.edu/factsheets/CarexFSF/new/carex_nebrascensis_ > species.htm > > http://utc.usu.edu/factsheets/CarexFSF/new/carex_mitchelliana_ > species.htm > > Comments appreciated, > Timothy M. Jones > http://utc.usu.edu/keys/Carex/Carex.html <http://utc.usu.edu/keys/Carex/Carex.html> > _______________________________________________ > tdwg mailing list > tdwg(a)lists.tdwg.org > http://lists.tdwg.org/mailman/listinfo/tdwg <http://lists.tdwg.org/mailman/listinfo/tdwg> > > > _______________________________________________ > tdwg mailing list > tdwg(a)lists.tdwg.org > http://lists.tdwg.org/mailman/listinfo/tdwg _______________________________________________ tdwg mailing list tdwg(a)lists.tdwg.org http://lists.tdwg.org/mailman/listinfo/tdwg -- Robert A. Morris Professor of Computer Science UMASS-Boston ram(a)cs.umb.edu http://bdei.cs.umb.edu/ http://www.cs.umb.edu/~ram http://www.cs.umb.edu/~ram/calendar.html <http://www.cs.umb.edu/~ram/calendar.html> phone (+1)617 287 6466

2 3

RE: [tdwg] Species pages and video
by Emery, Rob 29 Aug '07

29 Aug '07

Hello Everyone, More and more we are using very high quality auto montage stills to provide diagnostic images with almost unlimited depth of field e.g. http://www.padil.gov.au/viewPestDiagnosticImages.aspx?id=677 It only occurred to us recently when presenting to farmers that these images, while spectacular, are not much use in helping them identify farm pests by eye or with a hand lens. We decided to take video of the pests because it gives farmers a better idea of what they are looking for. The movement of the insects can help distinguish them as can a backdrop of the environment where they are likely to be found. We have now incorporated mpeg video into a number of our database-driven species profile pages. One of the links below has the video pop up in the player and the other should run embedded in the web page. The range of stored grain protectants in Australia have varying efficacy against species so we expect farmers to be able to perform some rudimentary identification when deciding on a treatment. We recently uploaded these videos to YouTube because... well... we could. http://agspsrv34.agric.wa.gov.au/ento/agird/pestweb/Query1_1.idc?ID=-991 113051 http://agspsrv34.agric.wa.gov.au/ento/pestweb/Query1_1.idc?ID=904621453 Regards, Rob -------------------------------------------------- Rob Emery (Mr) (Senior Entomologist) ph: 61 8 9368 3247 Fax: 61 8 9368 3223 Mob: 0404 819 601 <mailto:remery@agric.wa.gov.au> <http://www.agric.wa.gov.au/ento> Department of Agriculture and Food Western Australia 3 Baron-Hay Court, _-_|\ South Perth, 6151 / \ Western Australia --> \_.-._/ v This e-mail and files transmitted with it are privileged and confidential information intended for the use of the addressee. The confidentiality and/or privilege in this e-mail is not waived, lost or destroyed if it has been transmitted to you in error. If you received this e-mail in error you must (a) not disseminate, copy or take any action in reliance on it; (b) please notify the Department of Agriculture and Food, WA immediately by return e-mail to the sender; (c) please delete the original e-mail. This email has been successfully scanned by McAfee Anti-Virus software. Department of Agriculture and Food WA

1 0

Species pages and video
by Timothy M. Jones 28 Aug '07

28 Aug '07

Hello, I will not be attending the meeting this fall but thought that this may be of interest to those interested in species pages models. I am working on species pages that include the use of video. The videos were only added a month ago and are a bit rudimentary (with budget-conscious equipment) but the potential now seems truly limitless. Examples - http://utc.usu.edu/factsheets/CarexFSF/new/carex_eburnea_species.htm http://utc.usu.edu/factsheets/CarexFSF/new/carex_nebrascensis_species.htm http://utc.usu.edu/factsheets/CarexFSF/new/carex_mitchelliana_species.htm Comments appreciated, Timothy M. Jones http://utc.usu.edu/keys/Carex/Carex.html

12 14

Simple reference search & discovery
by Shorthouse, David 21 Aug '07

21 Aug '07

Folks, Rod Page has a slick scientific reference parser at http://bioguid.info/references and has also made an XML- & JSON- (with optional callback) generating function with full references as input parameter. I won't describe the guts of the parser & how it works, but will instead leave that heavy lifting to Rod. You may read more about it here: http://tinyurl.com/ynw2q2. I made a simple gadget for web page developers/authors to take advantage of this superb service. All you have to do is insert one line in the page header to insert a JavaScript file, download a few small icons and make them available to the JavaScript (one minor edit in the script), and adjust the markup associated with your references as follows: This is one full reference This is another full reference .and the functions in the JavaScript insert search icons for each reference. Upon receiving a visitor's click, a reference is shuttled off to Rod's parser and, after a very brief moment, the search icon changes to a clickable icon depending on what was found in the DOI, handle, PDF world. You can read more, get the script & icons, & try it out on a Blogger post here: http://tinyurl.com/ytqxo6. What's the point to all this? Well, old reprints are being scanned (& hopefully being assigned DOIs) all over the place. As a web page author, it's a pain the neck to stay on top of this game and yet there a strong desire to make references on a page clickable such that visitors can immediately download the article(s). There are other solutions to this, but my goal was to make a tool that is very simple to implement & intuitively obvious for visitors. Caveats: 1) Only scientific articles in journals will return successful responses, but of course nothing in life is guaranteed 2) There are a ton of ways a full reference to an article can be written. Successful response from Rod's service depends on the structure of these references between the elements. Before including this JavaScript and adjusting the markup on your web pages, you'd best try a few at http://bioguid.info/references. 3) Rod tweaks and updates services at http://bioguid.info on a regular basis so consider all this bleeding edge Have fun! David P. Shorthouse ------------------------------------------------------ Department of Biological Sciences CW-403, Biological Sciences Centre University of Alberta Edmonton, AB T6G 2E9 mailto:dps1@ualberta.ca http://canadianarachnology.webhop.net http://arachnidforum.webhop.net http://www.spiderwebwatch.org <http://www.spiderwebwatch.org/> ------------------------------------------------------

1 0

Biodiversity Informatics programmer position, Kansas State University
by Mark Mayfield 20 Aug '07

20 Aug '07

Dear Colleagues, I would like to make you aware of a new opportunity for a programmer (http://www.lib.ksu.edu/news/bisprogrammer.html) involving the exposure and presentation of biodiversity data at Kansas State University in Manhattan, Kansas. This position offers a great opportunity to showcase the use existing standards and applications to format web output related to biodiversity. Please circulate this announcement to anyone you think may be interested or appropriate. Note that review of applications begins September 14 and continues until the position is filled. Also note that although I am not the contact for application I'd be happy to address inquiries about the position. Thanks, Mark Mark H. Mayfield Research Asst. Professor Herbarium-Division of Biology Kansas State University Manhattan, Kansas 66506 785-532-2795 Announcement: K-State [Kansas State University] Libraries seeks a skilled and motivated programmer to join its team in developing and supporting the Biodiversity Information System (BiodIS) through a grant-funded collaboration of the Libraries, Division of Biology, and the Department of Entomology. This position offers an interesting array of development projects dedicated to providing unique content and innovative access tools to BiodIS users. Salary range is $50-60,000 per year commensurate with qualifications and experience. This is a term position with current funding for 4 years (additional funding is being sought). For further details see the full job posting at http://www.lib.ksu.edu/news/bisprogrammer.html.

1 0

TDWG 2007 REMINDER: deadline for Abstracts and Regular Registration fee
by Weitzman, Anna 14 Aug '07

14 Aug '07

REMINDER in just over 24 hours (15 August 2007, 23:59 UTC) Registration fees increase AND Abstracts are due for TDWG 2007 TDWG 2007 will be held 16-22 September 2007 in Bratislava, Slovakia. I urge everyone interested in Biodiversity Informatics to see http://www.tdwg.org/conference2007/programme/schedule/ for the complete schedule of talks. I am particularly impressed by the strength (depth and breadth) of this year's schedule. If you have been contemplating joining or wondering how TDWG can serve taxonomists better, why not come and see what we are up to and raise your needs if they are not on the Biodiversity Informatics Standards horizon? While the schedule for talks is NEARLY full, there is still time to submit abstracts for posters and/or computer demonstrations. Bratislava is just across the Danube from Vienna and is a very attractive destination. There is still plenty of reasonable accommodation available (see http://www.tdwg.org/conference2007/housingtravel/ for information about the venue, accommodation, etc.), so please consider joining us for a great meeting. Regards, Anna Anna L. Weitzman, PhD TDWG Journal Editor Botanical and Biodiversity Informatics Research National Museum of Natural History Smithsonian Institution office: 202.633.0846 mobile: 202.415.4684 weitzman(a)si.edu

1 0