nate trail network development & marc standards office 8/1/2006 with help from sydney olive how...
TRANSCRIPT
![Page 1: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/1.jpg)
Nate TrailNetwork Development & MARC Standards Office8/1/2006
With help from Sydney Olive
How to Build, Display and Find METS Objects
![Page 2: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/2.jpg)
•A little about the technology
•How we use it
•Searching and Lucene
•Cocoon Tools
•Future Directions
•Conclusions
Outline
![Page 3: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/3.jpg)
Technology Used• XML documents (METS, MODS, etc.)
• METS Object
• XSL processes • Transformation or display
• Cocoon framework (and a little Java)
![Page 4: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/4.jpg)
XSL for Transformation
![Page 5: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/5.jpg)
XSL for Display
![Page 6: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/6.jpg)
• User input via URL matches
Cocoon Concepts (1)
–<map:match pattern="navigation/*">
<map:generate src="cocoon:/{1}/mets.xml"/>
<map:transform src="navigation.xsl"/>
<map:serialize type="xml"/>–</map:match>
![Page 7: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/7.jpg)
• Combine small matches to create
a pipeline
• Separate Data from Action and Design
Cocoon Concepts (2)
![Page 8: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/8.jpg)
• Database SQL processing
MySQL extract
MODS (SRU)(Three masters LC publication)
How we use it (1)
![Page 9: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/9.jpg)
• METS making pipeline:
o MySQL extract MODS
o ObjectType, Files, MODS, rights datao METSMaker stylesheet uses ObjectType to
create links among files and descriptive metadata, based on METS profile: METS
How we use it (2)
![Page 10: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/10.jpg)
• Cocoon for Display o Navigation, Description,
Pageturning
o xml data for display
o add header, footer,
breadcrumbs
o VHP presentations
How we use it (3)
![Page 11: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/11.jpg)
Searching and Lucene
• We have XML objects, so we need an XML based search system.
• Cocoon comes with Lucene.
• Lucene indexes are easy to configure and modify: METS In x t mde ed i e
![Page 12: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/12.jpg)
Searching
• Search page – limit search to certain object types,
– search certain fields only, or
– search all (default)
• Canned search as collection presentation tool (LC Publications, baseball)
• New browsing capability
![Page 13: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/13.jpg)
Cocoon Tools (1)
• METS Profile Validation (fs01)
• SQL : query any Oracle, MySQL tables from the browser to get back XML
![Page 14: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/14.jpg)
Cocoon Tools (2)
• Site administration, enhancement of processes
– Get IDs for some set of the database for extraction, cleanup
– Convert from MARC to MODS (input) or MODS to MARC: (extract)
– Convert HTML to XML
– Detect deletions of objects
– Link checking
– Search for MARC records using SRU
![Page 15: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/15.jpg)
Future Directions
• New Behaviors, Profiles (Article OCR) (Multivolume Monograph / rarebook source)
• RSS• Integrate profile validation with METS building• Integrate JHOVE file inspection tool (MIX)• Investigate using JPEG2000 file format for image
manipulation enhancement• Submit objects to a repository• Exchange objects with another entity
![Page 16: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/16.jpg)
Conclusions
• What are we learning from building this application?
![Page 17: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/17.jpg)
Conclusions
• The METS standard is flexible enough to describe multiple kinds of complex objects
![Page 18: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/18.jpg)
Conclusions
• METS Profiles help define an object and it’s range of behaviors
![Page 19: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/19.jpg)
Conclusions
• METS and MODS play well together.
![Page 20: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/20.jpg)
Conclusions
• METS files can be built automatically.
![Page 21: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/21.jpg)
Conclusions
• It may look hard, but METS objects can be parsed, validated and used without difficulty
![Page 22: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/22.jpg)
Conclusions
• MODS is extremely powerful as a structural tool, not just a bibliographic tool
• (but good, consistent, authoritative cataloging makes search and display
much more reliable)
![Page 23: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/23.jpg)
Conclusions
• Display is for today only; well structured data lasts.
![Page 24: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/24.jpg)
Conclusions
Without standardized structures, we end up with egg on our face.
![Page 26: Nate Trail Network Development & MARC Standards Office 8/1/2006 With help from Sydney Olive How to Build, Display and Find METS Objects](https://reader030.vdocuments.mx/reader030/viewer/2022032612/56649eef5503460f94bfeb36/html5/thumbnails/26.jpg)
Get back to work!!
Photos © 2006 Nate Trail