![Page 1: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/1.jpg)
File Formats and Significant Properties
Manfred ThallerUniversität zu* Köln
March 24th, 2009
*University at not of Cologne
![Page 2: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/2.jpg)
I – What is (in) a format?
2
![Page 3: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/3.jpg)
An image
![Page 4: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/4.jpg)
An image6 rows5 columns
![Page 5: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/5.jpg)
5 rows6 columns
![Page 6: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/6.jpg)
An image1 1 1 1 11 0 0 0 11 1 0 1 11 1 0 1 11 1 0 1 11 1 1 1 1
1 == ochre0 == red
![Page 7: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/7.jpg)
An image1 1 1 1 11 0 0 0 11 1 0 1 11 1 0 1 11 1 0 1 11 1 1 1 1
1 == blue0 == yellow
![Page 8: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/8.jpg)
An image1 1 1 1 11 0 0 0 11 1 0 1 11 1 0 1 11 1 0 1 11 1 1 1 1
Store:1,1,1,1,1,1,0,0,0,1,1,1,0,1,1,1,1,0,1,1,1,1,0,1,1,1,1,1,1,1
![Page 9: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/9.jpg)
An image1 1 1 1 11 0 0 0 11 1 0 1 11 1 0 1 11 1 0 1 11 1 1 1 1
Store:1,1,1,1,1,1,0,0,0,1,1,1,0,1,1,1,1,0,1,1,1,1,0,1,1,1,1,1,1,1
Uncompressed
![Page 10: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/10.jpg)
An image1 1 1 1 11 0 0 0 11 1 0 1 11 1 0 1 11 1 0 1 11 1 1 1 1
Store:6,1,3,0,3,1,1,0,4,1,1,0,4,1,1,0,7,1
(Compressed)Run LengthEncoded
![Page 11: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/11.jpg)
An image6 rows5 columns
1 == ochre0 == red
Uncompressed
![Page 12: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/12.jpg)
An imagedimensions
1 == ochre0 == red
Uncompressed
![Page 13: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/13.jpg)
An imagedimensions
photogrammetricinterpretation
Uncompressed
![Page 14: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/14.jpg)
An imagedimensions
photogrammetricinterpretation
compression
![Page 15: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/15.jpg)
An image<basicinformation>
<renderinginformation>
<storageinformation>
![Page 16: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/16.jpg)
File format<basic information>
What to do?<rendering information>
How to do it?<storage information>
How to move it from persistent todeployed form?<data>
What to deploy?
![Page 17: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/17.jpg)
File format<basic information>
Mandatory<rendering information>
Useful<storage information>
Historical<data>
Mandatory
![Page 18: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/18.jpg)
File formatA deterministic specification how theproperties of a digital object can reversiblybe converted into a linear bytestream(bitstream).
![Page 19: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/19.jpg)
II – Why would we want to know?
![Page 20: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/20.jpg)
Bit rotAn Image filebefore ….
![Page 21: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/21.jpg)
... and afterone byte ischanged.
Bit rotUndetectableby software.
![Page 22: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/22.jpg)
002 004
234 123
234 156
127 178
221 221
Processing dictionary
Payload
Bit rot
![Page 23: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/23.jpg)
002 004
234 123
234 156
127 xxx
221 221
One byte is damaged, one bytecannot be displayed correctly.
Bit rot
![Page 24: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/24.jpg)
002 xxx
234 123
234 156
127 178
221 221
One byte is damaged, ten bytescannot be displayed correctly.
Bit rot
![Page 25: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/25.jpg)
But 1 …
Why should I care? Can I not just pay a technician to keep some system of checksums?
Counter-but 1 …Do you rather buy a brand of car with a reputation of an excellent network of maintenance shops, or one with a reputation for needing little maintenance?
![Page 26: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/26.jpg)
But 2 …
But is bit rot really that important? I have read, that files most of the time get either unreadable completely, or stay completely undamaged?
Counter-but 2a …In disaster recovery: yes!With files on degrading storage systems / devices: no!
![Page 27: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/27.jpg)
But 2 …But is bit rot really that important?
Counter-but 2b …Bit rot is, indeed, just one problem.!We do this is just to show, that there are differences between the technical fitness for preservation between formats. Others go beyond 15 minutes.
![Page 28: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/28.jpg)
But 3 …But is there not a simple list in this type of problems, which I can consult easily?
Counter-but 3 …No.
![Page 29: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/29.jpg)
III – Which format to choose?
![Page 30: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/30.jpg)
Recommended formats: textHigh confidence Medium confidence Low confidence
Plain text (encoding: ISO8859-1 - 9, UTF-8, UTF-16 with BOM)
XML (includesXSD/XSL/XHTML, etc.; with included or accessibleschema and characterencoding explicitlyspecified)
PDF/A-1 (ISO 19005-1)
Cascading Style Sheets(*.css)
DTD (*.dtd)PDF (*.pdf) (embedded
fonts)Rich Text Format 1.x
(*.rtf)HTML 4.x (include a
DOCTYPE declaration)SGML (*.sgml)Open Office (*.sxw/*.odt)Office Open XML
(*.docx)
PDF (*.pdf) (encrypted)Microsoft Word (*.doc)WordPerfect (*.wpd)DVI (*.dvi)All other text formats not
listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 31: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/31.jpg)
Recommended formats: bitmap / raster image
High confidence Medium confidence Low confidenceTIFF (uncompressed)PNG (*.png)
BMP (*.bmp)JPEG/JFIF (*.jpg)JPEG2000 (prefer
lossless oruncompressed) (*.jp2)
TIFF (compressed)GIF (*.gif)
MrSID (*.sid)TIFF (in Planar
format) FlashPix (*.fpx)PhotoShop (*.psd)All other raster image
formats not listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 32: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/32.jpg)
Recommended formats: vector graphics
High confidence Medium confidence Low confidenceSVG 1.1 (no Java
binding) (*.svg)Computer Graphic
Metafile (CGM, WebCGM) (*.cgm)
EncapsulatedPostscript (EPS)
Macromedia Flash (*.swf)
All other vector image formats not listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 33: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/33.jpg)
Recommended formats: audioHigh confidence Medium confidence Low confidence
AIFF (PCM) (*.aif, *.aiff)
WAV (PCM) (*.wav)
SUN Audio (uncompressed) (*.au)
Standard MIDI (*.mid,*.midi)
Ogg Vorbis (*.ogg)Free Lossless Audio
Codec (*.flac)Advance Audio
Coding (*.mp4, *.m4a, *.aac)
MP3 (MPEG-1/2, Layer 3)(*.mp3)
AIFC (compressed) (*.aifc)
NeXT SND (*.snd)RealNetworks 'Real
Audio‚ (*.ra, *.rm, *.ram)Windows Media
Audio(*.wma)WAV (compressed)
(*.wav)All other audio formats
not listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 34: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/34.jpg)
Recommended formats: videoHigh confidence Medium confidence Low confidence
Motion JPEG 2000(ISO/IEC 15444-4)(*.mj2)
AVI (uncompressed)(*.avi)
QuickTime Movie(uncompressed)(*.mov)
Motion JPEG (*.avi,*.mov)
Ogg Theora (*.ogg)MPEG-1, MPEG-2
(*.mpg, *.mpeg)MPEG-4(*.mp4)
AVI (compressed) (*.avi)
QuickTime Movie(compressed) (*.mov)
RealNetworks 'Real Video‚ (*.rv)
Windows Media Video(*.wmv)
All other video formats not listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 35: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/35.jpg)
Recommended formats: “data base”High confidence Medium confidence Low confidence
Delimited Text (*.txt,*.csv)
SQL DDL
DBF (*.dbf)OpenOffice
*.sxc/*.ods)Office Open XML
*.xlsx)
Excel (*.xls)All other spreadsheet/
database formats notlisted here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
![Page 36: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/36.jpg)
Recommended formats: 3D (“virtual reality”)
High confidence Medium confidence Low confidenceX3D (*.x3d) VRML (*.wrl, *.vrml)
U3D (Universal 3D fileformat)
All other virtual realityformats not listed here
http://www.fcla.edu/digitalArchive/pdfs/recFormats.pdf
*******
![Page 37: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/37.jpg)
Thank you!
![Page 38: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/38.jpg)
Exercise <format 1>
Size 1 - Count 1 - Shoot:Some <xxx> are not correctly displayedSome <xxx> are not recognized
Size 1 - Count 1 - Corrupt:Unable to open the fileFile size has changed
Size 512 - Count 1 - Shoot:<xxx> are not displayed
<format 2>
…
Our findings support / do not support the Floridarecommendations for this type of content, because …
![Page 39: File Formats and Significant Properties · 2018. 2. 13. · File Formats and Significant Properties Manfred Thaller Universität zu* Köln March 24th, 2009 *University at not of Cologne](https://reader036.vdocuments.mx/reader036/viewer/2022071109/5fe3e5822efac01586718c2e/html5/thumbnails/39.jpg)
Dieses Werk ist unter einem CreativeCommons Namensnennung 3.0
DeutschlandLizenzvertrag lizenziert. Um die Lizenz
anzusehen, gehen Sie bitte zuhttp://creativecommons.org/licenses/by/3.0
/de/ oder schicken Sie einen Brief anCreative Commons, 171 Second Street,
Suite 300, San Francisco, California94105, USA.