The Metadata in TIFF files » History » Revision 7
« Previous |
Revision 7/20
(diff)
| Next »
Robin Mills, 12 Nov 2016 17:27
The Metadata in TIFF files¶
The Tagged Image File Format is a container. It's very flexible and can deal with multiple pages, different colour spaces, frame configurations as well as metadata. The specification is available from: https://partners.adobe.com/public/developer/en/tiff/TIFF6.pdf
The format is quite simple and consists of a fixed format header (of 8 bytes) which provides the offset of a directory of records. A directory has a two byte header which contains the length of the directory followed by 12 byte field or "tag". The final entry in the directory is always the offset to the next dictionary. A dictionary of length == 0 terminates the directory chain.
A tag consists of a 12 byte record: TagID, TagType, Count and Offset which are 2,2,4 and 4 bytes respectively. The TagID defines the purpose of the record (Width, Height, ColorSpace etc) and the TagType defines the data format. Count and Offset are used to contain the raw data or provide an offset in the file at which to read the raw data for this tag.
This is described in the specification. The code in tiff image.cpp/ TiffImage::printStructure() decodes the dictionaries.
The TIFF container is so flexible it is used as the structure for most RAW formats including Adobe's DNG. Additionally the TIFF container is used to store the metadata that lies inside the Exif blocks embedded in JPEG and PNG files.
There is a 64bit version of Tiff called BigTiff. This is currently not supported by exiv2.
Example:
The version of exiv2(.exe) which ships with v0.25 provides options -pS
to reveals the structure of the TIFF and option -pX
is used to extract the raw XMP/xml data. The option -pa is used to print the metadata in human readable format.
$ exiv2 -pa ~/tif Exif.Image.ImageWidth Short 1 40 Exif.Image.ImageLength Short 1 470 Exif.Image.BitsPerSample Short 3 8 8 8 Exif.Image.Compression Short 1 LZW Exif.Image.PhotometricInterpretation Short 1 RGB Exif.Image.StripOffsets Long 1 2694 Exif.Image.Orientation Short 1 right, top Exif.Image.SamplesPerPixel Short 1 3 Exif.Image.RowsPerStrip Short 1 1092 Exif.Image.StripByteCounts Long 1 5086 Exif.Image.PlanarConfiguration Short 1 1 Exif.Image.Predictor Short 1 Horizontal differencing Exif.Image.SampleFormat Short 3 Unsigned integer data Exif.Image.XMLPacket Byte 2500 (Binary value suppressed) Xmp.dc.title LangAlt 1 lang="x-default" this is a title /Users/rmills/tif: (No IPTC data found in the file) $ exiv2 -pS ~/tif STRUCTURE OF TIFF FILE: /Users/rmills/tif address | tag | type | count | offset | value 10 | 0x0100 ImageWidth | SHORT | 1 | 2621440 | 40 22 | 0x0101 ImageLength | SHORT | 1 | 30801920 | 470 34 | 0x0102 BitsPerSample | SHORT | 3 | 182 | 46 | 0x0103 Compression | SHORT | 1 | 327680 | 5 58 | 0x0106 PhotometricInterpret | SHORT | 1 | 131072 | 2 70 | 0x0111 StripOffsets | LONG | 1 | 2694 | 0 82 | 0x0112 Orientation | SHORT | 1 | 393216 | 6 94 | 0x0115 SamplesPerPixel | SHORT | 1 | 196608 | 3 106 | 0x0116 RowsPerStrip | SHORT | 1 | 71565312 | 1092 118 | 0x0117 StripByteCounts | LONG | 1 | 5086 | 0 130 | 0x011c PlanarConfiguration | SHORT | 1 | 65536 | 1 142 | 0x013d Predictor | SHORT | 1 | 131072 | 2 154 | 0x0153 SampleFormat | SHORT | 3 | 188 | 166 | 0x02bc XMLPacket | BYTE | 2500 | 194 | <?xpacket begin="..." id="W5M0Mp ... $ exiv2 -pX ~/tif | xmllint -pretty 1 - <?xml version="1.0"?> <?xpacket begin="" id="W5M0MpCehiHzreSzNTczkc9d"?> <x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0-Exiv2"> <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <rdf:Description xmlns:dc="http://purl.org/dc/elements/1.1/" rdf:about=""> <dc:title> <rdf:Alt> <rdf:li xml:lang="x-default">this is a title</rdf:li> </rdf:Alt> </dc:title> </rdf:Description> </rdf:RDF> </x:xmpmeta> <?xpacket end="w"?> 855 rmills@rmillsmbp:~/Documents/exiv2 $
You can clearly see the XMLPacket is stored at offset 194 into the file and consists of 2500 bytes. You can of course directly extract the XMP with the following command which says: set the block size to 1 byte, skip 194 bytes and dump the next 2500 bytes:
863 rmills@rmillsmbp:~/Documents/exiv2 $ dd bs=1 skip=194 count=2500 if=~/tif | xmllint -pretty 1 - 2500+0 records in 2500+0 records out 2500 bytes transferred in 0.005714 secs (437526 bytes/sec) <?xml version="1.0"?> <?xpacket begin="" id="W5M0MpCehiHzreSzNTczkc9d"?> <x:xmpmeta xmlns:x="adobe:ns:meta/" x:xmptk="XMP Core 4.4.0-Exiv2"> <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <rdf:Description xmlns:dc="http://purl.org/dc/elements/1.1/" rdf:about=""> <dc:title> <rdf:Alt> <rdf:li xml:lang="x-default">this is a title</rdf:li> </rdf:Alt> </dc:title> </rdf:Description> </rdf:RDF> </x:xmpmeta> <?xpacket end="w"?> 864 rmills@rmillsmbp:~/Documents/exiv2 $The option
-pX
doesn't actually use dd to achieve the same result and is much more convenient to use.
To demonstrate that the metadata block in a JPEG is a TIFF file, extract and print the structure.
$ exiv2 -pS ~/jpg STRUCTURE OF JPEG FILE: /Users/rmills/jpg address | marker | length | data 2 | 0xd8 SOI 4 | 0xe1 APP1 | 14862 | Exif..II*..................... 14868 | 0xe1 APP1 | 2720 | http://ns.adobe.com/xap/1.0/.< 17590 | 0xed APP13 | 110 | Photoshop 3.0.8BIM.......6.... 17702 | 0xe2 APP2 | 4094 | MPF.II*...............0100.... 21798 | 0xdb DQT | 132 21932 | 0xc0 SOF0 | 17 21951 | 0xc4 DHT | 418 22371 | 0xda SOS | 12 $ dd bs=1 skip=12 count=14862 if=~/jpg of=bull.tif 14862+0 records in 14862+0 records out 14862 bytes transferred in 0.038783 secs (383211 bytes/sec) $ exiv2 -pS bull.tif STRUCTURE OF TIFF FILE: bull.tif address | tag | type | count | offset | value 10 | 0x010f Make | ASCII | 18 | 134 | NIKON CORPORATION. 22 | 0x0110 Model | ASCII | 12 | 152 | NIKON D5300. 34 | 0x0112 Orientation | SHORT | 1 | 1 | 1 46 | 0x011a XResolution | RATIONAL | 1 | 164 | 58 | 0x011b YResolution | RATIONAL | 1 | 172 | 70 | 0x0128 ResolutionUnit | SHORT | 1 | 2 | 2 82 | 0x0131 Software | ASCII | 10 | 180 | Ver.1.00 . 94 | 0x0132 DateTime | ASCII | 20 | 190 | 2015:02:13 20:46:51. 106 | 0x0213 YCbCrPositioning | SHORT | 1 | 1 | 1 118 | 0x8769 ExifTag | LONG | 1 | 210 | 210 4080 | 0x0103 Compression | SHORT | 1 | 6 | 6 4092 | 0x011a XResolution | RATIONAL | 1 | 4168 | 4104 | 0x011b YResolution | RATIONAL | 1 | 4176 | 4116 | 0x0128 ResolutionUnit | SHORT | 1 | 2 | 2 4128 | 0x0201 JPEGInterchangeForma | LONG | 1 | 4184 | 4184 4140 | 0x0202 JPEGInterchangeForma | LONG | 1 | 10670 | 10670 4152 | 0x0213 YCbCrPositioning | SHORT | 1 | 1 | 1 $The version of the exiv2 command-line program that ships with v0.26 later has an option
-pR
with recursively prints the structure of an image file. By recursive we mean the utility will print the structures while reside inside other structures. For example, the Exif metadata in a JPEG is a encoded as a TIFF embedded in the file. 543 rmills@rmillsmbp:~/gnu/exiv2/trunk $ exiv2 -pR test/data/Reagan.jpg STRUCTURE OF JPEG FILE: test/data/Reagan.jpg address | marker | length | data 0 | 0xffd8 SOI 2 | 0xffe1 APP1 | 5718 | Exif..MM.*...................... STRUCTURE OF TIFF FILE (MM): MemIo address | tag | type | count | offset | value 10 | 0x0100 ImageWidth | SHORT | 1 | 13107200 | 200 22 | 0x0101 ImageLength | SHORT | 1 | 8519680 | 130 34 | 0x0102 BitsPerSample | SHORT | 4 | 242 | 8 8 8 8 46 | 0x0103 Compression | SHORT | 1 | 65536 | 1 58 | 0x0106 PhotometricInterpretation | SHORT | 1 | 131072 | 2 70 | 0x010e ImageDescription | ASCII | 403 | 250 | 040621-N-6536T-062.USS Ronald Re ... 82 | 0x010f Make | ASCII | 18 | 653 | NIKON CORPORATION 94 | 0x0110 Model | ASCII | 10 | 671 | NIKON D1X 106 | 0x0112 Orientation | SHORT | 1 | 65536 | 1 118 | 0x0115 SamplesPerPixel | SHORT | 1 | 262144 | 4 130 | 0x011a XResolution | RATIONAL | 1 | 681 | 681/0 142 | 0x011b YResolution | RATIONAL | 1 | 689 | 689/0 154 | 0x011c PlanarConfiguration | SHORT | 1 | 65536 | 1 166 | 0x0128 ResolutionUnit | SHORT | 1 | 131072 | 2 178 | 0x0131 Software | ASCII | 40 | 697 | Adobe Photoshop Elements 12.0 Ma ... 190 | 0x0132 DateTime | ASCII | 20 | 737 | 2016:09:13 11:58:16 202 | 0x013b Artist | ASCII | 34 | 757 | Photographer..s Mate 3rd Class ( ... 214 | 0x8769 ExifTag | LONG | 1 | 792 | 792 STRUCTURE OF TIFF FILE (MM): MemIo address | tag | type | count | offset | value 794 | 0x829a ExposureTime | RATIONAL | 1 | 1254 | 1254/0 806 | 0x829d FNumber | RATIONAL | 1 | 1262 | 1262/0 818 | 0x8822 ExposureProgram | SHORT | 1 | 65536 | 1 830 | 0x9000 ExifVersion | UNDEFINED | 4 | 808596016 | 0220 842 | 0x9003 DateTimeOriginal | ASCII | 20 | 1270 | 2004:06:21 23:37:53 854 | 0x9004 DateTimeDigitized | ASCII | 20 | 1290 | 2004:06:21 23:37:53 866 | 0x9101 ComponentsConfiguration | UNDEFINED | 4 | 16909056 | ... 878 | 0x9102 CompressedBitsPerPixel | RATIONAL | 1 | 1310 | 1310/0 890 | 0x9201 ShutterSpeedValue | SRATIONAL | 1 | 1318 | 1318/0 902 | 0x9202 ApertureValue | RATIONAL | 1 | 1326 | 1326/0 914 | 0x9204 ExposureBiasValue | SRATIONAL | 1 | 1334 | 1334/0 926 | 0x9205 MaxApertureValue | RATIONAL | 1 | 1342 | 1342/0 938 | 0x9207 MeteringMode | SHORT | 1 | 131072 | 2 950 | 0x9208 LightSource | SHORT | 1 | 655360 | 10 962 | 0x9209 Flash | SHORT | 1 | 0 | 0 974 | 0x920a FocalLength | RATIONAL | 1 | 1350 | 1350/0 986 | 0x9290 SubSecTime | ASCII | 3 | 808845312 | 06 998 | 0x9291 SubSecTimeOriginal | ASCII | 3 | 808845312 | 06 1010 | 0x9292 SubSecTimeDigitized | ASCII | 3 | 808845312 | 06 1022 | 0xa000 FlashpixVersion | UNDEFINED | 4 | 808529968 | 0100 1034 | 0xa001 ColorSpace | SHORT | 1 |4294901760 | 65535 1046 | 0xa002 PixelXDimension | LONG | 1 | 200 | 200 1058 | 0xa003 PixelYDimension | LONG | 1 | 130 | 130 1070 | 0xa217 SensingMethod | SHORT | 1 | 131072 | 2 1082 | 0xa300 FileSource | UNDEFINED | 1 | 50331648 | . 1094 | 0xa301 SceneType | UNDEFINED | 1 | 16777216 | . 1106 | 0xa401 CustomRendered | SHORT | 1 | 0 | 0 1118 | 0xa402 ExposureMode | SHORT | 1 | 65536 | 1 1130 | 0xa403 WhiteBalance | SHORT | 1 | 65536 | 1 1142 | 0xa404 DigitalZoomRatio | RATIONAL | 1 | 1358 | 1358/0 1154 | 0xa405 FocalLengthIn35mmFilm | SHORT | 1 | 4128768 | 63 1166 | 0xa406 SceneCaptureType | SHORT | 1 | 0 | 0 1178 | 0xa407 GainControl | SHORT | 1 | 0 | 0 1190 | 0xa408 Contrast | SHORT | 1 | 0 | 0 1202 | 0xa409 Saturation | SHORT | 1 | 0 | 0 1214 | 0xa40a Sharpness | SHORT | 1 | 0 | 0 1226 | 0xa40c SubjectDistanceRange | SHORT | 1 | 0 | 0 1238 | 0xa420 ImageUniqueID | ASCII | 33 | 1366 | 127c1377b054a3f65bf2754ebb24e7f2 ... END MemIo 226 | 0x8825 GPSTag | LONG | 1 | 1400 | 1400 1422 | 0x0103 Compression | SHORT | 1 | 393216 | 6 1434 | 0x011a XResolution | RATIONAL | 1 | 1498 | 1498/0 1446 | 0x011b YResolution | RATIONAL | 1 | 1506 | 1506/0 1458 | 0x0128 ResolutionUnit | SHORT | 1 | 131072 | 2 1470 | 0x0201 JPEGInterchangeFormat | LONG | 1 | 1514 | 1514 1482 | 0x0202 JPEGInterchangeFormatLeng | LONG | 1 | 4196 | 4196 END MemIo 5722 | 0xffed APP13 | 3038 | Photoshop 3.0.8BIM..........Z... Record | DataSet | Name | Length | Data 1 | 90 | CharacterSet | 3 | .%G 1 | 90 | CharacterSet | 3 | .%G 2 | 0 | RecordVersion | 2 | .. 2 | 120 | Caption | 402 | 040621-N-6536T-062.USS Ronald Reagan (CV... 2 | 122 | Writer | 9 | Dir. NVNS 2 | 40 | SpecialInstructions | 49 | Credit as U.S. Navy photo by Elizabeth T... 2 | 80 | Byline | 32 | Photographer..s Mate 3rd Class ( 2 | 85 | BylineTitle | 21 | U.S Navy Photographer 2 | 110 | Credit | 8 | U.S Navy 2 | 115 | Source | 24 | Navy Visual News Service 2 | 5 | ObjectName | 18 | 040621-N-6536T-062 2 | 55 | DateCreated | 8 | 20040621 2 | 60 | TimeCreated | 11 | 000000+0000 2 | 62 | DigitizationDate | 8 | 20040621 2 | 63 | DigitizationTime | 11 | 233753-0400 2 | 90 | City | 19 | Straits of Magellan 2 | 101 | CountryName | 13 | South America 2 | 15 | Category | 1 | N 2 | 20 | SuppCategory | 12 | 703-614-9154 2 | 20 | SuppCategory | 23 | navyvisualnews@navy.mil 2 | 20 | SuppCategory | 11 | UNCLASSFIED 2 | 10 | Urgency | 1 | 5 2 | 25 | Keywords | 13 | ronald reagan 2 | 25 | Keywords | 6 | reagan 2 | 25 | Keywords | 6 | cvn 76 2 | 25 | Keywords | 6 | cvn-76 2 | 25 | Keywords | 18 | straights magellan 2 | 25 | Keywords | 8 | magellan 2 | 25 | Keywords | 7 | carrier 2 | 25 | Keywords | 12 | nimitz-class 2 | 25 | Keywords | 4 | ship 2 | 25 | Keywords | 8 | underway 8762 | 0xffe1 APP1 | 5329 | http://ns.adobe.com/xap/1.0/.<?x 14093 | 0xffe2 APP2 | 576 | ICC_PROFILE......0ADBE....mntrRG chunk 1/1 14671 | 0xffee APP14 | 14 | Adobe.d@...... 14687 | 0xffdb DQT | 132 14821 | 0xffc0 SOF0 | 17 14840 | 0xffdd DRI | 4 14846 | 0xffc4 DHT | 418 15266 | 0xffda SOS 544 rmills@rmillsmbp:~/gnu/exiv2/trunk $
Updated by Robin Mills about 5 years ago · 7 revisions