M00021045
New product
INFORMATION AND DOCUMENTATION - WARC FILE FORMAT
British Standards Institution
In stock
Warning: Last items in stock!
Availability date: 11/05/2021
Foreword<br>Introduction<br>1 Scope<br>2 Normative references<br>3 Terms, definitions and abbreviated terms<br>4 File and record model<br>5 Named fields<br>6 WARC record types<br>7 Record segmentation<br>8 WARC file name, size and compression<br>Annex A (informative) - Use cases for writing WARC<br> records<br>Annex B (informative) - Examples of WARC records<br>Annex C (informative) - WARC file size and name<br> recommendations<br>Annex D (informative) - Compression recommendations<br>Bibliography
Defines the WARC file format: - to store both the payload content and control information from mainstream Internet application layer protocols, such as the HTTP, DNS, and FTP; - to store arbitrary metadata linked to other stored data (e.g. subject classifier, discovered language, encoding); - to support data compression and maintain data record integrity; - to store all control information from the harvesting protocol (e.g. request headers), not just response information; - to store the results of data transformations linked to other stored data; - to store a duplicate detection event linked to other stored data (to reduce storage in the presence of identical or substantially similar resources); - to be extended without disruption to existing functionality; - to support handling of overly long records by truncation or segmentation, where desired.
Published | |
Document Type | Standard |
Status | Current |
Publisher | British Standards Institution |
Pages | |
ISBN | |
Committee | IDT/2/7 |
Supersedes |
|