Siegfried development benchmarks
Sun, 14 May 2023 20:50:10 UTC
Environment
These benchmarks were run on a e3_1240v5 machine that was automatically provisioned.
Specs for the e3_1240v5: 4 cores @ 3.5GHz, 32GB ECC DDR4 RAM, 2x SSD 250GB.
You can inspect the commands that were run to generate these benchmarks here.
| Tool | Version |
|---|---|
| master | siegfried 1.10.1 /root/siegfried/default.sig (2023-03-23T15:09:43Z) identifiers: - pronom: DROID_SignatureFile_V111.xml; container-signature-20230307.xml |
| develop | siegfried 1.10.1 /root/siegfried/dev.sig (2023-05-14T20:50:11Z) identifiers: - pronom: DROID_SignatureFile_V111.xml; container-signature-20230307.xml |
iPRES Systems Showcase
A corpus created for the 2014 iPRES conference comprising 2,206 files (5GB). Represents a range of formats, including AV and some uncommon types. Sourced from http://www.webarchive.org.uk/datasets/ipres.ds.1/.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 9.425480311s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 8.862456113s |
The tools differed in output for 0 files in the corpus.
iPRES 2022 Pantry
A corpus created for the 2022 iPRES conference Digital Preservation Bake Off Challenge comprising 2,944 files (20.8GB). Includes a number of different content types, ranging from generic and not-so generic PDFs, still images and office documents, to complex objects such as AV, 3D and disk images, to web-based objects such as websites and social media. The ‘exotic ingredients’ section contains data with additional challenges, such as unidentifiable objects, corrupt objects or legacy file formats. Sourced from https://ipres2022.scot/call-for-contributions-2/data-set/.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 25.619188536s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 25.157610419s |
The tools differed in output for 0 files in the corpus.
PRONOM files
A corpus created by Greg Lepore and comprising 1,205 files (2.1GB). Includes a single sample of as many of the PRONOM IDs (PUIDs) that Greg could find.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 2.779280977s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 2.636082962s |
The tools differed in output for 0 files in the corpus.
Govdocs (Selected)
A selection from the Govdocs1 corpus comprising 26,124 files (31.4GB). Represents typical office formats, including approx. 15,000 PDFs. Originally sourced from http://openpreservation.org/blog/2012/07/26/1-million-21000-reducing-govdocs-significantly/.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 1m33.024456375s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 1m29.080177964s |
The tools differed in output for 0 files in the corpus.
The Deluxe
This benchmark checks multi-ID identification using the deluxe.sig signature file which contains four identifiers: PRONOM, LOC FDDs, freedesktop.org and tika-mimetypes. This benchmark is run against the PRONOM files corpus.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 6.480806164s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 6.619116514s |
The tools differed in output for 0 files in the corpus.
Unzipping
This benchmark checks the `sf -z` command (scans within zip files and other container formats) when run against the iPres corpus.
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 24.905398413s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 24.304802366s |
The tools differed in output for 0 files in the corpus.
Profile
