Siegfried development benchmarks
Fri, 17 Jan 2020 19:06:48 UTC
Environment
These benchmarks were automatically run on a t1.small.x86 machine provisioned from https://www.packet.net/.
Specs for the t1.small.x86: 4 Physical Cores @ 2.4 GHz; 8 GB DDR3 RAM; 80 GB SSD.
You can inspect the commands that were run to generate these benchmarks here.
Tools
| Tool | Version |
|---|---|
| master | siegfried 1.7.13 /root/siegfried/default.sig (2019-08-18T15:32:39+02:00) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml |
| develop | siegfried 1.8.0 /root/siegfried/dev.sig (2020-01-17T19:06:48Z) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml |
iPRES Systems Showcase
A corpus created for the 2014 iPRES conference comprising 2,206 files (5GB). Represents a range of formats, including AV and some uncommon types. Sourced from http://www.webarchive.org.uk/datasets/ipres.ds.1/
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 35.638499062s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 35.67518665s |
The tools differed in output for 0 files in the corpus.
PRONOM files
A corpus created by Greg Lepore and comprising 1,205 files (2.1GB). Includes a single sample of as many of the PRONOM IDs (PUIDs) that Greg could find.
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 6.772402429s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 6.912226876s |
The tools differed in output for 0 files in the corpus.
Govdocs (Selected)
A selection from the Govdocs1 corpus comprising 26,124 files (31.4GB). Represents typical office formats, including approx. 15,000 PDFs. Originally sourced from http://openpreservation.org/blog/2012/07/26/1-million-21000-reducing-govdocs-significantly/
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 7m17.294073284s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 6m39.144029737s |
The tools differed in output for 0 files in the corpus.
The Deluxe
This benchmark checks multi-ID identification using the deluxe.sig signature file which contains four identifiers: PRONOM, LOC FDDs, freedesktop.org and tika-mimetypes. This benchmark is run against the PRONOM files corpus.
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 13.019781111s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 12.978634387s |
The tools differed in output for 3 files in the corpus.
| file | master | develop |
| /root/corpora/pronom-files/fmt_2_Broadcast WAVE_muellersfritz.de_.cm4all_iproc.php_laptop.mp3_cdp=a.wav | audio/vnd.wave;audio/x-wav;fdd000118;fmt/2 | audio/vnd.wave;audio/x-wav;fdd000012;fmt/2 |
| /root/corpora/pronom-files/fmt_464_CorelDraw_Drawing_mba_strp.cdr | application/coreldraw;application/vnd.corel-draw;fdd000118;fmt/464 | application/coreldraw;application/vnd.corel-draw;fdd000012;fmt/464 |
| /root/corpora/pronom-files/x-fmt_311_dbase_text_memo.dbt | UNKNOWN;UNKNOWN;UNKNOWN;image/vnd.zbrush.pcx | UNKNOWN;UNKNOWN;image/vnd.zbrush.pcx;image/vnd.zbrush.pcx |
Unzipping
This benchmark checks the `sf -z` command (scans within zip files and other container formats) when run against the iPres corpus.
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 1m36.214653024s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 1m35.79367314s |
The tools differed in output for 0 files in the corpus.
Profile
