Back to siegfried

Siegfried development benchmarks

Sun, 28 Jul 2019 18:07:57 UTC

Environment

These benchmarks were automatically run on a t1.small.x86 machine provisioned from https://www.packet.net/.

Specs for the t1.small.x86: 4 Physical Cores @ 2.4 GHz; 8 GB DDR3 RAM; 80 GB SSD.

You can inspect the commands that were run to generate these benchmarks here.

Tools

Tool Version
master siegfried 1.7.12 /root/siegfried/default.sig (2019-06-15T12:22:38+02:00) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml
develop siegfried 1.7.13 /root/siegfried/default.sig (2019-06-15T12:22:38+02:00) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml

iPRES Systems Showcase

A corpus created for the 2014 iPRES conference comprising 2,206 files (5GB). Represents a range of formats, including AV and some uncommon types. Sourced from http://www.webarchive.org.uk/datasets/ipres.ds.1/

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 35.463390416s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 35.432997206s

The tools differed in output for 0 files in the corpus.

Raw output

PRONOM files

A corpus created by Greg Lepore and comprising 1,205 files (2.1GB). Includes a single sample of as many of the PRONOM IDs (PUIDs) that Greg could find.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 6.25447507s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 6.256566125s

The tools differed in output for 0 files in the corpus.

Raw output

Govdocs (Selected)

A selection from the Govdocs1 corpus comprising 26,124 files (31.4GB). Represents typical office formats, including approx. 15,000 PDFs. Originally sourced from http://openpreservation.org/blog/2012/07/26/1-million-21000-reducing-govdocs-significantly/

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 6m30.101451269s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 6m27.558097172s

The tools differed in output for 0 files in the corpus.

Raw output

The Deluxe

This benchmark checks multi-ID identification using the deluxe.sig signature file which contains four identifiers: PRONOM, LOC FDDs, freedesktop.org and tika-mimetypes. This benchmark is run against the PRONOM files corpus.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 12.779824023s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 12.773029684s

The tools differed in output for 0 files in the corpus.

Raw output

Unzipping

This benchmark checks the `sf -z` command (scans within zip files and other container formats) when run against the iPres corpus.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 1m31.000347481s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 1m30.740848962s

The tools differed in output for 19 files in the corpus.

filemasterdevelop
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430204833/http://www.archive.org/flv/flv.js?v=1.34x-fmt/423x-fmt/111
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430204841/http://www.archive.org/services/get-item-image.php?identifier=gd1978-12-16.sonyecm250-no-dolby.walker-scotton.miller.82212.sbeok.flac16&collection=GratefulDead&mediatype=etreex-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430204844/http://www.archive.org/services/get-item-image.php?identifier=zh27814&collection=zh27&mediatype=audiox-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430204936/http://www.archive.org/includes/players.js?mediatype=audiox-fmt/423x-fmt/111
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205000/http://www.archive.org/services/get-item-image.php?identifier=a_few_good_gmen&collection=machinima&mediatype=moviesx-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205006/http://www.archive.org/about/faq.php?faq_id=252x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205007/http://www.archive.org/about/faq.php?faq_id=243x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205008/http://www.archive.org/about/faq.php?faq_id=251x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205011/http://www.archive.org/about/faq.php?faq_id=257x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205011/http://www.archive.org/about/faq.php?faq_id=269x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205012/http://www.archive.org/about/faq.php?faq_id=241x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205013/http://www.archive.org/about/faq.php?faq_id=268x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205013/http://www.archive.org/about/faq.php?faq_id=242x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205014/http://www.archive.org/about/faq.php?faq_id=249x-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205022/http://www.archive.org/help/derivatives.php?mediatype=moviesx-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205022/http://www.archive.org/help/derivatives.php?mediatype=audiox-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205037/http://www.archive.org/includes/players.js?mediatype=etreex-fmt/423x-fmt/111
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205120/http://www.archive.org/index.php?skin=classicx-fmt/169UNKNOWN
/root/corpora/ipres-systems-showcase-files/IAH-20080430204825-00000-blackbook.warc#20080430205139/http://www.archive.org/services/get-item-image.php?identifier=secretarmiesb00spivrich&collection=americana&mediatype=textsx-fmt/169UNKNOWN

Raw output

History

2019-12-12 08:12:41 +0000 UTC

2019-12-11 21:22:13 +0000 UTC

2019-12-08 17:20:18 +0000 UTC

2019-12-05 21:52:59 +0000 UTC

2019-10-15 19:48:31 +0000 UTC

2019-08-18 13:54:03 +0000 UTC

2019-08-15 17:39:38 +0000 UTC

2019-08-15 17:23:20 +0000 UTC

2019-08-14 18:38:15 +0000 UTC

2019-07-29 18:52:25 +0000 UTC

2019-07-28 18:07:57 +0000 UTC

2019-06-29 18:08:46 +0000 UTC

2019-06-29 14:00:27 +0000 UTC

2019-06-15 10:53:03 +0000 UTC

2019-06-12 18:59:37 +0000 UTC

2019-06-06 18:45:34 +0000 UTC

2019-06-05 13:20:23 +0000 UTC

2019-02-23 20:58:08 +0000 UTC

2019-02-18 20:08:35 +0000 UTC

2019-02-16 10:33:59 +0000 UTC

2019-02-14 20:35:53 +0000 UTC

2019-02-03 11:12:55 +0000 UTC

2018-10-10 11:24:35 +0000 UTC

2018-09-19 01:50:01 +0000 UTC

2018-08-30 07:36:32 +0000 UTC

2018-08-27 06:10:52 +0000 UTC

2018-08-21 06:00:13 +0000 UTC

2018-07-27 05:54:19 +0000 UTC