Back to siegfried

Siegfried development benchmarks

Mon, 30 Dec 2019 14:45:41 UTC

Environment

These benchmarks were automatically run on a t1.small.x86 machine provisioned from https://www.packet.net/.

Specs for the t1.small.x86: 4 Physical Cores @ 2.4 GHz; 8 GB DDR3 RAM; 80 GB SSD.

You can inspect the commands that were run to generate these benchmarks here.

Tools

Tool Version
master siegfried 1.7.13 /root/siegfried/default.sig (2019-08-18T15:32:39+02:00) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml
develop siegfried 1.8.0 /root/siegfried/dev.sig (2019-12-30T14:45:41Z) identifiers: - pronom: DROID_SignatureFile_V95.xml; container-signature-20180917.xml

iPRES Systems Showcase

A corpus created for the 2014 iPRES conference comprising 2,206 files (5GB). Represents a range of formats, including AV and some uncommon types. Sourced from http://www.webarchive.org.uk/datasets/ipres.ds.1/

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 32.450238257s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 32.107018573s

The tools differed in output for 0 files in the corpus.

Raw output

PRONOM files

A corpus created by Greg Lepore and comprising 1,205 files (2.1GB). Includes a single sample of as many of the PRONOM IDs (PUIDs) that Greg could find.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 6.461008741s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 6.377464646s

The tools differed in output for 0 files in the corpus.

Raw output

Govdocs (Selected)

A selection from the Govdocs1 corpus comprising 26,124 files (31.4GB). Represents typical office formats, including approx. 15,000 PDFs. Originally sourced from http://openpreservation.org/blog/2012/07/26/1-million-21000-reducing-govdocs-significantly/

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 5m47.950029643s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 5m45.829701287s

The tools differed in output for 0 files in the corpus.

Raw output

The Deluxe

This benchmark checks multi-ID identification using the deluxe.sig signature file which contains four identifiers: PRONOM, LOC FDDs, freedesktop.org and tika-mimetypes. This benchmark is run against the PRONOM files corpus.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 12.335557577s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 12.418687196s

The tools differed in output for 0 files in the corpus.

Raw output

Unzipping

This benchmark checks the `sf -z` command (scans within zip files and other container formats) when run against the iPres corpus.

Results

Tool Description Duration
master Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. 1m33.40292597s
develop Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. 1m32.706978363s

The tools differed in output for 0 files in the corpus.

Raw output

Profile

profiler information for siegfried development branch

History

2020-05-14 02:48:21 +0000 UTC

2020-04-22 02:23:19 +0000 UTC

2020-04-09 03:55:38 +0000 UTC

2020-04-05 02:51:15 +0000 UTC

2020-02-25 06:51:44 +0000 UTC

2020-02-25 03:51:55 +0000 UTC

2020-02-25 03:42:25 +0000 UTC

2020-02-25 03:33:51 +0000 UTC

2020-02-13 20:24:46 +0000 UTC

2020-02-12 20:27:13 +0000 UTC

2020-02-12 20:16:54 +0000 UTC

2020-02-11 21:12:06 +0000 UTC

2020-02-11 20:52:15 +0000 UTC

2020-01-21 23:35:20 +0000 UTC

2020-01-17 19:06:48 +0000 UTC

2020-01-14 22:18:52 +0000 UTC

2020-01-13 22:58:37 +0000 UTC

2020-01-10 11:12:45 +0000 UTC

2020-01-08 06:39:13 +0000 UTC

2020-01-01 21:40:32 +0000 UTC

2019-12-30 14:51:24 +0000 UTC

2019-12-30 14:49:43 +0000 UTC

2019-12-30 14:45:41 +0000 UTC

2019-12-30 14:36:24 +0000 UTC

2019-12-12 08:12:41 +0000 UTC

2019-12-11 21:22:13 +0000 UTC

2019-12-08 17:20:18 +0000 UTC

2019-12-05 21:52:59 +0000 UTC

2019-10-15 19:48:31 +0000 UTC

2019-08-18 13:54:03 +0000 UTC

2019-08-15 17:39:38 +0000 UTC

2019-08-15 17:23:20 +0000 UTC

2019-08-14 18:38:15 +0000 UTC

2019-07-29 18:52:25 +0000 UTC

2019-07-28 18:07:57 +0000 UTC

2019-06-29 18:08:46 +0000 UTC

2019-06-29 14:00:27 +0000 UTC

2019-06-15 10:53:03 +0000 UTC

2019-06-12 18:59:37 +0000 UTC

2019-06-06 18:45:34 +0000 UTC

2019-06-05 13:20:23 +0000 UTC

2019-02-23 20:58:08 +0000 UTC

2019-02-18 20:08:35 +0000 UTC

2019-02-16 10:33:59 +0000 UTC

2019-02-14 20:35:53 +0000 UTC

2019-02-03 11:12:55 +0000 UTC

2018-10-10 11:24:35 +0000 UTC

2018-09-19 01:50:01 +0000 UTC

2018-08-30 07:36:32 +0000 UTC

2018-08-27 06:10:52 +0000 UTC

2018-08-21 06:00:13 +0000 UTC

2018-07-27 05:54:19 +0000 UTC