Siegfried development benchmarks
Fri, 27 Jul 2018 05:54:19 UTC
Environment
These benchmarks were automatically run on a t1.small.x86 machine provisioned from https://www.packet.net/.
Specs for the t1.small.x86: 4 Physical Cores @ 2.4 GHz; 8 GB DDR3 RAM; 80 GB SSD.
You can inspect the commands that were run to generate these benchmarks here.
iPRES Systems Showcase
A corpus created for the 2014 iPRES conference comprising 2,206 files (5GB). Represents a range of formats, including AV and some uncommon types. Sourced from http://www.webarchive.org.uk/datasets/ipres.ds.1/
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 31.160217951s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 30.963125721s |
The tools differed in output for 30 files in the corpus.
| file | master | develop |
| /root/corpora/ipres-systems-showcase-files/ACCLINK.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/ANALYSF.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/ANALYSIS.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/ATPVBAEN.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/BSHXL.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/Balance Sheet.xlt | fmt/61 | fmt/62 |
| /root/corpora/ipres-systems-showcase-files/EUROTOOL.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/EXPENSES.XLS | fmt/473 | fmt/56 |
| /root/corpora/ipres-systems-showcase-files/EXPTOOWS.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/ExpenseStatement.xlt | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/FUNCRES.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/HTML.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/INVOICE.XLT | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/LABEL.WDB | fmt/233 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/LOOKUP.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/Loan Amortization.xlt | fmt/61 | fmt/62 |
| /root/corpora/ipres-systems-showcase-files/PROCDB.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/QE.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/SALES.XLT | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/SOLVER.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/SUMIF.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/Sales Invoice.xlt | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/TMPLTNUM.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/Timecard.xlt | fmt/61 | fmt/62 |
| /root/corpora/ipres-systems-showcase-files/UPDTLINK.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/Village Software.xlt | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/WEBFORM.XLA | fmt/61 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/WZTEMPLT.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/XLODBC.XLA | fmt/59 | fmt/111 |
| /root/corpora/ipres-systems-showcase-files/XLQUERY.XLA | fmt/59 | fmt/111 |
PRONOM files
A corpus created by Greg Lepore and comprising 1,205 files (2.1GB). Includes a single sample of as many of the PRONOM IDs (PUIDs) that Greg could find.
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 3.857836972s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 3.940533185s |
The tools differed in output for 4 files in the corpus.
| file | master | develop |
| /root/corpora/pronom-files/fmt_128_OpenDocument Text_de.qwerkop.www_projects_mspace_doku.sdw | fmt/136 | fmt/128 |
| /root/corpora/pronom-files/fmt_129_OpenDocument Spreadsheet_Sauvetage_PL_TP.sxc | fmt/137 | fmt/129 |
| /root/corpora/pronom-files/fmt_137_OpenDocument_Spreadsheet_chart-range-import.sxc | fmt/137 | x-fmt/263 |
| /root/corpora/pronom-files/x-fmt_84_Microsoft_Powerpoint_Design_Template.POT | fmt/126 | fmt/111 |
Govdocs (Selected)
A selection from the Govdocs1 corpus comprising 26,124 files (31.4GB). Represents typical office formats. Originally sourced from http://openpreservation.org/blog/2012/07/26/1-million-21000-reducing-govdocs-significantly/
Results
| Tool | Description | Duration |
|---|---|---|
| master | Master branch of github.com/richardlehane/siegfried. Corresponds to latest production release. | 3m11.649016359s |
| develop | Develop branch of github.com/richardlehane/siegfried. Tip of development and potentially unstable. | 9m20.895460128s |
The tools differed in output for 126 files in the corpus.
| file | master | develop |
| /root/corpora/govdocs-selected/CSV_16/096379.csv | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/CSV_16/616072.csv | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/CSV_16/675163.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/CSV_17/113892.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/CSV_17/477637.csv | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/CSV_17/483360.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/CSV_17/609313.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/CSV_17/778548.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/CSV_17/922895.csv | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/DOC_135/862565.zip | fmt/523 | x-fmt/263 |
| /root/corpora/govdocs-selected/HTML_124/462908.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_143/558860.html | x-fmt/394 | fmt/99 |
| /root/corpora/govdocs-selected/HTML_29/125709.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/137485.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/228989.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/231543.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/260625.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/266760.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/304937.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/376530.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/408767.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_29/455959.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_61/109253.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_68/143214.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_68/276772.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_72/164860.html | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/HTML_72/247864.html | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/HTML_72/338953.html | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/HTML_72/564203.html | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_72/579101.html | fmt/61 | fmt/62 |
| /root/corpora/govdocs-selected/HTML_74/164869.html | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_74/971338.html | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/173826.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/215336.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/238780.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/276768.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/324608.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/400269.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/559657.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_76/560715.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_81/194038.html | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_86/247863.html | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_86/879975.html | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_86/880332.html | fmt/61 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_87/249088.html | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_91/297609.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_91/862543.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_93/304942.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_94/310021.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/HTML_95/310778.html | fmt/40 | fmt/111 |
| /root/corpora/govdocs-selected/KML_8/486133.kml | fmt/724 | x-fmt/263 |
| /root/corpora/govdocs-selected/PDF_1562/661753.pdf | fmt/134 | fmt/15 |
| /root/corpora/govdocs-selected/PDF_1616/553738.pdf | fmt/134 | fmt/18 |
| /root/corpora/govdocs-selected/PDF_1631/825237.pdf | fmt/134 | fmt/17 |
| /root/corpora/govdocs-selected/PDF_169/915424.pdf | fmt/134 | fmt/17 |
| /root/corpora/govdocs-selected/PDF_246/960747.pdf | fmt/134 | fmt/16 |
| /root/corpora/govdocs-selected/PDF_3230/900709.pdf | fmt/134 | fmt/18 |
| /root/corpora/govdocs-selected/PDF_608/113057.pdf | fmt/134 | fmt/19 |
| /root/corpora/govdocs-selected/PPS_1/424289.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/444773.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/468159.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/595101.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/694512.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/724719.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/727240.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/883180.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/887669.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_1/925160.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_10/318062.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_11/370208.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/219264.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/246872.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/249164.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/427081.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/690540.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/691123.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/692615.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/752637.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/760806.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_2/764092.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/042949.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/262754.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/343072.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/375593.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/613430.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/656831.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/664695.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/666705.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/673464.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_3/760665.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/021626.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/281474.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/284610.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/353108.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/377873.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/616855.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/660218.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/675338.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/728413.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_4/922892.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/250540.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/317841.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/334478.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/411334.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/421710.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/431713.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/675924.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/681118.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/727242.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_6/926200.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_7/122904.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_7/234520.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_7/369635.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_7/915553.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPS_8/226216.pps | fmt/126 | fmt/111 |
| /root/corpora/govdocs-selected/PPT_45/405374.zip | fmt/215 | x-fmt/263 |
| /root/corpora/govdocs-selected/PPT_45/947671.zip | fmt/215 | x-fmt/263 |
| /root/corpora/govdocs-selected/PPT_46/472071.zip | fmt/487 | x-fmt/263 |
| /root/corpora/govdocs-selected/PPT_46/973194.zip | fmt/215 | x-fmt/263 |
| /root/corpora/govdocs-selected/SWF_12/554614.swf | fmt/134 | fmt/505 |
| /root/corpora/govdocs-selected/SWF_12/628689.swf | fmt/134 | fmt/505 |
| /root/corpora/govdocs-selected/XLS_162/508651.zip | fmt/214 | x-fmt/263 |
| /root/corpora/govdocs-selected/XLS_162/606177.zip | fmt/214 | x-fmt/263 |
| /root/corpora/govdocs-selected/XLS_187/654115.zip | fmt/214 | x-fmt/263 |
| /root/corpora/govdocs-selected/XLS_188/654117.zip | fmt/214 | x-fmt/263 |
| /root/corpora/govdocs-selected/XML_22/555096.xml | fmt/40 | fmt/111 |
Profile
