SBML Test-Suite Results Tracker

[anandijain]

SBML test suite report

SBMLtoolkit.jl is regularly tested against the SBML test suite. The last test was run on October 24, 2021 on cases 00001 to 01664. Detailed results can be found in the csv below. Out of the 1664 cases 1219 expectedly failed, as

• they contain SBML constraints, rules or events, or
• do not contain any reactions, or
• cannot be converted to SBML Version 3 Level 2, or
• contain kineticLaws in reversible reactions with ambiguous forward and reverse part, or
• are flux balance models.

Of the remaining 445 cases

• 422 can be converted to a ModelingToolkit.ReactionSystem, of which
• 416 simulate without returning an error, of which
• 416 yield the correct simulation results.

CSV

test_suite_report.csv

[matthiaskoenig]

You should submit the results on the official webpage. This allows people to easily evaluate what can be simulated.
See here for the database: http://raterule.caltech.edu/Facilities/Database
And here for an example: http://raterule.caltech.edu/Facilities/Database/Submission/Details/281

edit: fixed links

[anandijain]

@matthiaskoenig both of those 404

[matthiaskoenig]

@anandijain SBML moved the webpage. The new addresses are available via
https://sbml.org/software/sbml-test-suite/

and at the moment
http://raterule.caltech.edu/Facilities/Database
http://raterule.caltech.edu/Facilities/Database/Submission/Details/281