Introduction¶
Why TIRA?¶
Solving the shared task should be the hard part of a submission.
Automatically evaluate and track participants’ submissions.
Evaluate submissions automatically and without publishing the test data.
Via containerization, we not only store the code that produced the submission but also the environment it ran in.
All submissions and their evaluations in one place.
How do I…¶
For those who have train-, validation-, and test-data and want to see how they can be fitted well.
This step is optional. If you need a TIRA instance for internal shared tasks, you are welcome to host you own instance. For a lightweight alternative, also have a look at hosting your own runner.
This step is also optional. This is for you if you want to use an external TIRA instance but keep your test data internal.
Hint
You just want to try TIRA within your organization without setting up the production deployment? We have created a slimmed down demo deployment just for this!
Frequently Asked Questions
No questions yet .