Introduction

In science, shared tasks are crucial for collecting diverse approaches to tackle complex problems. TIRA provides a platform for organizing these tasks and welcoming submissions, whether for research or education.

Getting Started

Completing your first submission in just 4 steps!

Join tira.io (or the instance you want to participate on)

Prepare your Submission

Participating in a Shared Task

Sign up for a Shared Task

Joining a Task and preparing your Environment

Submit

Submitting your Submission

Quicklinks

TIRA-CLI

Interacting with TIRA from the comfort of your command line.

TIRA CLI

Python Client

Interacting with TIRA from your Python code.

Python Client

Integrations

For reproducibility and confidentiality reasons, all TIRA submissions are sandboxed and can not access the internet. But we created TIRA integrations for important libraries so that you don’t have to refrain from using them. These integrations are designed to be unintrusive small changes and allow your code to run inside and outside the sandbox.

huggingface

python-client/huggingface

ir_datasets

IR-Datasets Integration

pyterrier

Pyterrier Integration

Frequently Asked Questions

Participation

How do I participate in a shared task?

See Participating in a Shared Task.

Problems

I believe, I found a bug with TIRA. What do I do?

Please have a look at Reporting Bugs