How to use

Step 1 - Register
To start a new experiment, click on New experiment. If you do not have an account yet, you will be asked to register. You may also add your accounts to your user settings under external logins.
Step 2- Choose a publication to start an experiment
  • Use the search to check if your chosen publication already exists.
  • If it does not exist yet, click on import in order to add the publication by DBLP key or DOI. If importing fails, you will be forwarded to the create page.
  • If neither a DOI nor a DBLP key exist for your chosen publication, then click on create to manually create a publication.
As soon as the publication is available click “Choose” to start a new Experiment.
Step 3 – Create a new Experiment
In this step a GitHub repository will be created for your experiment. You can add links to external artifact resources (i.e. code, data, etc.) by clicking on the "Publication artifact links" button. If you did not already add your GitHub account, please add it in this form. This account will get permissions on the GitHub repository. Shortly after you click “Create” the repository should be ready. You can find your open experiments in My Experiments.
Step 4 – Conduct Experiment
Follow the link to the GitHub repository and fill the and upload your artifacts. Please write all the documentation in English to reach as many people as possible. This is what a new project looks like:
is a simple form you fill out to describe your setup and experiment steps. It will help others to know what you have done and run your experiment themselves.
is intended for source code you created.
is intended for (unchanged) source code from the authors.
is intended for data you created.
is intended for (unchanged) data from the authors.
is intended for output, etc.
Step 5 – Finish your experiment
When you are done with your reproduction and pushed all changes to the GitHub repository, click on "Finish experiment". Finished experiments are read-only. If you forgot something or want to correct a mistake, however, you can reopen the experiment again.

For detailed instructions please refer to our manual.

How to find a dblp reference for your paper

Step 1

Go to the DBLP database.

Step 2

Type in the title of your paper (or a part of it).

Search Paper
Step 3

Copy the DBLP key.

Obtain Reference

How to find a DOI reference for your paper

Finding the DOI (Document Object Identifier) for a given paper is not as straightforward as e.g. finding the DBLP reference for it. There are certain ways to find a DOI. If one does not work, you may try another.

Option 1

If a paper is obtained from a paper publisher database, it might have it's DOI printed on the first page.

DOI in Paper Example
Option 2

You may find the DOI via the publisher's website. Use the search function of a publisher (e.g. ResearchGate).

DOI in Publisher Example