Submissions

This page explains how you should submit your solutions to the benchmarks. It assumes you already have managed to login correctly.

To copy your solutions to your home directory of your aspXX account, we recommend that you scp from your machine into our server, instead of from our server into your machine:

scp -i 'your-private-ssh-key-file' -P 20001 'your-local-file' aspXX@asp.cs.kuleuven.be:~

To speed the installation process, we encourage entrants to build their solvers using statically linked libraries. This will guarantee that the correct libraries will be present in your binary file. Dynamically linked libraries may not be present on the test system, and will require extra time and overhead to install.

Setting up your home dir

When installing your solutions, take the following guidelines in consideration:

Your home directory should be empty, except for one directory with the name of the team (e.g., "DLV-01"). All other information in this directory will be deleted before the competition runs take place.
This directory should contain one script-file per benchmark, and the name of the script file should be identical with the name of the benchmark. More information on the scripts will be added shortly.
You and your programs can write everywhere in the home directory and in /tmp. However, beware of the following: during the competition runs, between any two runs of instances, your home directory will be restored to its state of May 15, 12 p.m. This means that no information can be ported from one instance to the next one.

Testing your solutions

To test your solutions, you can use the instances of the benchmarks that are available in this directory:

/home/ASP-competition/instances/<benchmark-name>/

You can either manually verify that the solutions produced by your system are correct, or you can use the checker scripts. These are the same scripts that will be used when the competition is run.

Note that the checker scripts only verify the correctness of a given witness; they will not check whether the output UNSATISFIABLE is correct.

Submitting your solutions

Once you are satisfied that your solution for a given benchmark is correct, you can submit to our system using the following command:

asp-submit 'benchmark-name' 'executable'

Here, 'benchmark-name' should be the name of the benchmark, as found in this list; 'executable' should be the full path to your executable for this benchmark. Running the asp-submit script in this way will add your solution to our database. You can use the same command to change you solution later on.

Once you have submitted a solution, you can test it as follows:

asp-submit 'benchmark-name'

This will provide a report of how your executable performs on our test-instances for this benchmark. The report looks like this:

Submission 1 - score: 1 - date: 2009-04-20 14:02:52.957466 - status: done - time: 7.83708

The status field tells you how far along the testing process for your submission is:

status 'done' means that all instances have been tested
status 'yes' means that testing is still in progress
status 'unk' means that testing has not yet started

When the status is 'done', the time field tells you how long your submission took to run on the instances for this benchmark.

The deadline for the competition is 1200 UTC May 15 2009. Solutions that have not been submitted using 'asp-submit' at that time will not be taken into account.