Home
build details

# Using the Evaluator

Modified 2018-10-09 by Andrea Censi

This section describes how to use the Challenges evaluators.

## Evaluators

Modified 2018-10-09 by Andrea Censi

An evaluator is a machine that is in charge of evaluating the protocols.

You can see the list of connected evaluators here.

Modified 2018-10-09 by Andrea Censi

We have several evaluators online that process jobs.

If you want to avoid being in the queue, you can run your own evaluator.

The command line is:

$dts challenges evaluator  This evaluator will connect to the server and execute preferentially your submission. ## Advanced options for evaluator Modified 2018-10-09 by Andrea Censi ### Naming evaluator Modified 2018-10-09 by Andrea Censi Use the option --name to name the evaluator instance: $ dts challenges evaluator --name a name


Otherwise the name is going to be autogenerated.

For example:

$dts challenges evaluator --name Instance1 &$ dts challenges evaluator --name Instance2 &


### Run a specific submission

Modified 2018-10-09 by Andrea Censi

Run the evaluator on a specific submission:

$dts challenges evaluator --submission ID  This evaluates a specific submission. Note that to force re-evaluation of a submission, you must first reset the submission. Also note that you cannot re-evaluate a submission that has been “retired”. ### Features specification Modified 2018-10-09 by Andrea Censi The option --features is useful to force the identification of specific features. For example, you can pretend that you have an Nvidia GPU using: $ dts challenges evaluator --features 'gpu: 1'


You can find the list of features here.

No questions found. You can ask a question on the website.