Skip to content

Latest commit

 

History

History
10 lines (7 loc) · 548 Bytes

README.md

File metadata and controls

10 lines (7 loc) · 548 Bytes

Building an evaluation program that works with CodaLab

This example uses python.

evaluate.py - is an example that checks that the submission data matches the truth data, which is "Hello World!" setup.py - this is a file that enables py2exe to build a windows executable of the evaluate.py script. metadata - this is a file that lists the contents of the program.zip bundle for the CodaLab system.

Once these pieces are assembled they are packages as program.zip which CodaLab can then use to evaluate the submissions for a competition.