Script for IR4QA

IR4QA-runchecker2 validates if:

This script must be run at the directory where your runs are.

If it doesn't work, modify the AWK path in the script according to your environment (i.e. AWK=/usr/bin/gawk)

Usage: IR4QA-runchecker2 <topicIDfile> <IR4QArunfile>...

Download: IR4QA-runchecker2.gz.

Script for CCLQA

Coming soon.

Web based validator

You can verify the output file for Question Analysis, IR4QA and CCLQA by logging in to SEPIA and uploading it (and then deleting it unless it's the final submission).

Question Analysis

The validator checks if:

The validator also confirms the following statistics for a sanity check.

IR4QA

The validator checks if:

The validator also confirms the following statistics for a sanity check.

CCLQA

The validator checks if:

The validator also confirms the following statistics for a sanity check.

If problems are found, fix the format according to the error message, and submit again.

FormatChecker (last edited 2010-01-06 07:22:37 by HidekiShima)