Dear FinCausal,
I can't manage to get any results from the submission system. I always get this traceback:
Traceback (most recent call last):
File "/tmp/codalab/tmpPsjlX1/run/program/task_evaluate.py", line 256, in
main()
File "/tmp/codalab/tmpPsjlX1/run/program/task_evaluate.py", line 249, in main
args.func(args)
File "/tmp/codalab/tmpPsjlX1/run/program/task_evaluate.py", line 218, in from_folder
evaluate_files(g_file, s_file, o_file)
File "/tmp/codalab/tmpPsjlX1/run/program/task_evaluate.py", line 168, in evaluate_files
y_true = get_data(ref_csv[0:])
File "/tmp/codalab/tmpPsjlX1/run/program/task_evaluate.py", line 114, in get_data
[index, context, question, answer] = r[0]
ValueError: too many values to unpack (expected 4)
I followed the instructions and put the results_en.csv in a .zip file. Locally, with the code provided in the starter kit, the evaluation works fine. Is there something wrong with the system, or am I missing something?
Thanks, Georg
Posted by: CommodoreEU @ Nov. 2, 2024, 4 p.m.Hi, Georg:
We'll check this.
FinCausal Team
Posted by: lli-uam @ Nov. 3, 2024, 4:32 p.m.Hi, again:
First, make sure the header in the CSV has 4 labels. The INPUT data has only 3, so you must add an ANSWER label in your submission.
There is a submission with 5 columns in example 5056.1, but I'm not sure is yours. The last column is empty. I suggest you use a CSV writer that properly manages delimiters and escapes.
If you send me your submission file to jordi,porta@uam.es I'll check it.
--J
Posted by: lli-uam @ Nov. 3, 2024, 5:10 p.m.