This is a re-enaction of THIS CODALAB CHALLENGE on the old server.
This challenge mimics the NIPS 2003 Feature Selection Challenge: it allows you to make post-challenge submissions on test data to benchmark new methods. The challenge ended on December 12, 2003. |
NIPS | Clopinet |
Go here for more details (an archive of the original website):
http://web.archive.org/web/20130512034606/http://www.nipsfsc.ecs.soton.ac.uk/datasets
The aim of the challenge in feature selection is to find feature selection algorithms that significantly outperform methods using all features, on ALL five benchmark datasets. To facilitate entering results for all five datasets, all tasks are two-class classification problems. You can download the datasets in the Participate section.
Dataset | Size | Type | Features | Training Examples | Validation Examples | Test Examples |
---|---|---|---|---|---|---|
Arcene | 8.7 MB | Dense | 10000 | 100 | 100 | 700 |
Gisette | 22.5 MB | Dense | 5000 | 6000 | 1000 | 6500 |
Dexter | 0.9 MB | Sparse integer | 20000 | 300 | 300 | 2000 |
Dorothea | 4.7 MB | Sparse binary | 100000 | 800 | 350 | 800 |
Madelon | 2.9 MB | Dense | 500 | 2000 | 600 | 1800 |
The score is an average of AUC scores of each of the datasets.
New format:
You can submit just one file .predict instead of .resu and .conf. Each .predict file should contain in each line the respective confidence that the label is positive.
The BER metric will be also calculated, tresholding at 0.
The submission should consist of 5 .predict files (e.g.: arcene_test.predict) in a zip archive, without extra directories. You can optionally include .feat files. This sample submission contains random results.
Old format:
Submission in a format of the original contest should consist of 3 x 5 files in a zip archive:
datasetname_test.resu
datasetname_test.conf
datasetname.feat
See the sample submission in the original format.
The AUC scores are on the leaderboard, you can view the BER scores and feature statistics of your submission by clicking: 'View scoring output log'
This challenge is brought to you by ChaLearn. Contact the organizers.
Start: Feb. 1, 2015, midnight
Description: test
Never
You must be logged in to participate in competitions.
Sign In# | Username | Score |
---|---|---|
1 | Reference | - |
2 | guyon | - |