Skip to content

Commit

Permalink
add swag test set for the leaderboard
Browse files Browse the repository at this point in the history
  • Loading branch information
Rowan Zellers committed Oct 5, 2018
1 parent 6b2ca11 commit 774d10c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion data/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ In `train_full.csv` or `val_full.csv`: we have both the texts of the endings/con

## regular (shuffled)

This could be more interesting for modeling, and it's the way the test data is formatted. For each `startphrase` (also, split into `sent1`,`sent2`) we have 4 endings, and a label which says the correct one. You can use `test.csv` for submission on the leaderboard here: [https://leaderboard.dev.allenai.org/swag/submission/create](https://leaderboard.dev.allenai.org/swag/submission/create)
This could be more interesting for modeling, and it's the way the test data is formatted. For each `startphrase` (also, split into `sent1`,`sent2`) we have 4 endings, and a label which says the correct one. You can use `test.csv` for submission on the leaderboard here: [https://leaderboard.dev.allenai.org/swag/submission/create](https://leaderboard.dev.allenai.org/swag/submission/create). The fields are exactly the same as `val.csv` and `train.csv` except for the label.



Expand Down

0 comments on commit 774d10c

Please sign in to comment.