Adding adversarialQA dataset

[maxbartolo]

Adding the adversarialQA dataset (https://adversarialqa.github.io/) from Beat the AI (https://arxiv.org/abs/2002.00293)

[thomwolf]

Oh that's a really cool one, we'll review/merge it soon!

In the meantime, do you have any specific positive/negative feedback on the process of adding a datasets Max?
Did you follow the instruction in the detailed step-by-step?

[maxbartolo]

Thanks Thom, been a while, hope all is well!

Yes, I followed the step by step instructions and found them pretty straightforward. The only things I wasn't sure of were what should go into the YAML tags field for the dataset card, and whether there was a list of options somewhere (maybe akin to the metrics?) of the possible supported tasks. I found the rest very intuitive and the automated metadata and dummy data generation very handy. Thanks!

[thomwolf]

Good point! pinging @yjernite here so he can improve this part!

[yjernite]

@maxbartolo cool addition!

For the YAML tag, you should use the tagging app we provide to choose from a drop-down menu:
/~https://github.com/huggingface/datasets-tagging

The process is described toward the end of the step-by-step guide, do you have any suggestions for making it easier to find?

Otherwise, the dataset card is really cool, thanks for making it so complete!

[maxbartolo]

@yjernite

Thanks, YAML tags added. I think my main issue was with the flow of the step-by-step guide. For example, the card creator is introduced in Step 4, right after creating an empty directory for your dataset. The first field it requires are the YAML tags, which (at least for me) was the last step of the process.

I'd suggest having the guide structured in the same order as the creation process. For me it was something like:

• Step 1: Preparing your env
• Step 2: Write the loading/processing code
• Step 3: Automatically generate dummy data and dataset_infos.json
• Step 4: Tag the dataset
• Step 5: Write the dataset card using the card creator
• Step 6: Open a Pull Request on the main HuggingFace repo and share your work!!

Thanks again!

[lhoestq]

Looks all good to me !
Thank you for adding it :) and good dataset card as well

I just did one minor change in the dummy_data.zip files: I removed unused files to make them lighter.