Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tasks 1200-1225: Assigning categories, domains and addressing feedbacks #601

Merged
merged 10 commits into from
Nov 30, 2021

Conversation

yeganehkordi
Copy link
Contributor

No description provided.

@yeganehkordi yeganehkordi marked this pull request as draft November 12, 2021 21:45
@yeganehkordi
Copy link
Contributor Author

In the atomic tasks, the crowd workers were confused by the head and tail words (head is the first phrase and tail is the second one). Do we need to change them?

@yeganehkordi yeganehkordi marked this pull request as ready for review November 15, 2021 12:58
@swarooprm
Copy link
Contributor

Categories reviewed: ready to go @danyaljj

@danyaljj
Copy link
Contributor

Thanks!

@danyaljj
Copy link
Contributor

I merged a conflict but not sure if I did it correctly. @yeganehkordi could you check.

One question for either one of you: how is "verification" different from "detection"? We need to provide a definition for them in the document that clearly distinguishes their scopes.

@yeganehkordi
Copy link
Contributor Author

@danyaljj Thanks! We have two entity detection and abuse detection. I guess we can drop the abuse detection and entity detection out of the detection scope.
Verification is a sub-category for classification and it is used for binary classifications. For example, verify whether the claim is correct. In the verification tasks, the potential outputs are mentioned in the definition.
Detection tasks are to find something in the input. For example, detecting the entities in a review or detecting the motivation of something. Detection tasks can be text generation, classification, etc., and possible outputs are not necessarily given in the definition.

@danyaljj
Copy link
Contributor

Thanks! Could you clarify the distinction in the task hierarchy file?

@yeganehkordi
Copy link
Contributor Author

Sure! Done.
I'm thinking of writing documentation for the hierarchy after finalizing the categories.

@danyaljj
Copy link
Contributor

Thanks! Yeah, documentation would be super-helpful for any future follow-up work.

@danyaljj danyaljj merged commit 4f84334 into allenai:master Nov 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants