-
Notifications
You must be signed in to change notification settings - Fork 3.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Text-to-SQL progress (Dialogue) #534
Comments
willyspinner
changed the title
Add Text-to-SQL problems (Dialogue)
Add Text-to-SQL progress (Dialogue)
Feb 17, 2021
That's a great idea! I think it may be potentially clearer to add them to the Semantic Parsing area as they are conceptually more similar to the Spider dataset than the standard dialogue setting. What do you think? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I've been reading up on Text-to-SQL problems (given natural language question & DB schema, generate a legal SQL query) and they seem to be an interesting subfield of Dialogue Answering Systems.
There are multiple datasets/ challenges that track their SOTAs, for example:
all of which have interesting tasks besides the standard Text-to-SQL problem, like Natural Language Response Generation given SQL and Query execution Results.
I realize that the spider dataset is under the semantic-parsing part, but SParC and CoSQL are more challenging datasets that incorporate multi-turns, context, as well as ambiguous and unanswerable questions that may present to be harder than the spider challenge.
I was wondering if we could add them?
The text was updated successfully, but these errors were encountered: