NumbersStation/NSText2SQL

Dataset Summary

NSText2SQL dataset used to train NSQL models. The data is curated from more than 20 different public sources across the web with permissable licenses (listed below). All of these datasets come with existing text-to-SQL pairs. We apply various data cleaning and pre-processing techniques including table schema augmentation, SQL cleaning, and instruction generation using existing LLMs. The resulting dataset contains around 290,000 samples of text-to-SQL pairs.

For more information and code, please see this repository.

How to use it

from datasets import load_dataset

dataset = load_dataset("NumbersStation/NSText2SQL")

Dataset Structure

Data Instances

Each data instance in this dataset represents a text-to-SQL entry where the instruction has been formatted with the table schema and question. The output is the SQL in SQlite dialect.

Data Fields

• instruction (string): the instruction to generate SQL.
• output (string): the ground truth SQL.
• source (string): the source dataset of the sample.

Languages

The language of the data is primarily English.

Source Data and Licensing Information

NSText2SQL is sourced from repositories with various licenses. Any use of all or part of the data gathered in NSText2SQL must abide by the terms of the original licenses, including attribution clauses when relevant. We thank all authors who provided these datasets. We provide provenance information for each dataset below.

Datasets	License	Link
academic	Not Found	https://github.com/jkkummerfeld/text2sql-data
advising	CC-BY-4.0	https://github.com/jkkummerfeld/text2sql-data
atis	Not Found	https://github.com/jkkummerfeld/text2sql-data
restaurants	Not Found	https://github.com/jkkummerfeld/text2sql-data
scholar	Not Found	https://github.com/jkkummerfeld/text2sql-data
imdb	Not Found	https://github.com/jkkummerfeld/text2sql-data
yelp	Not Found	https://github.com/jkkummerfeld/text2sql-data
criteria2sql	Apache-2.0	https://github.com/xiaojingyu92/Criteria2SQL
css	CC-BY-4.0	https://huggingface.co/datasets/zhanghanchong/css
eICU	CC-BY-4.0	https://github.com/glee4810/EHRSQL
mimic_iii	CC-BY-4.0	https://github.com/glee4810/EHRSQL
geonucleardata	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
greatermanchestercrime	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
studentmathscore	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
thehistoryofbaseball	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
uswildfires	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
whatcdhiphop	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
worldsoccerdatabase	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
pesticide	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
mimicsql_data	MIT	https://github.com/wangpinggl/TREQS
nvbench	MIT	https://github.com/TsinghuaDatabaseGroup/nvBench
sede	Apache-2.0	https://github.com/hirupert/sede
spider	CC-BY-SA-4.0	https://huggingface.co/datasets/spider
sql_create_context	CC-BY-4.0	https://huggingface.co/datasets/b-mc2/sql-create-context
squall	CC-BY-SA-4.0	https://github.com/tzshi/squall
wikisql	BSD 3-Clause	https://github.com/salesforce/WikiSQL

Citing this work

If you use this data in your work, please cite our work and the appropriate original sources:

To cite NSText2SQL, please use:

@software{numbersstation2023NSText2SQL,
  author    = {Numbers Station Labs},
  title     = {NSText2SQL: An Open Source Text-to-SQL Dataset for Foundation Model Training},
  month     = {July},
  year      = {2023},
  url       = {https://github.com/NumbersStationAI/NSQL},
}

To cite dataset used in this work, please use:

Datasets	Cite
academic	\cite{data-advising,data-academic}
advising	\cite{data-advising}
atis	\cite{data-advising,data-atis-original,data-atis-geography-scholar}
restaurants	\cite{data-advising,data-restaurants-logic,data-restaurants-original,data-restaurants}
scholar	\cite{data-advising,data-atis-geography-scholar}
imdb	\cite{data-advising,data-imdb-yelp}
yelp	\cite{data-advising,data-imdb-yelp}
criteria2sql	\cite{Criteria-to-SQL}
css	\cite{zhang2023css}
eICU	\cite{lee2022ehrsql}
mimic_iii	\cite{lee2022ehrsql}
geonucleardata	\cite{lee-2021-kaggle-dbqa}
greatermanchestercrime	\cite{lee-2021-kaggle-dbqa}
studentmathscore	\cite{lee-2021-kaggle-dbqa}
thehistoryofbaseball	\cite{lee-2021-kaggle-dbqa}
uswildfires	\cite{lee-2021-kaggle-dbqa}
whatcdhiphop	\cite{lee-2021-kaggle-dbqa}
worldsoccerdatabase	\cite{lee-2021-kaggle-dbqa}
pesticide	\cite{lee-2021-kaggle-dbqa}
mimicsql_data	\cite{wang2020text}
nvbench	\cite{nvBench_SIGMOD21}
sede	\cite{hazoom2021text}
spider	\cite{data-spider}
sql_create_context	Not Found
squall	\cite{squall}
wikisql	\cite{data-wikisql}

@InProceedings{data-advising,
  dataset   = {Advising},
  author    = {Catherine Finegan-Dollak, Jonathan K. Kummerfeld, Li Zhang, Karthik Ramanathan, Sesh Sadasivam, Rui Zhang, and Dragomir Radev},
  title     = {Improving Text-to-SQL Evaluation Methodology},
  booktitle = {Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  month     = {July},
  year      = {2018},
  location  = {Melbourne, Victoria, Australia},
  pages     = {351--360},
  url       = {http://aclweb.org/anthology/P18-1033},
}

@InProceedings{data-imdb-yelp,
  dataset   = {IMDB and Yelp},
  author    = {Navid Yaghmazadeh, Yuepeng Wang, Isil Dillig, and Thomas Dillig},
  title     = {SQLizer: Query Synthesis from Natural Language},
  booktitle = {International Conference on Object-Oriented Programming, Systems, Languages, and Applications, ACM},
  month     = {October},
  year      = {2017},
  pages     = {63:1--63:26},
  url       = {http://doi.org/10.1145/3133887},
}

@article{data-academic,
  dataset   = {Academic},
  author    = {Fei Li and H. V. Jagadish},
  title     = {Constructing an Interactive Natural Language Interface for Relational Databases},
  journal   = {Proceedings of the VLDB Endowment},
  volume    = {8},
  number    = {1},
  month     = {September},
  year      = {2014},
  pages     = {73--84},
  url       = {http://dx.doi.org/10.14778/2735461.2735468},
} 

@InProceedings{data-atis-geography-scholar,
  dataset   = {Scholar, and Updated ATIS and Geography},
  author    = {Srinivasan Iyer, Ioannis Konstas, Alvin Cheung, Jayant Krishnamurthy, and Luke Zettlemoyer},
  title     = {Learning a Neural Semantic Parser from User Feedback},
  booktitle = {Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year      = {2017},
  pages     = {963--973},
  location  = {Vancouver, Canada},
  url       = {http://www.aclweb.org/anthology/P17-1089},
}

@article{data-atis-original,
  dataset   = {ATIS, original},
  author    = {Deborah A. Dahl, Madeleine Bates, Michael Brown, William Fisher, Kate Hunicke-Smith, David Pallett, Christine Pao, Alexander Rudnicky, and Elizabeth Shriber},
  title     = {{Expanding the scope of the ATIS task: The ATIS-3 corpus}},
  journal   = {Proceedings of the workshop on Human Language Technology},
  year      = {1994},
  pages     = {43--48},
  url       = {http://dl.acm.org/citation.cfm?id=1075823},
}

@inproceedings{data-restaurants-logic,
  author    = {Lappoon R. Tang and Raymond J. Mooney},
  title     = {Automated Construction of Database Interfaces: Intergrating Statistical and Relational Learning for Semantic Parsing},
  booktitle = {2000 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora},
  year      = {2000},
  pages     = {133--141},
  location  = {Hong Kong, China},
  url       = {http://www.aclweb.org/anthology/W00-1317},
}

@inproceedings{data-restaurants-original,
 author    = {Ana-Maria Popescu, Oren Etzioni, and Henry Kautz},
 title     = {Towards a Theory of Natural Language Interfaces to Databases},
 booktitle = {Proceedings of the 8th International Conference on Intelligent User Interfaces},
 year      = {2003},
 location  = {Miami, Florida, USA},
 pages     = {149--157},
 url       = {http://doi.acm.org/10.1145/604045.604070},
}

@inproceedings{data-restaurants,
  author    = {Alessandra Giordani and Alessandro Moschitti},
  title     = {Automatic Generation and Reranking of SQL-derived Answers to NL Questions},
  booktitle = {Proceedings of the Second International Conference on Trustworthy Eternal Systems via Evolving Software, Data and Knowledge},
  year      = {2012},
  location  = {Montpellier, France},
  pages     = {59--76},
  url       = {https://doi.org/10.1007/978-3-642-45260-4_5},
}

@InProceedings{data-spider,
  author    = {Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, Zilin Zhang, and Dragomir Radev},
  title     = {Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task},
  booktitle = {Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing},
  year      = {2018},
  location  = {Brussels, Belgium},
  pages     = {3911--3921},
  url       = {http://aclweb.org/anthology/D18-1425},
}

@article{data-wikisql,
  author    = {Victor Zhong, Caiming Xiong, and Richard Socher},
  title     = {Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning},
  year      = {2017},
  journal   = {CoRR},
  volume    = {abs/1709.00103},
}

@InProceedings{Criteria-to-SQL,
  author    = {Yu, Xiaojing  and  Chen, Tianlong  and  Yu, Zhengjie  and  Li, Huiyu  and  Yang, Yang  and  Jiang, Xiaoqian  and  Jiang, Anxiao},
  title     = {Dataset and Enhanced Model for Eligibility Criteria-to-SQL Semantic Parsing},
  booktitle = {Proceedings of The 12th Language Resources and Evaluation Conference},
  month     = {May},
  year      = {2020},
  address   = {Marseille, France},
  publisher = {European Language Resources Association},
  pages     = {5831--5839},
}

@misc{zhang2023css,
  title     = {CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset}, 
  author    = {Hanchong Zhang and Jieyu Li and Lu Chen and Ruisheng Cao and Yunyan Zhang and Yu Huang and Yefeng Zheng and Kai Yu},
  year      = {2023},
}

@article{lee2022ehrsql,
  title     = {EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Records},
  author    = {Lee, Gyubok and Hwang, Hyeonji and Bae, Seongsu and Kwon, Yeonsu and Shin, Woncheol and Yang, Seongjun and Seo, Minjoon and Kim, Jong-Yeup and Choi, Edward},
  journal   = {Advances in Neural Information Processing Systems},
  volume    = {35},
  pages     = {15589--15601},
  year      = {2022},
}

@inproceedings{lee-2021-kaggle-dbqa,
  title     = {KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers},
  author    = {Lee, Chia-Hsuan and Polozov, Oleksandr and Richardson, Matthew},
  booktitle = {Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)},
  pages     = {2261--2273},
  year      = {2021},
}

@inproceedings{squall,
  title     = {On the Potential of Lexico-logical Alignments for Semantic Parsing to {SQL} Queries},
  author    = {Tianze Shi and Chen Zhao and Jordan Boyd-Graber and Hal {Daum\'{e} III} and Lillian Lee},
  booktitle = {Findings of EMNLP},
  year      = {2020},
}

@article{hazoom2021text,
  title     = {Text-to-SQL in the wild: a naturally-occurring dataset based on Stack exchange data},
  author    = {Hazoom, Moshe and Malik, Vibhor and Bogin, Ben},
  journal   = {arXiv preprint arXiv:2106.05006},
  year      = {2021},
}

@inproceedings{wang2020text,
  title     = {Text-to-SQL Generation for Question Answering on Electronic Medical Records},
  author    = {Wang, Ping and Shi, Tian and Reddy, Chandan K},
  booktitle = {Proceedings of The Web Conference 2020},
  pages     = {350--361},
  year      = {2020},
}

@inproceedings{nvBench_SIGMOD21,
  title     = {Synthesizing Natural Language to Visualization (NL2VIS) Benchmarks from NL2SQL Benchmarks},
  author    = {Yuyu Luo and Nan Tang and Guoliang Li and Chengliang Chai and Wenbo Li and Xuedi Qin},
  booktitle = {Proceedings of the 2021 International Conference on Management of Data, {SIGMOD} Conference 2021, June 20–25, 2021, Virtual Event, China},
  publisher = {ACM},
  year      = {2021},
}