Question Pairs Dataset
- by user1
- 03 March, 2022
Can you identify duplicate questions?
Quora’s first public dataset is related to the problem of identifying duplicate questions. At Quora, an important product principle is that there should be a single question page for each logically distinct question. For example, the queries “What is the most populous state in the USA?” and “Which state in the United States has the most people?” should not exist separately on Quora because the intent behind both is identical. Having a canonical page for each logically distinct query makes knowledge-sharing more efficient in many ways: for example, knowledge seekers can access all the answers to a question in a single location, and writers can reach a larger readership than if that audience was divided amongst several pages.
The dataset is based on actual data from Quora and will give anyone the opportunity to train and test models of semantic equivalence.
There are over 400,000 lines of potential question duplicate pairs. Each line contains IDs for each question in the pair, the full text for each question, and a binary value that indicates whether the line truly contains a duplicate pair.
For more information on this dataset, check out Quora’s first dataset release page.
This data is subject to Quora’s Terms of Service, allowing for non-commercial use.
Size: 21285 KB Price: Free Author: Quora Data source: kaggle.com