
ankitjh4/bharat-government-documents 数据集
汇集经筛选的印度公共信息文档文本,面向问答和检索。
为什么重要
可作为印度公共信息问答与文本检索任务的数据来源。
阅读原文huggingface.co
AI 解读(根据原文生成)
这是 Hugging Face 上的文本数据集,主题为“Bharat Guide: screened Indian public information documents”。数据快照包含去重归一化后的文本正文及来源记录,每行对应一个归一化来源正文,并保留标题、URL、抽取质量、检索时间、规则版本、主题标签和来源别名等溯源信息。筛选为启发式而非人工事实验证;文本不授予统一再使用许可。数据集页面可通过已知链接访问。
要点(AI 据原文整理,数字均已与原文核对)
- This snapshot contains 55,050 distinct normalized text bodies and 65,209 source records.
- One Parquet row represents one normalized source body, with original extracted text, source title, URL, extraction quality, observed retrieval time, rule version, topic labels and all current-body sou
- Selection requires an eligible assessment whose body checksum still matches the current document, with full_text or ocr_text extraction.
- The text exports contain no raw response bytes or account credentials.
- The next release is due after at least 10,000 newly qualifying distinct bodies, not 10,000 fetched URLs or chunks.