Skip to content
@opendatalab

OpenDataLab

OpenDataLab provides access to numerous significant open-source datasets.

English🌎|简体中文🀄

Note

📚 In 2025, we have open-sourced a high-quality multilingual dataset, WanJuan 3.0 (WanJuan Silu) which comprises over 1.2TB of indigenous textual corpora from five countries. Each subset includes seven major categories and 34 subcategories, covering a wide range of local characteristics, such as history, politics, culture, real estate, shopping, weather, dining, encyclopedic knowledge, and professional expertise. Here are the download links for the five subsets, and we welcome everyone to download and use them.

WanJuan3.0 KoreanArabicVietnameseRussianThai


🔥🔥🔥OpenDataLab Provide ecology for high-quality datasets for community. It provides:

🌟Extensive open data resources for AI Model

● High-speed and simple way to access open datasets
● 7700+ Large scale and high-quality open datasets for large model
● 1200+ Open datasets for Computer Vision
● 200+ Open datasets by CVPR
● Categorized datasets for hot topics

✨Open-source data processing toolkits

● Data acquisition toolkits supporting large datasets
● Data acquisition toolkits supporting kinds of tasks
● Open source intelligent Toolbox for Labeling

💫Dataset description language

● Format standardization
● DSDL: Dataset Description Language
● Define a CV dataset by DSDL
● OpenDataLab Standardized 100+ CV Datasets

Check our tutorials videos (in Chinese) to get started.


📣 We have upgraded and launched the function of authors uploading datasets independently. We hereby invite you to participate in using it to better promote your open source datasets, AI research results, etc., so that more people can access, obtain and use your dataset.

This is an introduction to the dataset autonomous upload function 【help doc】,You can create and share your dataset according to our guidelines. 💪

If you have any questions or obstacles, please feel free to contact us [email protected].

Popular repositories Loading

  1. MinerU MinerU Public

    A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具,将PDF转换成Markdown和JSON格式。

    Python 29.6k 2.4k

  2. PDF-Extract-Kit PDF-Extract-Kit Public

    A Comprehensive Toolkit for High-Quality PDF Content Extraction

    Python 7.2k 502

  3. labelU labelU Public

    Data annotation toolbox supports image, audio and video data.

    Python 1.1k 115

  4. DocLayout-YOLO DocLayout-YOLO Public

    DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception

    Python 1k 79

  5. LabelLLM LabelLLM Public

    The Open-Source Data Annotation Platform

    TypeScript 762 72

  6. WanJuan1.0 WanJuan1.0 Public

    万卷1.0多模态语料

    555 28

Repositories

Showing 10 of 43 repositories
  • MinerU Public

    A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具,将PDF转换成Markdown和JSON格式。

    opendatalab/MinerU’s past year of commit activity
    Python 29,635 AGPL-3.0 2,350 156 8 Updated Apr 2, 2025
  • PM4Bench Public
    opendatalab/PM4Bench’s past year of commit activity
    Python 9 0 0 0 Updated Apr 2, 2025
  • LEGION Public

    The official implementation of the paper "LEGION: Learning to Ground and Explain for Synthetic Image Detection"

    opendatalab/LEGION’s past year of commit activity
    Python 24 1 1 0 Updated Apr 2, 2025
  • OpenHuEval Public
    opendatalab/OpenHuEval’s past year of commit activity
    Python 5 Apache-2.0 0 1 0 Updated Mar 31, 2025
  • LOKI Public

    [ICLR 2025 Spotlight] The official implementation of the paper “LOKI:A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models”

    opendatalab/LOKI’s past year of commit activity
    Python 141 4 1 0 Updated Mar 31, 2025
  • UrBench Public

    [AAAI 2025]This repo contains evaluation code for the paper “UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios”

    opendatalab/UrBench’s past year of commit activity
    Python 28 4 1 0 Updated Mar 29, 2025
  • FakeVLM Public

    FakeVLM: Advancing Synthetic Image Detection through Explainable Multimodal Models and Fine-Grained Artifact Analysis

    opendatalab/FakeVLM’s past year of commit activity
    Python 27 0 2 0 Updated Mar 27, 2025
  • DocLayout-YOLO Public

    DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception

    opendatalab/DocLayout-YOLO’s past year of commit activity
    Python 1,031 AGPL-3.0 79 11 3 Updated Mar 27, 2025
  • labelU Public

    Data annotation toolbox supports image, audio and video data.

    opendatalab/labelU’s past year of commit activity
    Python 1,127 Apache-2.0 115 14 (1 issue needs help) 0 Updated Mar 25, 2025
  • labelU-Kit Public

    Data annotation component library --provided as NPM packages

    opendatalab/labelU-Kit’s past year of commit activity
    TypeScript 85 Apache-2.0 24 3 2 Updated Mar 25, 2025