Skip to content

Commit db34546

Browse files
authored
[Feature] Support mim download odl datasets (open-mmlab#2436)
1 parent fe4dec7 commit db34546

19 files changed

+702
-254
lines changed

MANIFEST.in

+1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,6 @@
11
include requirements/*.txt
22
include mmpose/.mim/model-index.yml
3+
include mmpose/.mim/dataset-index.yml
34
recursive-include mmpose/.mim/configs *.py *.yml
45
recursive-include mmpose/.mim/tools *.py *.sh
56
recursive-include mmpose/.mim/demo *.py

dataset-index.yml

+71
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,71 @@
1+
coco2017:
2+
dataset: COCO_2017
3+
download_root: data
4+
data_root: data/pose
5+
script: tools/dataset_converters/scripts/preprocess_coco2017.sh
6+
7+
mpii:
8+
dataset: MPII_Human_Pose
9+
download_root: data
10+
data_root: data/pose
11+
script: tools/dataset_converters/scripts/preprocess_mpii.sh
12+
13+
aic:
14+
dataset: AI_Challenger
15+
download_root: data
16+
data_root: data/pose
17+
script: tools/dataset_converters/scripts/preprocess_aic.sh
18+
19+
crowdpose:
20+
dataset: CrowdPose
21+
download_root: data
22+
data_root: data/pose
23+
script: tools/dataset_converters/scripts/preprocess_crowdpose.sh
24+
25+
halpe:
26+
dataset: Halpe
27+
download_root: data
28+
data_root: data/pose
29+
script: tools/dataset_converters/scripts/preprocess_halpe.sh
30+
31+
lapa:
32+
dataset: LaPa
33+
download_root: data
34+
data_root: data/pose
35+
script: tools/dataset_converters/scripts/preprocess_lapa.sh
36+
37+
300w:
38+
dataset: 300w
39+
download_root: data
40+
data_root: data/pose
41+
script: tools/dataset_converters/scripts/preprocess_300w.sh
42+
43+
wflw:
44+
dataset: WFLW
45+
download_root: data
46+
data_root: data/pose
47+
script: tools/dataset_converters/scripts/preprocess_wflw.sh
48+
49+
onehand10k:
50+
dataset: OneHand10K
51+
download_root: data
52+
data_root: data/pose
53+
script: tools/dataset_converters/scripts/preprocess_onehand10k.sh
54+
55+
freihand:
56+
dataset: FreiHAND
57+
download_root: data
58+
data_root: data/pose
59+
script: tools/dataset_converters/scripts/preprocess_freihand.sh
60+
61+
ap10k:
62+
dataset: AP-10K
63+
download_root: data
64+
data_root: data/pose
65+
script: tools/dataset_converters/scripts/preprocess_ap10k.sh
66+
67+
hagrid:
68+
dataset: HaGRID
69+
download_root: data
70+
data_root: data/pose
71+
script: tools/dataset_converters/scripts/preprocess_hagrid.sh

docs/en/advanced_guides/customize_datasets.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -256,4 +256,4 @@ combined_dataset = dict(
256256

257257
- **Converter transforms of sub-datasets** are applied when there exist mismatches of annotation format between sub-datasets and the combined dataset. For example, the number and order of keypoints might be different in the combined dataset and the sub-datasets. Then `KeypointConverter` can be used to unify the keypoints number and order.
258258

259-
- More details about `CombinedDataset` and `KeypointConverter` can be found in Advanced Guides-[Training with Mixed Datasets](../advanced_guides/mixed_datasets.md).
259+
- More details about `CombinedDataset` and `KeypointConverter` can be found in Advanced Guides-[Training with Mixed Datasets](../user_guides/mixed_datasets.md).

docs/en/user_guides/prepare_datasets.md

+65-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Prepare Datasets
22

3-
In this document, we will give a guide on the process of preparing datasets for the MMPose. Various aspects of dataset preparation will be discussed, including using built-in datasets, creating custom datasets, combining datasets for training, and browsing the dataset.
3+
In this document, we will give a guide on the process of preparing datasets for the MMPose. Various aspects of dataset preparation will be discussed, including using built-in datasets, creating custom datasets, combining datasets for training, browsing and downloading the datasets.
44

55
## Use built-in datasets
66

@@ -155,3 +155,67 @@ Here is a processed sample
155155
![transformed_coco](https://user-images.githubusercontent.com/26127467/187386652-bd47335d-797c-4e8c-b823-2a4915f9812f.jpg)
156156

157157
The heatmap target will be visualized together if it is generated in the pipeline.
158+
159+
## Download dataset via MIM
160+
161+
By using [OpenDataLab](https://opendatalab.com/), you can obtain free formatted datasets in various fields. Through the search function of the platform, you may address the dataset they look for quickly and easily. Using the formatted datasets from the platform, you can efficiently conduct tasks across datasets.
162+
163+
If you use MIM to download, make sure that the version is greater than v0.3.8. You can use the following command to update, install, login and download the dataset:
164+
165+
```shell
166+
# upgrade your MIM
167+
pip install -U openmim
168+
169+
# install OpenDataLab CLI tools
170+
pip install -U opendatalab
171+
# log in OpenDataLab, registry
172+
odl login
173+
174+
# download coco2017 and preprocess by MIM
175+
mim download mmpose --dataset coco2017
176+
```
177+
178+
### Supported datasets
179+
180+
Here is the list of supported datasets, we will continue to update it in the future.
181+
182+
#### Body
183+
184+
| Dataset name | Download command |
185+
| ------------- | ----------------------------------------- |
186+
| COCO 2017 | `mim download mmpose --dataset coco2017` |
187+
| MPII | `mim download mmpose --dataset mpii` |
188+
| AI Challenger | `mim download mmpose --dataset aic` |
189+
| CrowdPose | `mim download mmpose --dataset crowdpose` |
190+
191+
#### Face
192+
193+
| Dataset name | Download command |
194+
| ------------ | ------------------------------------ |
195+
| LaPa | `mim download mmpose --dataset lapa` |
196+
| 300W | `mim download mmpose --dataset 300w` |
197+
| WFLW | `mim download mmpose --dataset wflw` |
198+
199+
#### Hand
200+
201+
| Dataset name | Download command |
202+
| ------------ | ------------------------------------------ |
203+
| OneHand10K | `mim download mmpose --dataset onehand10k` |
204+
| FreiHand | `mim download mmpose --dataset freihand` |
205+
| HaGRID | `mim download mmpose --dataset hagrid` |
206+
207+
#### Whole Body
208+
209+
| Dataset name | Download command |
210+
| ------------ | ------------------------------------- |
211+
| Halpe | `mim download mmpose --dataset halpe` |
212+
213+
#### Animal
214+
215+
| Dataset name | Download command |
216+
| ------------ | ------------------------------------- |
217+
| AP-10K | `mim download mmpose --dataset ap10k` |
218+
219+
#### Fashion
220+
221+
Coming Soon

0 commit comments

Comments
 (0)