diff --git a/docs/the-droid-dataset.md b/docs/the-droid-dataset.md index 450da63..5cfb223 100644 --- a/docs/the-droid-dataset.md +++ b/docs/the-droid-dataset.md @@ -31,36 +31,16 @@ gsutil -m cp -r gs://gresearch/robotics/droid_100 gsutil -m cp -r gs://gresearch/robotics/droid_raw ``` - ### Accessing RLDS Dataset We provide a [Dataset Colab](https://colab.research.google.com/drive/1b4PPH4XGht4Jve2xPKMCh-AXXAQziNQa?usp=sharing) that walks you through the process of loading and visualizing a few samples from the DROID dataset. We also provide an example of a "training-ready" data loader that allows for efficient loading of DROID data for policy training (in PyTorch and JAX), including parallelized loading, normalization and augmentation in our [policy learning repo](https://github.com/droid-dataset/droid_policy_learning/blob/master/examples/droid_dataloader.py). -### Accessing Raw Data - -You can download the raw DROID data using the gsutil command listed above. It contains full-HD stereo videos for all three cameras, alongside with all other information contained in the RLDS dataset. Concretely, each episode folder contains the following information: -``` -episode: - | - |---- metadata_*.json: Episode metadata like building ID, data collector ID etc. - |---- trajectory.h5: All low-dimensional information like action and proprioception trajectories. - |---- recordings: - | - |---- MP4: - | | - | |---- *.mp4: High-res video of single (left) camera view. - | |---- *-stereo.mp4: High-res video of concatenated stereo camera views. - | - |---- SVO: - | - |---- *.svo: Raw ZED SVO file with encoded camera recording information (contains some additional metadata) - -``` ## 📝 Dataset Schema +The following fields are contained in every RLDS episode: ```python DROID = { "episode_metadata": { @@ -98,5 +78,26 @@ DROID = { } ``` +### Accessing Raw Data + +You can download the raw DROID data using the gsutil command listed above. It contains full-HD stereo videos for all three cameras, alongside with all other information contained in the RLDS dataset. Concretely, each episode folder contains the following information: +``` +episode: + | + |---- metadata_*.json: Episode metadata like building ID, data collector ID etc. + |---- trajectory.h5: All low-dimensional information like action and proprioception trajectories. + |---- recordings: + | + |---- MP4: + | | + | |---- *.mp4: High-res video of single (left) camera view. + | |---- *-stereo.mp4: High-res video of concatenated stereo camera views. + | + |---- SVO: + | + |---- *.svo: Raw ZED SVO file with encoded camera recording information (contains some additional metadata) + +``` + ## 📄 Data Analysis and Further Information Please consult the [paper](https://droid-dataset.github.io/paper.pdf) for detailed data analysis and further information about the dataset.