columbia_cairlab_pusht_real
Stay organized with collections
Save and categorize content based on your preferences.
UR5 planar pushing tasks
Split |
Examples |
'test' |
14 |
'train' |
122 |
FeaturesDict({
'steps': Dataset({
'action': FeaturesDict({
'gripper_closedness_action': float32,
'rotation_delta': Tensor(shape=(3,), dtype=float32, description=Delta change in roll, pitch, yaw.),
'terminate_episode': float32,
'world_vector': Tensor(shape=(3,), dtype=float32, description=Delta change in XYZ.),
}),
'is_first': bool,
'is_last': bool,
'is_terminal': bool,
'observation': FeaturesDict({
'image': Image(shape=(240, 320, 3), dtype=uint8),
'natural_language_embedding': Tensor(shape=(512,), dtype=float32),
'natural_language_instruction': string,
'robot_state': Tensor(shape=(2,), dtype=float32, description=Robot end effector XY state),
'wrist_image': Image(shape=(240, 320, 3), dtype=uint8),
}),
'reward': Scalar(shape=(), dtype=float32),
}),
})
Feature |
Class |
Shape |
Dtype |
Description |
|
FeaturesDict |
|
|
|
steps |
Dataset |
|
|
|
steps/action |
FeaturesDict |
|
|
|
steps/action/gripper_closedness_action |
Tensor |
|
float32 |
1 if close gripper, -1 if open gripper, 0 if no change. |
steps/action/rotation_delta |
Tensor |
(3,) |
float32 |
Delta change in roll, pitch, yaw. |
steps/action/terminate_episode |
Tensor |
|
float32 |
|
steps/action/world_vector |
Tensor |
(3,) |
float32 |
Delta change in XYZ. |
steps/is_first |
Tensor |
|
bool |
|
steps/is_last |
Tensor |
|
bool |
|
steps/is_terminal |
Tensor |
|
bool |
|
steps/observation |
FeaturesDict |
|
|
|
steps/observation/image |
Image |
(240, 320, 3) |
uint8 |
|
steps/observation/natural_language_embedding |
Tensor |
(512,) |
float32 |
|
steps/observation/natural_language_instruction |
Tensor |
|
string |
|
steps/observation/robot_state |
Tensor |
(2,) |
float32 |
Robot end effector XY state |
steps/observation/wrist_image |
Image |
(240, 320, 3) |
uint8 |
|
steps/reward |
Scalar |
|
float32 |
|
@inproceedings{chi2023diffusionpolicy,
title={Diffusion Policy: Visuomotor Policy Learning via Action Diffusion},
author={Chi, Cheng and Feng, Siyuan and Du, Yilun and Xu, Zhenjia and Cousineau, Eric and Burchfiel, Benjamin and Song, Shuran},
booktitle={Proceedings of Robotics: Science and Systems (RSS)},
year={2023}
}
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2024-09-03 UTC.
[null,null,["Last updated 2024-09-03 UTC."],[],[],null,["# columbia_cairlab_pusht_real\n\n\u003cbr /\u003e\n\n- **Description**:\n\nUR5 planar pushing tasks\n\n- **Homepage** :\n \u003chttps://github.com/columbia-ai-robotics/diffusion_policy\u003e\n\n- **Source code** :\n [`tfds.robotics.rtx.ColumbiaCairlabPushtReal`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/robotics/rtx/rtx.py)\n\n- **Versions**:\n\n - **`0.1.0`** (default): Initial release.\n- **Download size** : `Unknown size`\n\n- **Dataset size** : `2.80 GiB`\n\n- **Auto-cached**\n ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):\n No\n\n- **Splits**:\n\n| Split | Examples |\n|-----------|----------|\n| `'test'` | 14 |\n| `'train'` | 122 |\n\n- **Feature structure**:\n\n FeaturesDict({\n 'steps': Dataset({\n 'action': FeaturesDict({\n 'gripper_closedness_action': float32,\n 'rotation_delta': Tensor(shape=(3,), dtype=float32, description=Delta change in roll, pitch, yaw.),\n 'terminate_episode': float32,\n 'world_vector': Tensor(shape=(3,), dtype=float32, description=Delta change in XYZ.),\n }),\n 'is_first': bool,\n 'is_last': bool,\n 'is_terminal': bool,\n 'observation': FeaturesDict({\n 'image': Image(shape=(240, 320, 3), dtype=uint8),\n 'natural_language_embedding': Tensor(shape=(512,), dtype=float32),\n 'natural_language_instruction': string,\n 'robot_state': Tensor(shape=(2,), dtype=float32, description=Robot end effector XY state),\n 'wrist_image': Image(shape=(240, 320, 3), dtype=uint8),\n }),\n 'reward': Scalar(shape=(), dtype=float32),\n }),\n })\n\n- **Feature documentation**:\n\n| Feature | Class | Shape | Dtype | Description |\n|------------------------------------------------|--------------|---------------|---------|---------------------------------------------------------|\n| | FeaturesDict | | | |\n| steps | Dataset | | | |\n| steps/action | FeaturesDict | | | |\n| steps/action/gripper_closedness_action | Tensor | | float32 | 1 if close gripper, -1 if open gripper, 0 if no change. |\n| steps/action/rotation_delta | Tensor | (3,) | float32 | Delta change in roll, pitch, yaw. |\n| steps/action/terminate_episode | Tensor | | float32 | |\n| steps/action/world_vector | Tensor | (3,) | float32 | Delta change in XYZ. |\n| steps/is_first | Tensor | | bool | |\n| steps/is_last | Tensor | | bool | |\n| steps/is_terminal | Tensor | | bool | |\n| steps/observation | FeaturesDict | | | |\n| steps/observation/image | Image | (240, 320, 3) | uint8 | |\n| steps/observation/natural_language_embedding | Tensor | (512,) | float32 | |\n| steps/observation/natural_language_instruction | Tensor | | string | |\n| steps/observation/robot_state | Tensor | (2,) | float32 | Robot end effector XY state |\n| steps/observation/wrist_image | Image | (240, 320, 3) | uint8 | |\n| steps/reward | Scalar | | float32 | |\n\n- **Supervised keys** (See\n [`as_supervised` doc](https://www.tensorflow.org/datasets/api_docs/python/tfds/load#args)):\n `None`\n\n- **Figure**\n ([tfds.show_examples](https://www.tensorflow.org/datasets/api_docs/python/tfds/visualization/show_examples)):\n Not supported.\n\n- **Examples**\n ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):\n\nDisplay examples... \n\n- **Citation**:\n\n @inproceedings{chi2023diffusionpolicy,\n title={Diffusion Policy: Visuomotor Policy Learning via Action Diffusion},\n author={Chi, Cheng and Feng, Siyuan and Du, Yilun and Xu, Zhenjia and Cousineau, Eric and Burchfiel, Benjamin and Song, Shuran},\n booktitle={Proceedings of Robotics: Science and Systems (RSS)},\n year={2023}\n }"]]