Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[detectaction] Robokudo real robot #235

Merged
merged 17 commits into from
Dec 5, 2024
Merged

Conversation

sunava
Copy link
Collaborator

@sunava sunava commented Dec 2, 2024

DetectAction Overview

The DetectAction now returns a list of all detected objects. It supports various detection techniques:

  • ALL: 0
  • HUMAN: 1
  • TYPES: 2
  • REGION: 3
  • HUMAN_ATTRIBUTES: 4
  • HUMAN_WAVING: 5

Real Environment Behavior

Objects perceived in the real world are dynamically spawned into the environment.

Simulation Behavior

  • The get_scene_objects method serves as a mockup for the ALL detection type.
  • Detection types like HUMAN and HUMAN_ATTRIBUTES are not supported in the simulation.

Important Note

In the real Robokudo system, filtering for specific objects is not supported by default. While the detection pipeline is correct, if you are using it in a real environment, you must manually filter the objects in your demo.

State Management

  • The state parameter manages continuous perception.
  • Default state: start.
  • The perception can be stopped by setting state=stop.

To-Do

@Tigul: Implement knowledge condition.

# Example:
# self.knowledge_condition = VisibleProperty(self.object_designator_description)

…pports more robokudo functions -> Note: robokudo does not support query only for a specific object currently we have to mock up this in our demos.
…pports more robokudo functions -> Note: robokudo does not support query only for a specific object currently we have to mock up this in our demos.
src/pycram/datastructures/world.py Outdated Show resolved Hide resolved
src/pycram/process_modules/default_process_modules.py Outdated Show resolved Hide resolved
src/pycram/process_modules/default_process_modules.py Outdated Show resolved Hide resolved
src/pycram/process_modules/default_process_modules.py Outdated Show resolved Hide resolved
src/pycram/process_modules/pr2_process_modules.py Outdated Show resolved Hide resolved
test/test_designator/test_action_designator.py Outdated Show resolved Hide resolved
src/pycram/datastructures/world.py Outdated Show resolved Hide resolved
src/pycram/designators/action_designator.py Show resolved Hide resolved
src/pycrap/objects.py Outdated Show resolved Hide resolved
@sunava sunava requested a review from tomsch420 December 3, 2024 15:32
@sunava sunava merged commit 4045d9e into cram2:dev Dec 5, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants