-
Notifications
You must be signed in to change notification settings - Fork 48
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multi-Femto Mega camera connecting issue from the network #61
Comments
Hi @Anil-Bhujel Thank you for using the Femto Mega camera. We're glad to hear that the OrbeecSDK_ROS2 is running smoothly on your Ubuntu machine. Regarding your question about connecting multiple Femto Mega cameras over a network, I would first like to know how many cameras you plan to use and the resolution at which you plan to capture data. Our RGB streams use compression techniques such as MJPEG, H.264, and H.265, while depth streams are not compressed and are only available in Y16 format. Please note that H.264 and H.265 compression methods are only supported over the network. We will also soon be able to give you an example of setting up multiple cameras over the network. Best regards, |
@jian-dong
Sorry for a bit long queries, this is quite critical experiments and we are happy to use Orbbec camera. FYI, we set the IPs to each camera connected via network for single camera. When we connected all cameras in the network and run ros2 launch orbbec_camera femto_mega.launch.py enumerate_net_device:=true, it only launches single camera having the least IP address. Once again thank you for your time and support. |
Hi @Anil-Bhujel
This information will help us conduct a more accurate assessment. Thank you for your cooperation, and we will get back to you as soon as possible. |
Hi @jian-dong
I hope it clarifies you. If you have further let me know. |
@jian-dong |
In our previous test, the data size per second was: RGB: 1920x1080, 30fps, H264, data size: 2.59MB From this, we estimated that the data size for 4 cameras over 10 minutes would be 55.5GB. If the frame rate is reduced to 15fps, the data size would be: 55.5 / 2 = 27.77GB. If a lossless compression algorithm like RVL is used, with a compression ratio of 1/3, the total data size for 10 minutes should be reduced to around 9GB. @jian-dong Does rosbag2 support RVL compression and decompression during playback? |
Hi @zhonghong322 Thanks in advance |
I believe RVL is not being supported but you can use the MCAP file format as shown in the rosbag2 repository to properly configure your recordings and obtain better results through testings with different compression options as well |
Hi @Danilrivero, |
@jian-dong, |
Hi @Anil-Bhujel I have added a sample launch file for multiple network cameras with Femto Mega. You will need to download the Orbbec Viewer first from this link: OrbbecSDK Download. Locate the IP configuration options (as shown in the image below) and set a unique IP address for each camera. Please don't enable DHCP. Connect all cameras to a network switch, and then connect the switch to your computer. Your computer's network configuration should be on the same subnet as your cameras' IP addresses. After configuring, please ping the IP addresses of your cameras to ensure they are reachable. Once everything is set up, you can modify the launch sample file I provided to start multiple network cameras. Let’s focus on getting the multi-camera setup working first, and we can address further issues step-by-step. If you encounter any problems, please comment below on this issue. cc @xcy2011sky @zhonghong322 @jjiszjj |
Hi @jian-dong, @xcy2011sky, @jjiszjj , @zhonghong322 |
@Anil-Bhujel By the way, if you encounter any issues related to transmission efficiency, you can refer to the DDS tuning configuration documentation. For FastDDS, please refer to FastDDS Tuning Guide. For CycloneDDS, please check CycloneDDS Tuning Guide. |
@Anil-Bhujel |
|
@jian-dong |
@jian-dong, https://github.com/orbbec/OrbbecSDK_ROS2?tab=readme-ov-file#launch-parameters can we leverage from that? Our current recorded topics. You can see the ros2 timestamp at the bottom of the window and the color image from each camera at the right-side windows. |
@Anil-Bhujel |
Hi @Anil-Bhujel, We appreciate your patience and understanding. |
Hi @jian-dong |
Hi @jian-dong |
Hi @jian-dong |
You can configure the compression format in the ROS launch file. |
Hi @zhonghong322 |
@jian-dong Can ROS support recording and playback of H264 data |
@Anil-Bhujel A tool node for femto_mega decoding H264/H265 is provided under the femto_mega_h26x_decode branch. You can run this node to get the decoded video of H264/H265 and view the tool node from this link:https://github.com/orbbec/OrbbecSDK_ROS2/blob/femto_mega_h26x_decode/orbbec_camera/tools/mega_h26x_decode_node.cpp |
Hi @jjiszjj |
Hi @zhonghong322 @jjiszjj I used ros2 launch orbbec_camera femto_mega.launch.py color_format:=MJPG enumerate_net_device:=true and ros2 launch orbbec_camera femto_mega.launch.py enumerate_net_device:=true However, ros2 launch orbbec_camera femto_mega.launch.py color_format:=H264/H265 enumerate_net_device:=true seems working fine. Also, do we get back that coded topic to original image quality by running decoding node? |
Hi@Anil-Bhujel, thank you for your feedback.I have discovered this issue through your feedback and I will fix it in the near future. |
Hi@Anil-Bhujel .
|
@jjiszjj Further, we need to optimize power to the camera, so is there any facility to keep camera in sleep mode when no foreground scene is there? |
Hi @jian-dong and @zhonghong322 , |
Hello @jian-dong, Scene 2:
|
|
@Anil-Bhujel Scenario 2: You connected 4 Mega devices to the switch, which is then connected to your PC. I suspect both your switch and PC network ports are Gigabit Ethernet. Connecting 4 Mega devices might cause bandwidth issues. In this case, you can try reducing the frame rate to 15 fps, which should help. Additionally, when both PoE and DC power are supplied, the device will prioritize using DC power. |
@zhonghong322 Regarding optimization, if I change enable_ir to false, does it affect in depth calculation? This is the traffic from single Orbbec camera. @jian-dong @jjiszjj |
@Anil-Bhujel In subsequent versions, I will adapt to HS264/5 encoded videos from multiple cameras. |
@jjiszjj |
@Anil-Bhujel |
@jjiszjj
|
@jjiszjj |
@Anil-Bhujel Thank you for your feedback. I found your log here:#79 |
First of all, thanks for the nice SDK. I have setup the environment and run the OrbeecSDK_ROS2 in the Ubuntu machine and working fine. However, I didn't see the launch file for connecting multiple Femto Mega camera from the network. There is a launch file for multi-camera connected through USB but couldn't see for network ones. Could you please suggest about it how we can get it? Also, I would like to know about the compressed images from the camera. What compression technique is used and can we set the compression level during launch time?
Anil Bhujel,
Research Associate,
Michigan State University
The text was updated successfully, but these errors were encountered: