-
Notifications
You must be signed in to change notification settings - Fork 154
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Convert AudioData stream to arrays of floats, and convert arrays of floats to AudioData #84
base: master
Are you sure you want to change the base?
Commits on May 19, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 46e1c7f - Browse repository at this point
Copy the full SHA 46e1c7fView commit details -
Not compiling yet, want to be able to decode audio and then process a…
…rrays of samples.
Configuration menu - View commit details
-
Copy full SHA for a740590 - Browse repository at this point
Copy the full SHA a740590View commit details -
Configuration menu - View commit details
-
Copy full SHA for dba1563 - Browse repository at this point
Copy the full SHA dba1563View commit details -
Configuration menu - View commit details
-
Copy full SHA for e830583 - Browse repository at this point
Copy the full SHA e830583View commit details -
It looks like only one buffer is received, but I'm not handling it co…
…rrectly so the callback gets triggered repeatedly with the same buffer. It seems like I need something else in the pipeline to receive the app_buffer.
Configuration menu - View commit details
-
Copy full SHA for 2f2f32b - Browse repository at this point
Copy the full SHA 2f2f32bView commit details -
This may be the raw data- but what about 8-bit vs. 16-bit samples? Do…
… I have to know that and cast the data appropriately, or can I force conversion to expected format?
Configuration menu - View commit details
-
Copy full SHA for 16c637d - Browse repository at this point
Copy the full SHA 16c637dView commit details -
I thought I was getting good decoded data from the microphone, but no…
…w I only see five good samples and everything else is zero.
Configuration menu - View commit details
-
Copy full SHA for ad36501 - Browse repository at this point
Copy the full SHA ad36501View commit details -
Configuration menu - View commit details
-
Copy full SHA for e65a238 - Browse repository at this point
Copy the full SHA e65a238View commit details -
Passing data as -1.0 to 1.0 float now, so receiving node doesn't have…
… to understand it (should be 0 to 1.0?)
Configuration menu - View commit details
-
Copy full SHA for 3c51d1e - Browse repository at this point
Copy the full SHA 3c51d1eView commit details -
Configuration menu - View commit details
-
Copy full SHA for c87d14f - Browse repository at this point
Copy the full SHA c87d14fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9095bed - Browse repository at this point
Copy the full SHA 9095bedView commit details -
Trying to convert ros messages of floating point arrays to gstreamer …
…format, currently getting [ INFO] [/audio_capture] [/home/lucasw/catkin_ws/src/audio_common/float_to_audio/src/float_to_audio.cpp]:[208] [emitted push] [ERROR] [/audio_capture] [/home/lucasw/catkin_ws/src/audio_common/float_to_audio/src/float_to_audio.cpp]:[194] [gstreamer: Internal data flow error.] terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::lock_error> >' what(): boost: mutex Not sure if I'm specifying the float format correctly, x-raw-float is 0.10 and not 1.0.
Configuration menu - View commit details
-
Copy full SHA for 094a920 - Browse repository at this point
Copy the full SHA 094a920View commit details -
Should be able to trace problem with debug on:
0:00:00.016236728 17257 0x19a4720 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(int)28, channels=(int)1, width=(int)32, depth=(int)32, endianness=(int)1234, rate=(int)16000 in anything we support [ INFO] [/audio_capture] [/home/lucasw/catkin_ws/src/audio_common/float_to_audio/src/float_to_audio.cpp]:[208] [emitted push 8] 0:00:00.258644946 17257 0x19a4720 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(int)28, channels=(int)1, width=(int)32, depth=(int)32, endianness=(int)1234, rate=(int)16000 in anything we support 0:00:00.258680231 17257 0x19a4720 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(int)28, channels=(int)1, width=(int)32, depth=(int)32, endianness=(int)1234, rate=(int)16000 in anything we support 0:00:00.258704660 17257 0x19a4720 WARN basesrc gstbasesrc.c:2948:gst_base_src_loop:<source> error: Internal data flow error. 0:00:00.258712146 17257 0x19a4720 WARN basesrc gstbasesrc.c:2948:gst_base_src_loop:<source> error: streaming task paused, reason not-negotiated (-4) 0:00:00.258770927 17257 0x19a4720 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(int)28, channels=(int)1, width=(int)32, depth=(int)32, endianness=(int)1234, rate=(int)16000 in anything we support 0:00:00.258792146 17257 0x19a4720 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(int)28, channels=(int)1, width=(int)32, depth=(int)32, endianness=(int)1234, rate=(int)16000 in anything we support [ERROR] [/audio_capture] [/home/lucasw/catkin_ws/src/audio_common/float_to_audio/src/float_to_audio.cpp]:[194] [gstreamer: Internal data flow error.] terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::lock_error> >' what(): boost: mutex lock failed in pthread_mutex_lock: Invalid argument Aborted (core dumped)
Configuration menu - View commit details
-
Copy full SHA for 88f69cc - Browse repository at this point
Copy the full SHA 88f69ccView commit details -
Trying out paused, but the next problem seems to be with pads? gstpad…
….c gst_pad_push_data error pushing events, return not-negotiated (Seen on debug level 6)
Configuration menu - View commit details
-
Copy full SHA for 4677fbe - Browse repository at this point
Copy the full SHA 4677fbeView commit details -
Trying out S16LE as the input type, but now back to 0:00:00.276624022…
… 16823 0x224a000 WARN basetransform gstbasetransform.c:1414:gst_base_transform_setcaps:<filter> transform could not transform audio/x-raw, format=(string)S16LE, channels=(int)1, layout=(int)0, width=(int)16, depth=(int)16, rate=(int)16000, signed=(boolean)true in anything we support
Configuration menu - View commit details
-
Copy full SHA for 9e7d9a1 - Browse repository at this point
Copy the full SHA 9e7d9a1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6a0592b - Browse repository at this point
Copy the full SHA 6a0592bView commit details -
Finall got it! The whole problem was not specifying the layout as a s…
…tring. The input and output rates do look different though
Configuration menu - View commit details
-
Copy full SHA for c8c1653 - Browse repository at this point
Copy the full SHA c8c1653View commit details -
Making messages debug level, also adjusting visualization. Next step …
…is to approximate nes sound chip with A-D voices, have four ros nodes in control of each, and then they can be played individually.
Configuration menu - View commit details
-
Copy full SHA for 4fe1db6 - Browse repository at this point
Copy the full SHA 4fe1db6View commit details -
Configuration menu - View commit details
-
Copy full SHA for bba66bd - Browse repository at this point
Copy the full SHA bba66bdView commit details -
Wave encoding doesn't work, trying to fix that- if I put too many cap…
…s in it results in internal data error. Also trying to make noise sound more like online examples- I think when sample rate exceeds output sample rate there needs to be averaging. Also it is possible the mp3 compression is making the sound much different (could increase bitrate?), which is why I want wave to work.
Configuration menu - View commit details
-
Copy full SHA for c642cbd - Browse repository at this point
Copy the full SHA c642cbdView commit details -
flac seems to work, though I got a crash once (maybe a different node…
… though), and can't get rqt to load the config file
Configuration menu - View commit details
-
Copy full SHA for 18b4d29 - Browse repository at this point
Copy the full SHA 18b4d29View commit details -
disabling wave. Flac works but the waveform is really different, it s…
…eems like there ought to be an auditory difference (or maybe I need the conversion to float to understand the decoded format better)
Configuration menu - View commit details
-
Copy full SHA for a4c7f70 - Browse repository at this point
Copy the full SHA a4c7f70View commit details -
Rename projects for consistency, but maybe float_to_audio should be a…
…udio_from_float to have the same prefix as the rest of the projects? Also deleted a lot of commented out code. Inability to kill float_to_audio easily remains, also other major issue is that audio_to_float assumes format to convert to float, I think I understand gstreamer enough to make it do the floating point conversion.
Configuration menu - View commit details
-
Copy full SHA for 52fe48c - Browse repository at this point
Copy the full SHA 52fe48cView commit details -
The launch file doesn't work when I launch it- something is wrong wit…
…h float_to_audio, but when I run it manually it does work: rosrun float_to_audio float_to_audio audio:=audio2 samples:=decoded __name:=float_to_audio __ns:=/audio
Configuration menu - View commit details
-
Copy full SHA for 2fc59f5 - Browse repository at this point
Copy the full SHA 2fc59f5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b7fb73 - Browse repository at this point
Copy the full SHA 5b7fb73View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4584078 - Browse repository at this point
Copy the full SHA 4584078View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8bae90d - Browse repository at this point
Copy the full SHA 8bae90dView commit details -
Configuration menu - View commit details
-
Copy full SHA for f6a80dc - Browse repository at this point
Copy the full SHA f6a80dcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 497bba7 - Browse repository at this point
Copy the full SHA 497bba7View commit details -
Configuration menu - View commit details
-
Copy full SHA for d61ee03 - Browse repository at this point
Copy the full SHA d61ee03View commit details -
Configuration menu - View commit details
-
Copy full SHA for e0a3be8 - Browse repository at this point
Copy the full SHA e0a3be8View commit details