Would you like to hear what we've been working on? Then you've come to the right place!
We are developing acoustic sensors for soft actuators, that use sound from within the actuator to detect, localize and overall characterize contact and other interactions.
We believe this to be a very powerful sensorization approach and want to share it with you. So on this page, we want to provide you with all the necessary tools to get started yourself.
The idea of acoustic sensing is to use information contained in sound, to sense the physical state of the sensorized object. We use it, for example, to measure the contact location on soft pneumatic actuators. But we have also used acoustic sensing to determine the force of a contact or to identify the material of the touched object.
This is possible, because sound traveling through any structure, e.g. soft actuators, is modulated slightly depending on the physical state of that structure. We can detect this small change and learn to infer from it the corresponding physical state, e.g. a contact at a specific location.
The great thing about this is that all you need is a microphone and speaker and you're ready to go! In the following, we present what hardware and software we are useing and provide you with simple scripts to get you started. In a few minutes, you can use acoustic sensing yourself to measure contact on a soft actuator. Or you can get more creative and try to sense how full a glass of water is, recognize the type of shoe you're wearing, or attempt to determine the ripeness of a watermelon by tapping it. Get creative!
Bitte beachten Sie: Sobald Sie sich das Video ansehen, werden Informationen darüber an YouTube/Google übermittelt. Weitere Informationen dazu finden Sie unter Google Privacy.
If you want to get started right away, all you need is microphone and a speaker. You can even use the built-in ones from you laptop. (For example, I used the provided scripts to detect which part of my laptop I was tapping against, using only my laptop's microphone.)
If you want to sensorize objects other than your laptop, you will, however, need external microphones and speakers. Here is the list of components we use to sensorize the PneuFlex actuator:
We provide example code for the recording of training data, training of the simple sensor model, and live sensing using the trained model.
The code can be found here: https://git.tu-berlin.de/rbo/robotics/acoustic_sensing_starter_kit
If you have any questions or would like to tell us about the cool acoustic sensor application you created, please don't hesitate to contact us!