Wednesday, February 10, 2010

The VoiceBot: A Voice Controlled Robot Arm

Comment on Daniel's blog


In this paper, Brandi House, Jonathan Malkin and Jeff Bilmes look at modifying the vocal joy stick in such a way that it can be used to control a robot arm. They first built a 2d model and then extended to to the 3d robotic arm. They tested the robotic arm with multiple control schemes including forward kinematic, where each joint is controlled separately, and inverse kinematic, where the user directly controls the end furthest from the base and the other joints are positioned using an inverse kinematic solver.




The robot arm was controlled by the user making various vowel sounds at varying pitches and volumes. For the tests, fore each control scheme several users were given instructions and was allowed up to ten minutes to practice. They were then given the task of using the robot arm to pick up two pieces of candy and place them in a target area. It was found that the users favored and worked better with the inverse kinematic control scheme as opposed to the forward kinematic controls.




I do think that this could be usefull for disabled people. I also think it could be interesting to watch some one use this. It would kind of sound like they are singing. Also, we already have several other forms of controll for the handicapped like gazing and brain sensors.

No comments:

Post a Comment