Click here to sign in with or
Forget Password?
Learn more
share this!
16
Twit
Share
Email
August 22, 2022 feature
by Ingrid Fadelli , Tech Xplore
Researchers University of California, Berkeley (UC Berkeley), Université de Montréal and Mila have recently developed a hierarchical reinforcement learning framework to improve the precision of quadrupedal robots in soccer shooting. This framework, introduced in a paper pre-published on arXiv, was deployed on a Unitree A1, a quadruped robot developed by UnitreeRobotics.
“Human legs are not only for locomotion but can also be used for manipulation like playing soccer, and we want to enable quadrupedal robots to also attain this ability,” Zhongyu Li, one of the researchers who carried out the study, told TechXplore. “There is a notable league in the robotics community called ‘RoboCup’ (Robot World Cup), that has been inviting researchers to train their robots to play soccer games for decades.”
Recent advancements have enabled the creation of more reliable hardware and advanced control algorithms for robots. As a result, robots are now more agile and could potentially tackle more complex tasks, including playing soccer alongside humans. The framework developed by Li and his colleagues could help to improve the ability of quadruped robots to shoot the ball during soccer games.
The new framework has two key components: a motion control policy and a motion planning policy. The motion control component allows the robot to track an arbitrary trajectory for the toe on its kicking leg. The motion planning policy, on the other hand, selects an optimal toe trajectory to shoot a nearby soccer ball (detected by an external camera) to a target location (e.g., the goalpost).
“Our design allows us to decouple the challenge of the precise soccer shooing task into the two subtasks: control and planning,” Li said. “We can first focus on training a robust control policy that can work on the hardware, then re-use such a controller to learn the planning strategy. To precisely shoot the ball to targets in the real world, the planner is trained using the real-world data when the robot is shooting the real soccer ball.”
Li and his colleagues tested their framework in a series of real-world tests, using an A1 quadruped robot. They found that it allowed the robot to shoot a deformable soccer ball to random targets with high precision. This is a very complex task to tackle, as the robot needs to swing its kicking leg quickly and gain momentum without losing its balance.
“The soccer ball introduces more challenges because the robot needs to deal with not only the hard-to-model soft contact with the deformable ball but also the uncertainties of the rolling friction between the ball and the ground,” Li said. “The methodology we developed to address such problems could be potentially useful for the tasks where dynamic robots, such as legged robots, have to interact with soft objects, such as ball, ropes, leash, clothes, etc.”
In the future, the framework created by this team of researchers could be used to improve the performance of robots in soccer tournaments, particularly Robocup. Meanwhile, Li and his colleagues plan to devise other frameworks and machine learning models to improve the performance of robots in other elements of soccer playing.
“Our long-term goal is to develop quadrupedal robotic soccer players that could one day compete with humans,” Li added. “We are developing more complex soccer skills using quadrupedal robots and hopefully, in the near future, we can start a fully autonomous soccer game using quadrupedal robots.”
Explore further
© 2022 Science X Network
Facebook
Twitter
Email
Feedback to editors
2 hours ago
0
2 hours ago
0
9 hours ago
0
Aug 19, 2022
0
Aug 16, 2022
0
59 minutes ago
1 hour ago
1 hour ago
1 hour ago
2 hours ago
2 hours ago
7 hours ago
Nov 25, 2021
Aug 27, 2020
Aug 16, 2022
Nov 02, 2021
Jun 20, 2019
May 05, 2022
2 hours ago
Aug 19, 2022
Aug 17, 2022
Aug 17, 2022
Aug 16, 2022
Aug 16, 2022
Use this form if you have come across a typo, inaccuracy or would like to send an edit request for the content on this page. For general inquiries, please use our contact form. For general feedback, use the public comments section below (please adhere to guidelines).
Please select the most appropriate category to facilitate processing of your request
Thank you for taking time to provide your feedback to the editors.
Your feedback is important to us. However, we do not guarantee individual replies due to the high volume of messages.
Your email address is used only to let the recipient know who sent the email. Neither your address nor the recipient’s address will be used for any other purpose. The information you enter will appear in your e-mail message and is not retained by Tech Xplore in any form.
Daily science news on research developments and the latest scientific innovations
Medical research advances and health news
The most comprehensive sci-tech news coverage on the web
This site uses cookies to assist with navigation, analyse your use of our services, collect data for ads personalisation and provide content from third parties. By using our site, you acknowledge that you have read and understand our Privacy Policy and Terms of Use.