Position control of an acoustic cavitation bubble by reinforcement learning

Klapcsik, Kálmán (avtor), Gyires-Tóth, Bálint (avtor), Rosselló, Juan Manuel (avtor), Hegedüs, Ferenc (avtor)

Reinforcement Learning (RL) is employed to develop control techniques for manipulating acoustic cavitation bubbles. This paper presents a proof of concept in which an RL agent is trained to discover a policy that allows precise control of bubble positions within a dual-frequency standing acoustic wave field by adjusting the pressure amplitude values. The agent is rewarded for driving the bubble to a target position in the shortest possible time. The results demonstrate that the agent exploits the nonlinear behaviour of the bubble and, in specific cases, identifies solutions that cannot be addressed using the linear theory of the primary Bjerknes force. The RL agent performs well under domain randomization, indicating that the RL approach generalizes effectively and produces models robust against noise, which could arise in real-world applications.

• Jezik: Angleški jezik
• Ključne besede: acoustic bubble, reinforcement learning, sonochemistry
• Vrsta gradiva: Članek v reviji
• Tipologija: 1.01 - Izvirni znanstveni članek
• Organizacija: FS - Fakulteta za strojništvo
• Status publikacije: Objavljeno
• Različica publikacije: Objavljena publikacija
• Leto izida: 2025
• Št. strani: 14 str.
• Številčenje: Vol. 115, art. 107290
• PID: 20.500.12556/RUL-167766
• UDK: 621
• ISSN pri članku: 1873-2828
• DOI: 10.1016/j.ultsonch.2025.107290
• COBISS.SI-ID: 228470787
• Datum objave v RUL: 11.03.2025

Gradivo je del revije

• Naslov: Ultrasonics Sonochemistry
• Založnik: Elsevier
• ISSN: 1873-2828
• COBISS.SI-ID: 23127813

Licence

• Licenca: CC BY-NC-ND 4.0, Creative Commons Priznanje avtorstva-Nekomercialno-Brez predelav 4.0 Mednarodna
• Povezava: http://creativecommons.org/licenses/by-nc-nd/4.0/deed.sl
• Opis: Najbolj omejujoča licenca Creative Commons. Uporabniki lahko prenesejo in delijo delo v nekomercialne namene in ga ne smejo uporabiti za nobene druge namene.