• 03 Oct 2023
• 2023

Piano VR, a piano-playing robot that attracts experiencers at AI4VN

[VnExpress] University of Economics Ho Chi Minh City (UEH) exhibited GrandAR Piano, a Music Playing Robot and Virtual Reality Bicycle that attracts experiencers for two days of September 21-22 at AI4VN.

The booth of UEH exhibited at the AI Expo - an exhibition within the framework of the Vietnam Artificial Intelligence Festival (AI4VN 2023), taking place at Riverside Palace, 360D Ben Van Don, District 4, Ho Chi Minh City. The entire exhibition has 30 booths with a variety of artificial intelligence application products in the fields of AI for households, businesses, hospitals, banks, and schools.

The experience space of UEH was outstanding with unique products, attracting attention as soon as it opened.

Mr. Huynh Thanh Dat - Minister of Science and Technology - along with leaders of ministries, departments, and scientists experiencing the products before the opening session of the AI Summit on September 22. Photo: Quynh Tran

GrandAR Piano - A virtual piano

The virtual piano includes a carpet with the letters a-b-c-d-e-f, connected to the AR screen, creating an experience of incorporating physical movements and music. To interact, visitors can choose their favorite music and jump on the carpet according to the marked characters. Corresponding to each dance step, the interactive screen will display the player standing on the giant keyboard with pleasant sounds and fun symbols.

Present at the event early, Hoai Phuong (Thu Duc district, Ho Chi Minh City) chose two songs: Twinkle Star and Kia con buom vang. Phuong was excited because that was the first time she experienced playing the piano with her feet, creating her own catchy melody, along with the image of herself standing on the giant keyboard in a virtual space.

"This is the first time I get to play the piano in such an interesting way," Phuong was dancing according to the instructions while she was describing her feelings.

The project development team said that the human-machine interaction model would bring a space full of interesting emotions. The product has contributed to changing the image of a multidisciplinary UEH, becoming a typical example of research and commercialization of technology products.

Many people experienced the virtual piano. Photo: UEH

GrandAR Piano is a collaborative research project between the Institute of Innovation, UEH College of Technology and Design and University of Natural Sciences, National University Ho Chi Minh City. The representative said that the goal of the project was to develop augmented reality applications in large spaces or public locations. The product first appeared in 2022, bringing a lot of excitement to UEH students.

Robot performing arts

The robot with a face and suit like a real artist sitting in front of the organ engaged the focus of the exhibition. The robot presented a skillful and complex musical performance along with playing the piano. The robot also interacted with visitors, tilted its head, smiled, and waved its hands, etc.

The robot performing piano at the festival. Photo: Thanh Tung

Many people gathered in front of the booth to watch the robot’s demonstration. Khanh Linh (District 5, Ho Chi Minh City) enjoyed dancing to the music and was surprised that the robot was skillful like an artist.

The robot development team of the Institute of Intelligence and Interaction, College of Technology and Design under UEH, said it took a lot of time to research, build and train skills for the product. To be able to play the piano, the robot combined mechatronics, communications and programming to create an innovative product.

"Machines are not just components assembled together that only perform rudimentary operations, but they can also become true artists. The guitar-playing robot is a clear demonstration of creativity and high applicability of technology in the field of art and education", the representative emphasized.

With this approach, the school hoped that people would love music more through unique and interesting performances.

R2S VR Cycling - driving in virtual reality

Using virtual reality technology (VR), R2S VR Cycling creates a virtual environment to simulate traffic situations thanks to VR technology so that users can practice reflexes like in reality.

For example, when walking and encountering obstacles or signs, users can develop observation skills, evaluate situations, and make decisions quickly and safely. This is also a way to help students master traffic rules in a safe and healthy testing environment.

Experiencing the AR bicycle. Photo: UEH

"After practicing my reflexes a few times, I feel more confident when participating in traffic," said Quang Thanh (District 11, Ho Chi Minh City). R2S VR Cycling is a project in the field of traffic safety education of the Institute of Smart Cities and Management (ISCM), UEH College of Technology and Design.

In addition to the exhibition booth, on the afternoon of September 21, UEH introduced the presentation of Dr. Nguyen Huu Huan - Head of UEH Financial Markets Department and Associate Professor, Dr. Nguyen Truong Thinh - Director of UEH Institute of Intelligent and Interactive Technology. Experts discussed the role of fintech in the 4.0 era and how to apply AI and big data to healthcare in two AI Workshop sessions.

UEH is currently developing a multidisciplinary strategy with a model of three member colleges including the College of Business; College of Economics, Law and Government; and College of Technology and Design. The unique technology products mentioned above are the initial results of this direction.

Source: VnExpress