February 25, 2024

We are creating some awesome events for you. Kindly bear with us.

CityU Researchers Co-Develop Advanced Robotic VR System

A research team co-led by the City University of Hong Kong (CityU) recently developed an innovative human-machine interface (HMI) that can teleoperate robots to imitate the user’s actions and perform complicated tasks. The breakthrough technology demonstrates the potential for conducting COVID-19 swab tests and nursing patients with infectious diseases.

A key part of the advanced HMI system, named Robotic VR, is the flexible, multi-layered electronic skin developed by Dr Yu Xinge, Associate Professor in the Department of Biomedical Engineering (BME) at CityU, and his team. The system’s bottom layer of skin-tone elastomeric silicone serves as a soft adhesive interface that can be mounted on the skin and joints of the user.

Dr Yu stated that the new system enables teleoperating robotics to conduct complicated tasks. Doctors wearing the HMI system with VR glasses can remotely control the robots and experience the tactile sensations of the robots to accurately conduct surgery, and medical workers can remotely manipulate the robots to look after infectious patients or collect bio-samples, thus greatly decreasing the infection risk.

The team conducted experiments such as remotely controlling the robotic hand to collect throat swab samples for COVID-19 tests and to teleoperate humanoid robots to clean a room and even provide patient care. The team is developing a next-generation system for the robotic collection of nasal swab tests.

The layers of the electronic skin are interconnected with a collection of chip-scale integrated circuits and sensing components, including resistors, capacitors, a Bluetooth module, a microcontroller unit (MCU), and soft sensors and actuators developed by the team.

The sensors of the Robotic VR system can accurately detect and convert subtle human motion into electrical signals, which are processed by the MCU and wirelessly transmitted to the target robot. In this way, the user can teleoperate with the robot to imitate their motion to accomplish tasks remotely. The pressure sensors on the robot can send feedback signals to control the vibration intensity of the haptic actuators through the Bluetooth module, thus providing haptic feedback for the user. The user can then precisely control and adjust the motion of the robot’s arm according to the intensity of the feedback.

The new system is stretchable and can be tightly mounted on human skin and even the whole human body for a long time. In addition, the interface provides both haptic and visual feedback systems, providing an immersive experience for users.

The HMI system links users to robotics or computers and plays a significant role in teleoperating robotics. However, conventional HMIs are based on bulky, rigid and expensive machines, and the lack of adequate feedback for users limits their application for conducting complicated tasks.

With the advanced circuit design and outstanding mechanical characteristics, Dr Yu believes Robotic VR can teleoperate various machines, e.g., driverless cars, while people with disability can remotely manipulate a robot to carry heavy goods. This new system is also expected to help provide a new approach in wirelessly connecting people to a robot or virtual character in the metaverse.

The system supports three wireless transmission methods – Bluetooth (up to tens of metres), Wi-Fi (up to about 100 metres), and the Internet (worldwide) – which can be adjusted according to practical applications.

The research study was published in Science Advances under the title “Electronic Skin as Wireless Human Machine Interfaces for Robotic VR”. The corresponding authors are Dr Yu and Professor Xie Zhaoqian from Dalian University of Technology (DUT). The first authors are PhD students Liu Yiming, Yiu Chun-ki and post-doc fellow, Dr Huang Ya, from BME, and Ms Song Zhen from DUT.

PARTNER

Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.

PARTNER

CTC Global Singapore, a premier end-to-end IT solutions provider, is a fully owned subsidiary of ITOCHU Techno-Solutions Corporation (CTC) and ITOCHU Corporation.

Since 1972, CTC has established itself as one of the country’s top IT solutions providers. With 50 years of experience, headed by an experienced management team and staffed by over 200 qualified IT professionals, we support organizations with integrated IT solutions expertise in Autonomous IT, Cyber Security, Digital Transformation, Enterprise Cloud Infrastructure, Workplace Modernization and Professional Services.

Well-known for our strengths in system integration and consultation, CTC Global proves to be the preferred IT outsourcing destination for organizations all over Singapore today.

PARTNER

Planview has one mission: to build the future of connected work. Our solutions enable organizations to connect the business from ideas to impact, empowering companies to accelerate the achievement of what matters most. Planview’s full spectrum of Portfolio Management and Work Management solutions creates an organizational focus on the strategic outcomes that matter and empowers teams to deliver their best work, no matter how they work. The comprehensive Planview platform and enterprise success model enables customers to deliver innovative, competitive products, services, and customer experiences. Headquartered in Austin, Texas, with locations around the world, Planview has more than 1,300 employees supporting 4,500 customers and 2.6 million users worldwide. For more information, visit www.planview.com.

SUPPORTING ORGANISATION

SIRIM is a premier industrial research and technology organisation in Malaysia, wholly-owned by the Minister​ of Finance Incorporated. With over forty years of experience and expertise, SIRIM is mandated as the machinery for research and technology development, and the national champion of quality. SIRIM has always played a major role in the development of the country’s private sector. By tapping into our expertise and knowledge base, we focus on developing new technologies and improvements in the manufacturing, technology and services sectors. We nurture Small Medium Enterprises (SME) growth with solutions for technology penetration and upgrading, making it an ideal technology partner for SMEs.

PARTNER

HashiCorp provides infrastructure automation software for multi-cloud environments, enabling enterprises to unlock a common cloud operating model to provision, secure, connect, and run any application on any infrastructure. HashiCorp tools allow organizations to deliver applications faster by helping enterprises transition from manual processes and ITIL practices to self-service automation and DevOps practices. 

PARTNER

IBM is a leading global hybrid cloud and AI, and business services provider. We help clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM’s hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently and securely. IBM’s breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM’s legendary commitment to trust, transparency, responsibility, inclusivity and service.

Send this to a friend