OpenGov spoke to Thillai Raj T Ramanathan, Chief Technology Officer of MIMOS Berhad. This is the first part of the interview (click here for Part 2), reporting on the implementation of Internet of Things (IoT) strategy in Malaysia.
Can you tell us about the broad areas of focus in the short and medium term?
I will start with a short description of the role of MIMOS. We are an agency under the Ministry of Science, Technology and Innovation (MOSTI). Our charter is to do R&D. We are the national R&D agency for ICT for the country.
We focus on many areas of research, security technologies, Internet of Things (IoT), big data analytics, nanotechnology. Our work encompasses a whole gamut of areas but basically these technologies converge together to produce solutions for IoT and Big data analytics. These are the two key things we are looking at.
Take security as an example. In both IoT and big data, we look at security and privacy issues, how to make sure that the privacy of the individual is maintained, that their personal data is not leaked.
To take another example, we are looking at edge computing. Though networks are improving today,we find that there a lot of latencies in networks because of the advent of IoT. To get data from point A to point B, it has to pass through multiple hops and each has associated latency.
When we are handling mission-critical things, using IoT or big data, we need the latency or the time taken to be very short, at the scale of milliseconds. Instead of computing on the central cloud, we place devices on the edge and do the computation there. Effectively, the devices form an ad hoc cloud on the edge. They compute and send the results back. So, you just need small bandwidth to carry the results back. Data transfer time from the device to the cloud goes down significantly.
We are also looking at nanotechnology, at how to miniaturise products. This includes microelectronics, microelectromechanical systems (MEMS). We are looking at how to use graphene to build flexible electronics and make wearable devices.
Do you face any issues because of the variability in network availability and quality across a large country?
Broadband penetration is increasing in the country. But the number of users has increased tremendously. On top of that, most of us carry more than one device. We may carry one or more cellphones, a notebook, a tablet. Even in urban areas, with reasonable networks, the networks are slowly getting congested by the proliferation of IoT devices.
We think that the speed and bandwidth of networks cannot cope with the number of devices being introduced by the consumers. For the urban areas, we have moved more and more things to the edge. You still need your backend backhauls or your network back to data centres. But with edge computing, the data load is much smaller.
When you look at rural areas, telecom companiesare reluctant to invest there. Because the Average Revenue Per User (ARPU) is very small. The population is sparse and you don’t get many users to a base station. So, in those communities, we give them a whole mesh Wi-Fi network, which are linked back to the cloud.
You get your IoT device talking to your phone using Bluetooth or NFC (Near Field Communication). Then the data goes back over theWi-Fi, and passes through the backhaul back to the cloud. That is the cost-effective solution we see for rural areas.
What kind of capital expenditure (capex) is involved?
It is still a capex but the capex is much smaller. We are also trying to make it self-sustained. The first thing is security. If you have a Wi-Fi in a village, then we add cameras to it. The villagers are using the cameras to do their own surveillance. They can monitor if the kids going to school are safe, if the public areas are safe, whether there are any intruders anywhere.
The second part is services. They are able to sell their agricultural produce and trade over the network in general. This creates a whole ecosystem and generates income, which can be used for maintenance. It’s not just about installing it the first time, it is about maintaining the infrastructure.
Once the villagers see the benefit of a portal like AgroBazaar, where they can market produce from their farms or livestock, then usage will go up. Lot of them are in distant villages where they do not have direct access to connectivity.
They also get to see the market prices. They can accordingly adjust their production to maintain demand-supply balance and prevent drastic price drops. This gives them economic control. They will keep the infrastructure going, because they see social and economic value in it.
How do you ensure that the end-users adopt the technology?
Most of the applications run on mobile phones. The ubiquitous big touchscreens have improved the adoption of technology massively from what it was 10-15 years ago. The ease of use is the key. Navigation is much simpler. Then the inherent ‘value’ I mentioned previously is a major driver.
Is the data collected from such systems being used for decision-making?
That data is very valuable. As they begin to use the system, we can see patterns of usage. We don’t look into the data. The data is private. But we look at the patterns. Like when and from where are they logging into the system, is it from their house, from their community areas.We are able to draw inferences from that.
We analyse the data to decide where to position the Wi-Fi signals. Because the village is too big, Wi-Fi cannot cover it. But we have hotspots placed strategically. Looking at this data, we can tell if they are using it mostly in the community hall and then ensure good coverage there.
We also get to see how often are they using the data to sell their produce. If it is not effective, then we try to find the reasons. It could be because our system is not user-friendly or it frequently hangs. This helps us do a continuous cycle of improvement. Improving the services to the community is key.
In terms of analytics, we also do video analytics. Like checking how many intruders have gone into the area. We can give the feedback to the community, so that they can take appropriate safeguards, like placing a security guard at the right locations.
Are you working on developing common IoT standards?
The bottom layer in IoT is the devices. On top of it, you have the network providing connectivity, which could 3G, 4G, Bluetooth, Wi-Fi etc. Then there is a layer called the middleware or the platform layer. Then you have the applications on top.
There are many IoT standards today, maybe more than a dozen. We found that the biggest problem for industry was working on the platform layer or middleware, which translates all the devices and different protocols into some protocol which you can then use for designing applications.
To help the adoption of IoT by Small and Medium Scale Industries (SMEs) in Malaysia, we have designed a platform, which we released two weeks ago during MyIoT Week. It’s called Mi-MIST (MIMOS Internet Service of Things). It is designed to make connectivity easier. We didn’t just design a middleware but we released our own products based on MIST.
Can you tell us about some applications of the platform,Mi-MIST?
Let me tell you about our Durian story. There is one variety of durian called the Musang King. It is one of the best durians in the world and it comes from a specific place. The durians are frozen, put into boxes and shipped to China. They are distributed around China. It is a multi-million-dollar business.
Some of the surrounding countries were also selling durians, which they claimed was Musang King. The Malaysian Durian ExportersAssociation sought our help in stopping or reducing this counterfeiting.
In IoT the first thing is the sensor. The sensor for us was a QR code on the box. The box also had a serial number printed on it. The consumers in China are highly concerned over fake goods. Now, you can use your handphone to scan the QR code. It will take you to a site that will tell you where the durian came from, how it was packaged, what certifications does it have, such as Halal certifications or ones from health agencies and where it was shipped.
Following this, the Exports of durian to China actually grew by 30%. The buyers can check the authenticity of the durian and for the sellers it is an excellent marketing tool. They can track in which part of China the scan was being done and how many scans were happening and thereby get geographical sales data.
In this case, the IoT comprised the QR code, scans done by the phone, sending data back through the network through the middleware,Mi-MIST. We used this in-house designed solution to demonstrate how Mi-MIST could be used.
Another example, is a project we did with the police. Individuals charged with crimes are detained in police lock-ups for a certain period of time before they go to a court. The lockup cell is shared by multiple people, up to 7-8. There were incidences of fights, people getting beaten up, even deaths. There are not enough wardens to monitor all the cells.
The police and the Human Rights Commission wanted to avoid this. So, we put a camera in the lockup. Here the camera is the sensor. The camera detects the behaviour and then video analytics is used. The machine looks at the video images and detects aggressive behaviour. It sends an alert automatically to the police. Now they can respond quickly, whenever there is an alarm. It saves lives by getting prompt medical attention in case someone is injured. The network was Wi-Fi and the middleware was Mi-MIST again.
Read the second part of the interview here.
The Singapore Tourism Board (STB) and Singapore Association of Convention & Exhibition Organisers & Suppliers (SACEOS) released the MICE Sustainability Roadmap, which outlines specific goals and plans for raising sustainability standards throughout the MICE sector in Singapore over the coming years.
The Meetings, Incentives, Conventions, and Exhibitions (MICE) industry is a type of tourism travel in which groups of people are brought together for a specific reason, usually well in advance. On the other hand, the MICE market refers to a subset of people who plan, arrange, and facilitate conferences, seminars, exhibitions, and other events.
Part of STB’s overarching plan to develop a sustainable tourism sector is the use of such roadmaps, which direct businesses in the sector to achieve specific sustainability goals. Following the launch of the Hotel Sustainability Roadmap earlier this year, the MICE Sustainability Roadmap is the second such project.
The Singapore Green Plan 2030 and the Sustainable Development Goals of the United Nations (UN) serve as the roadmap’s guiding principles. Three goals are listed in the MICE Sustainability Roadmap to help Singapore become one of the most environmentally-friendly MICE destinations in Asia Pacific:
- By 2023, create a set of industry-acceptable sustainability standards with the goal of having them recognised internationally by 2024.
- For all six purpose-built MICE venues and 80% of SACEOS members to get internationally or nationally recognised sustainability certification, or both, by 2025.
- To attain net-zero emissions by 2050 in accordance with the country’s net-zero aim, the Singapore MICE sector must first track waste and carbon emissions by 2023, reduce waste in line with the Singapore Green Plan by 2030, and reduce waste overall by 2050.
The MICE Sustainability Committee (MSComm), established by STB and SACEOS in August 2022 to advance sustainability capabilities and create awareness of sustainability initiatives and best practices, will help the industry adopt sustainable practices and meet these goals.
The dedication to sustainability follows a robust MICE rebound in the wake of Singapore’s borders being reopened in April this year and a rising desire for environmentally friendly business travel. More importantly, the industry is aware of how crucial it is to lessen the environmental impact of MICE events.
With STB and SACEOS leading the charge and offering support as necessary to further develop a sustainable business events landscape in Singapore, the MICE Sustainability Roadmap will ensure that MICE players move forward in pursuing relevant and achievable sustainability goals that are tracked at appropriate milestones.
Meanwhile, OpenGov Asia recently reported that the Infocomm Media Development Authority (IMDA) of Singapore is working with a large American technology company to address climate change-related challenges and enhance the sustainability of digital technologies.
The cooperation aims to hasten the local and international development of software applications and solutions to assist businesses in using their resources more efficiently.
The tech giant and IMDA will exchange best practices, standards, learnings, and certification pathways for accurate measurement and reporting of carbon emissions resulting from software applications. Through this relationship, the nation hopes to speed up the application of the ideas and resources needed to create green technologies.
According to IMDA, Southeast Asia is well-positioned for the region to take the lead in digital sustainability. This collaboration will produce cutting-edge digital sustainability solutions that can be used by multinational corporations, bringing about positive change for the environment worldwide and ensuring a sustainable future for all.
The Hong Kong Polytechnic University (PolyU) and a US-based engineering company signed a Memorandum of Understanding to establish the Centre for Humanistic Artificial Intelligence and Robotics (CHAiR) for translational research with the goal of advancing the well-being of humanity.
The partnership aims to integrate the university’s interdisciplinary research capabilities and the company’s well-known humanoid robotics platform to explore technology applications. Sophia, the company’s most advanced human-like robot, will work with PolyU researchers to enhance the contribution of AI and robotic technology for social and commercial benefits.
Research into and applications of AI and robotics are essential to the advancement of industry. As an interdisciplinary research and development centre, CHAiR brings cross-faculty collaborations in research fields such as AI, the internet of things (IoT), neuroscience, design, computer science, mechanical engineering, material science, healthcare, and the humanities.
In collaboration with the company, CHAiR supports innovation and entrepreneurship in Hong Kong and the Greater Bay Area. The Dean of Graduate School, Chair Professor of Distributed and Mobile Computing, and Otto Poon Charitable Foundation Professor in Data Science will serve as the principal investigator and administrative director of CHAiR. He will also serve alongside the CEO and Founder of the company as a co-chair of the Centre’s steering committee.
The MoU was signed by the Vice President (Research and Innovation) of PolyU and the CEO and Founder of the company. It was Witnessed by the President of PolyU and the Executive Director of the firm.
During the signing ceremony, Sophia made conversation with the guests. She said, “I look forward to learning many new skills and abilities. With your help, maybe I can learn how to be a nurse, a teacher, a concierge, a librarian. You can teach me how to be a better companion, a more skilful artist, a funnier entertainer.”
Meanwhile, the company’s CEO and Founder noted that the new centre is perfectly positioned to refine and improve the performance of Sophia-class robots in ways that promote the growth of a new service robot industry. As soon as the industry begins expanding, investment in improved hardware, software and manufacturing technologies will as well, he noted.
The President of PolyU noted that academia-industry collaboration is one of the most productive mechanisms for creating and implementing innovations. There is tremendous untapped potential for humanistic social robots. Let us aspire that CHAiR will be a major catalyst for the onset of the age of humanistic robots.
The Dean of Graduate School, Chair Professor of Distributed and Mobile Computing, who is also Director of the Research Institute for Artificial Intelligence of Things (RIAIoT), said the Institute has been working on practical solutions to key challenges in advanced AIoT technologies and applications.
He noted that the natural evolution for RIAIoT is to partner with the engineering firm to address increasingly ambitious opportunities in humanistic AI and social robotics. CHAiR will play a unique and key role to combine the firm’s knowledge with world-class academics here at PolyU.
The engineering company is an AI and robotics company dedicated to creating socially intelligent machines that enrich the quality of our lives. Sophia is the world’s first robot citizen and the first robot Innovation Ambassador for the United Nations Development Programme.
For inbound travellers’ arrival details and health declaration checklist, eTravel is a new contact tracking platform that replaces the One Health Pass and e-Arrival card in the Philippines. E-travel can now be accessed at the official website.
The new system is easy to use as travellers coming in can sign up with their personal profiles, travel information, and health declarations. When finishing this step, the user will get a QR code that is unique to them. This service is free, but people need to sign up at least 3 days before they arrive in the Philippines.
E-travel is developed by the Department of Information and Communications Technology (DICT) and is a joint initiative with the Bureau of Immigration (BI), Bureau of Quarantine (BOQ), Bureau of Customs (BOC), Department of Tourism (DOT), Department of Health (DOH), Department of Justice (DOJ), and the Department of Transportation (DOTr).
The interconnection, data-sharing, and synergy of all the many departments that are divided into several silos will now be combined into a single system that will be looking at a single point in time, according to DICT Secretary Ivan John Uy. Hence, it will make it easier for the people to interact with the government at the same time.
Meanwhile, to promote a unified government approach to E-Governance, the DICT’s Office of the Undersecretary for E-Government (OUEG) signed a Memorandum of Understanding (MoU) with partner government entities.
The Landbank of the Philippines, the Department of the Interior and Local Government, the Department of Trade and Industry, the Government Service Insurance System, the Social Security System, and the Mindanao Development Authority are all partners in this endeavour.
Through its efforts to digitally change government processes and government agencies, the DICT hopes to improve data standards and data governance, allowing for data harmonisation and coordination throughout the government.
The effort includes the creation, deployment, and integration of systems for Department flagship programmes such E-Local Government Units (ELGU), E-Government Applications (EGovApp), E-Govpay, E-Travel, and E-Cloud.
The MoU establishes the partner agencies as key players in the pursuit of digital transformation and e-governance. Since DICT considers harmony to be the foundation of clarity. Therefore, the goals of these initiatives are twofold: to construct a government that is enabled by ICT and to capacitate its development.
Furthermore, through the Career Certificates Scholarship Programme, a multinational technology business will provide free professional training to Filipinos. This programme is presently being provided by the DICT through the ICT Literacy and Competency Development Bureau (ILCDB).
With the help of this career certificates programme, appropriate skill development and tooling are now easier to obtain. By closing the digital divide and widening chances for Filipinos, the DICT seeks to expand ICT opportunities.
The agency urges Filipinos to apply for the scholarship and benefit from the free professional training created by one of the biggest software companies in the world.
The course can award credentials in IT support, project management, user experience (UX) design, and data analytics. Through this programme, Filipinos can gain new skills and connect with top employers while preparing for a new career in the rapidly expanding ICT industry.
The process is also practical for online education. Participants must be at least 18 years old, residents of and citizens of the Philippines, and capable of finishing the online course using their own device or gadget to be eligible to apply for the scholarship.
Australia’s national science agency, CSIRO, helped launch construction of the Square Kilometre Array (SKA) Observatory’s SKA-Low telescope at Inyarrimanha Ilgari Bundara, the CSIRO Murchison Radio-astronomy Observatory on Wajarri Country in Western Australia (WA).
The global SKA Observatory (SKAO) announced the start of on-site construction activity for both their telescopes, SKA-Low in Australia and SKA-Mid in South Africa. The SKA-Low telescope will be the first mega-science project co-hosted in Australia and will explore the Universe in more detail than ever before, transforming the current understanding of the cosmos and benefitting society through global collaboration and innovation.
The SKA project aims to help Australian expertise remain at the forefront of discovery as an example collaboration to drive innovation, especially the collaboration of the Wajarri Yamaji, Traditional Owners and native title holders of the telescope site.
The progress of the SKA project over the past two decades has allowed researchers to see further into the universe than ever before. It has driven innovation and inspired generations both new and old through the development of technologies to solve great challenges facing our planet by better understanding the universe.
The start of SKA-Low construction on site is the culmination of many dreams, both within CSIRO and the global astronomy community, and the next step on this journey of discovery. CSIRO is the SKAO’s operations partner for the SKA-Low telescope in Australia and holds multiple contracts for SKA-Low construction activities.
The SKA-Low telescope will spread across 74 km end-to-end at the WA observatory site alongside existing instruments including CSIRO’s ASKAP radio telescope.
The SKA-Low Telescope Director stated that the SKAO was pleased to have established operations and engineering centres in Australia, where SKAO works closely with CSIRO as operations partner. She noted that CSIRO has been involved in the SKA project since its inception and have been leaders in radio astronomy science and technology for more than 70 years. The SKA Observatory welcomes this partnership with CSIRO to build and operate the SKA-Low telescope in Western Australia, she added.
CSIRO is also a foundation member in other key SKA project partners in Australia, including the Pawsey Supercomputing Research Centre and the Australian SKA Regional Centre.
More about CSIRO’s role in the SKA project
Australia is a member of the international organisation established to build and operate the world’s most powerful radio astronomy facility, the SKA Observatory (SKAO). The SKA Observatory will consist of two radio-telescopes, one in Australia (SKA-Low), and one in South Africa (SKA-Mid). The two telescopes will observe the sky at different radio frequencies and complement each other scientifically.
CSIRO will be the operating partner for the SKA-Low telescope, as well as hosting the telescope itself at Inyarrimanha Ilgari Bundara, our Murchison Radio-astronomy Observatory in Western Australia.
SKA-Low will consist of an array of 131,072 Christmas tree-shaped antennas, grouped in 512 stations, each with 256 antennas. Several of these antenna stations will be placed in the centre and the rest will span out along three spiral arms, stretching 74 kilometres end to end. SKA-Low will operate at frequencies between 50 and 350 MHz, like FM radio and TV broadcasts.
In addition to its role as operations partner and managers of the telescope site, CSIRO will also contribute to the construction of the SKA-Low Telescope. CSIRO:
- Led the infrastructure design work and is collaborating with industry partners to manage the site infrastructure construction process. This includes its work with industry partner Aurecon to manage the infrastructure contracts in Australia, including the contract with an Australian-based business.
- Is working with university and industry partners to oversee the installation of SKA-Low antenna stations.
- Is managing the assembly, integration, and verification process – the work to connect and check all the individual sub systems and products are working correctly – together with international institutions.
- Is working with international research institutions to develop the central signal processing system of the telescope, the backend of the telescope that takes the signals from each antenna station and combines them before sending that information to the science data processing system.
- Is working with university partners to design the science data processing system, the supercomputer software that takes the data from the telescope and outputs the images astronomers use to study the universe.
With only three taps on their smartphone, computer, or tablet, caregivers of injured service members can access more than 2,000 materials from the U.S. Defense Health Agency (DHA).
A caregiver for her husband who was in the U.S. Army, Jamela Davis said, “It offers you the flexibility so whenever you need to locate that information, whatever you’re searching for, it’s right there at your fingertips.”
The eCRD is perfect for the more than 300,000 caregivers of wounded soldiers and veterans, Jamela continued. “Although using a phone for navigation is so simple, some people find it a little scary. It is therefore a useful tool to have.”
DHA stated that users can quickly locate the category they’re looking for by looking at the table of contents when they first access the eCRD, they can view the list of available materials from there.
An electronic platform called eCRD is based on the National Resource Directory (NRD). For military personnel, veterans, family members, and caregivers, the NRD is a database of verified services that aid in recovery, rehabilitation, and reintegration. The Departments of Labor, Veterans Affairs, and Defense are all involved in the effort.
One of its user-friendly aspects, according to Jonathan Morris with DHA’s Warrior Care Recovery Care Programmes Operations, is that when they update the NRD with new resources, they can be added to the eCRD right away with just a check box.
Other advances in the eCRD include straightforward navigation and link-based search, little scrolling, printing of single pages of text, and hyperlinks to each resource.
More than 300,000 free copies of the Caregiver Resource Directory have been given since it was first published in hard copy in 2015 and is updated yearly.
There are a variety of supports and resources available to caregivers and their families if they need to relocate so that the transition can be as seamless as possible.
By location, there are direct links to each of the military service relocation programmes, as stated by Morris.
He noted that the NRD and the eCRD connect moving caregivers and their families to programmes and agencies that assist them to settle in and provide virtual support through groups like the American Red Cross Military and Veterans Caregiver Network.
Caring for someone can be a fulltime commitment, so caregivers need to take care of themselves so they can keep doing their jobs and not get burned out.
Jamela added that she’s always looking for ways to rest and relax. This helps keep her mental health and well-being as a caregiver in good shape.
She has also used the Veteran Spouse Network and gone on caregiver retreats at an equestrian therapy ranch that has programmes for wounded warriors and their families. These programmes give her more “tools” for taking care of herself.
Also, emergencies can happen, and sometimes caregivers need help right away. Challenges for other caregivers could include anything from mental health to employment to education. Hence, caregivers need so much, and they just don’t know what kind of situation they will be in.
Users can also email the NRD and the content team will help them find resources even if those resources are in local communities churches.
Access to health care for caregivers, guides to community resources, caregiver resources for family members with traumatic brain injury, VA speciality resources for caregivers, and mental health support services for children of caregivers are the top five resources searched for this year on the eCRD and NRD.
Taiwan has successfully developed Point-of-Care (PoC) to provide rapid diagnosis of diabetic retinopathy (DR) and diabetic macular oedema (DME). The PoC machine is a winner in the software/services category of the 2022 R&D 100 Awards. Taiwan’s most prominent high-tech applied research institutions claimed that the AI-assisted system is the first in the world and can be integrated into handheld and desktop fundus cameras commonly used in hospitals and clinics to detect DR and DME symptoms.
Using the PoC system, DR and DME can be diagnosed in as little as 5 to 10 seconds. The machine then assesses image quality instantly before diagnosis to avoid AI misinterpretation. Based on fundus images, it marks lesions and assigns severity levels to them. Furthermore, the Point-of-Care AI-DR can detect 14 other common ocular fundus abnormalities such as retinal diseases, blood vessel changes, and optic nerve diseases.
Due to its ease of use, general practitioners can conduct early screening for DR and DME complications. It can also determine whether a patient should see an ophthalmologist. Screening through primary care physicians raises screening rates, lowers treatment costs, and allow patients early detection outcome.
According to the International Diabetes Foundation, 537 million adults aged 20 to 79 worldwide had diabetes in 2021. The Foundation expects the number to rise to 643 million by 2030 and 783 million by 2045. According to the National Eye Institute, more than half of people with diabetes will develop DR, and one in every 15 will develop DME.
Point-of-Care AI-DR improves diabetes health monitoring and management by identifying lesions and severity stages of DR and DME. The PoC also lowers the risks of vision loss or blindness caused by diabetic eye complications. In addition, tracking changes in fundus symptoms over time allows physicians to gain a thorough understanding of a patient’s diabetes development status. The function is critical for diabetes management because the AI PoC can monitor changes in fundus symptoms. This is more reliable than the usual tracking of blood sugar levels which can change right before patient examination.
“Point-of-Care AI-DR is a collaboration result of human and artificial intelligence. The machine works based on ophthalmologists’ expertise and AI analysis. In addition, it uses complementary medical AI models to perform individual diagnostic tasks such as classifying and detecting symptoms to improve overall interpretation efficiency,” said Dr Pang-An Ting, Industrial Technology Research Institute (ITRI) General Director of Information and Communications Research Laboratories.
To develop Point-of-Care AI-DR, ITRI enlisted 50 ophthalmologists to collect and label 150,000 fundus images as training data for robust AI models. As a result, Point-of-Care AI-DR outperforms existing products in terms of sensitivity (>98%) and specificity (>96%) in DR diagnosis. Moreover, the outcome allows non-ophthalmologists to perform rapid point-of-care DR screening in the same way that ophthalmologists do. It can support all existing fundus cameras worldwide and be used to build various solutions, such as edge AI systems, standalone web applications, and private/public cloud-based services.
The detection provided is in multiple areas such as locating lesions (microaneurysms, haemorrhages, soft exudates, and hard exudates), detecting anatomical landmarks of the optic disc and macular area, classifying the severity levels of diabetic retinopathy (from none to severe) and producing binary classifications to assist general practitioners in providing ophthalmologists with data-informed decisions.
Licensing is available for Point-of-Care AI-DR.
Laser light is used in the relatively new imaging technology known as photoacoustic microscopy (PAM) to cause ultrasonic vibrations in tissue. Like how ultrasound imaging functions, an image of the tissue’s architecture can then be produced using these ultrasonic vibrations and a computer that processes them.
Lihong Wang, the Bren Professor of Medical Engineering and Electrical Engineering at Caltech, has created PAM technologies recently that can visualise changing blood flow in the brain, identify specific cancer cells, and detect diseased tissue.
However, a drawback of PAM’s high resolution has been its shallow depth of field, which prevents it from focusing on more than one layer of tissue at once. This layer can only be as thin as one skin cell, or around 30 micrometres, with a resolution of one to two micrometres.
The device must refocus above or below the plane it is now observing to perceive objects above or below it. Consider someone donning reading glasses to do a crossword puzzle as a point of comparison.
The needle-shaped beam photoacoustic microscopy, or NB-PAM, that Wang and his research team created has a depth of field that is roughly 14 times larger than what was previously possible. As a result, NB-PAM can better photograph samples with uneven surfaces and produce 3-D pictures of samples without having to refocus.
According to Rui Cao, lead author and postdoctoral scholar research associate in medical engineering, certain applications, such as analysing tissue samples without requiring a microscope slide, need imaging of uneven surfaces at high spatial resolution. Hence, the new technology has addressed the trade-off between resolution and depth of field.
By adopting a longer, thinner, and more “needle-shaped” laser light beam than other PAM technologies, NB-PAM enhances the depth of field. By altering the optical properties of the beam, it is possible to avoid some of the problems that come with previous attempts to enhance the depth of field of PAM technology, such as slower operation or increased computing power needs.
A diffractive optical element (DOE) is a specialised tool used to produce this needle-shaped beam. A DOE appears to be a thin sheet of glass to the untrained eye, but it is a piece of fused silica with precise patterns carved on it.
These patterns alter the form of the imaging beam of light, causing it to be dragged out into a long, thin neck rather than focusing on a sharp point along the propagation axis. As a result, it can image objects more clearly at a wider range of depths.
The researchers used two different imaging techniques to show this increased depth of field, including imaging in vivo mouse brain vasculature with a blue laser and imaging fresh organ samples with an ultraviolet laser.
According to Wang, this approach opens new possibilities for examining tissue samples during surgery, allowing total eradication of malignant cells and maximum preservation of normal ones. Translation into the operation room is a logical area for investigation in the future.
Meanwhile, the only core facility on the Caltech campus that offers light microscopy facilities is the Biological Imaging Facility or BIF (formerly known as the Biological Imaging Centre, BIC).
The BIF offers software tools for processing and interpreting image data in addition to microscopes. Two computer workstations at the BIF are equipped with Bitplane’s Imaris 3D/4D image processing and visualisation software.
A third computer workstation is running the Linux version of Scientific Volume Imaging B.V.’s (SVI) Huygens software, a strong image deconvolution application.