The business of Experian, a global leader
in credit reporting and marketing services with annual revenues exceeding US$4.3
billion (for 2017), is all about data.
Experian has four main business units:
Credit Information Services, Decision Analytics, Business Information Services,
and Marketing Services. Experian Marketing Services (EMS) helps marketers
connect with customers through relevant communications across a variety of
channels, driven by advanced analytics on an extensive database of geographic,
demographic, and lifestyle data. EMS has built its business on the effective
collection, analysis, and use of data.
The company has always handled large
amounts of data, billions and quadrillions of records, on who consumers are,
how they’re connected, how they interact. With today’s proliferation of digital
channels and information of social media likes, web interactions and email
responses, older systems no longer have the capacity to deal with the data
In the past, there was no requirement to
provide data in real-time. Experian sent customer database updates to clients
once a month for campaign adjustments, allowing Experian to process large
volumes of data through a number of diverse platforms, which were mostly mainframe
That’s changing. Today’s consumers leave a
digital trail of behaviors and preferences for marketers to leverage so they
can enhance the customer experience. Experian’s clients, which includes many of
the top retail companies in the world, are asking for more frequent updates on
consumers’ latest purchasing behaviors, online browsing patterns and social
media activity so they can respond in real time. They are increasingly looking
for a single, integrated view of their customer.
infrastructure for real-time reporting
Meeting the need for immediacy of
information and customisation of data in real time for clients, would require a
technological infrastructure that can accommodate rapid processing, large-scale
storage, and flexible analysis of multi-structured data. Experian’s mainframes
were hitting their limits in terms of performance, flexibility and scalability.
EMS set an internal goal to process more
than 100 million records of data per hour, translating to 28,000 records per
The team decided to look for new
architectures that could handle the new volumes of data. About 30 criteria were
identified for the new platform, ranging from depth and breadth of offering to
support capabilities to price to unique distribution features. Two criteria
were prioritized: Both batch and real-time data processing capabilities; and scalability
to accommodate large and growing data volumes.
The North America Experian Marketing
Services group led the evaluation of NoSQL technologies within Experian. Hadoop
and HBase quickly surfaced as a natural fit for Experian’s needs. EMS engineers
downloaded raw Apache Hadoop.
They saw certain gaps that could be filled
by a commercial distribution. EMS evaluated several distributions and selected
Cloudera to meet EMS’ enterprise-level Hadoop needs, such as meeting client
SLAs (service level agreements) and having 24×7 reliability.
Experian invested in Cloudera Enterprise,
which is comprised of three things: Cloudera’s open source Hadoop stack (CDH),
a management toolkit (Cloudera Manager), and expert technical support.
A production version of Experian’s
Cross-Channel Identity Resolution (CCIR) engine was launched. CCIR is a linkage
engine that is used to keep a persistent repository of client touch points.
CCIR runs on HBase,
a high-performance, distributed data store that integrates with Cloudera's
platform to deliver a secure and easy-to-manage NoSQL database.
EMS’ HBase system spanned five billion rows
of data, as of 2017, and the number is expected to grow tenfold in the near
future. HBase offers a shared architecture that is distributed, fault tolerant,
and optimised for storage. In addition, HBase enables both batch and real-time
Experian feeds data into the CDH-powered
CCIR engine using custom extract, transform, load (ETL) scripts from in-house
mainframes and relational databases including IBM DB2, Oracle, SQL Server, and
performance accelerated by 50x
The new platform is delivering operational
efficiency to Experian by accelerating processing performance by 50x, at a
fraction of the cost of the legacy environment. The new system can process 100
million records per hour compared to 50 million matches per day earlier.
Cloudera Enterprise allows Experian to get
maximum operational efficiency out of their Hadoop clusters. Due to a wide
variation in use cases for customers, the team had to do a lot of tweaking on
the platform to get the performance we need. Cloudera Enterprise provides the
ability to store these store different configuration settings and version those
McCullough added, “Not only has Cloudera
Manager simplified our process, but it’s made it possible at all. Without a
Linux background, I would not have been able to deploy Hadoop across a cluster
and configure it and have anything up and running in nearly the timeframe that
Furthermore, Cloudera Manager enabled the
deployment and configuration of Hadoop across a cluster in the timeframe
Experian had. Cloudera Manager monitors services running on cluster and reports
when servers are unhealthy, services have stopped, and/or nodes are bad. It automates
distribution across the cluster, monitors CPU usage across various applications
and data storage availability and provides a single portal to see into all
The deployment allowed Experian to process
orders of magnitude more information through its systems. Experian’s platform is
the first data management platform of its kind that accepts data, links
information together across an entire marketing ecosystem, and puts it into a
usable format for an enhanced customer experience. These data processing capabilities
combined with Experian’s expertise in bringing together data assets provided
new insights into tomorrow’s marketing environments.
In January 2017, it was announced
that Experian was integrating Cloudera Enterprise onto
its cloud environment for its Credit Information Services, Decision Analytics
and Business Information Services business lines, with the aim of improved credit data processing speeds for
clients. Thus, Cloudera continues to transform the way Experian provides
consumer and business credit data to its clients.
The Singapore Tourism Board (STB) and Singapore Association of Convention & Exhibition Organisers & Suppliers (SACEOS) released the MICE Sustainability Roadmap, which outlines specific goals and plans for raising sustainability standards throughout the MICE sector in Singapore over the coming years.
The Meetings, Incentives, Conventions, and Exhibitions (MICE) industry is a type of tourism travel in which groups of people are brought together for a specific reason, usually well in advance. On the other hand, the MICE market refers to a subset of people who plan, arrange, and facilitate conferences, seminars, exhibitions, and other events.
Part of STB’s overarching plan to develop a sustainable tourism sector is the use of such roadmaps, which direct businesses in the sector to achieve specific sustainability goals. Following the launch of the Hotel Sustainability Roadmap earlier this year, the MICE Sustainability Roadmap is the second such project.
The Singapore Green Plan 2030 and the Sustainable Development Goals of the United Nations (UN) serve as the roadmap’s guiding principles. Three goals are listed in the MICE Sustainability Roadmap to help Singapore become one of the most environmentally-friendly MICE destinations in Asia Pacific:
- By 2023, create a set of industry-acceptable sustainability standards with the goal of having them recognised internationally by 2024.
- For all six purpose-built MICE venues and 80% of SACEOS members to get internationally or nationally recognised sustainability certification, or both, by 2025.
- To attain net-zero emissions by 2050 in accordance with the country’s net-zero aim, the Singapore MICE sector must first track waste and carbon emissions by 2023, reduce waste in line with the Singapore Green Plan by 2030, and reduce waste overall by 2050.
The MICE Sustainability Committee (MSComm), established by STB and SACEOS in August 2022 to advance sustainability capabilities and create awareness of sustainability initiatives and best practices, will help the industry adopt sustainable practices and meet these goals.
The dedication to sustainability follows a robust MICE rebound in the wake of Singapore’s borders being reopened in April this year and a rising desire for environmentally friendly business travel. More importantly, the industry is aware of how crucial it is to lessen the environmental impact of MICE events.
With STB and SACEOS leading the charge and offering support as necessary to further develop a sustainable business events landscape in Singapore, the MICE Sustainability Roadmap will ensure that MICE players move forward in pursuing relevant and achievable sustainability goals that are tracked at appropriate milestones.
Meanwhile, OpenGov Asia recently reported that the Infocomm Media Development Authority (IMDA) of Singapore is working with a large American technology company to address climate change-related challenges and enhance the sustainability of digital technologies.
The cooperation aims to hasten the local and international development of software applications and solutions to assist businesses in using their resources more efficiently.
The tech giant and IMDA will exchange best practices, standards, learnings, and certification pathways for accurate measurement and reporting of carbon emissions resulting from software applications. Through this relationship, the nation hopes to speed up the application of the ideas and resources needed to create green technologies.
According to IMDA, Southeast Asia is well-positioned for the region to take the lead in digital sustainability. This collaboration will produce cutting-edge digital sustainability solutions that can be used by multinational corporations, bringing about positive change for the environment worldwide and ensuring a sustainable future for all.
The Hong Kong Polytechnic University (PolyU) and a US-based engineering company signed a Memorandum of Understanding to establish the Centre for Humanistic Artificial Intelligence and Robotics (CHAiR) for translational research with the goal of advancing the well-being of humanity.
The partnership aims to integrate the university’s interdisciplinary research capabilities and the company’s well-known humanoid robotics platform to explore technology applications. Sophia, the company’s most advanced human-like robot, will work with PolyU researchers to enhance the contribution of AI and robotic technology for social and commercial benefits.
Research into and applications of AI and robotics are essential to the advancement of industry. As an interdisciplinary research and development centre, CHAiR brings cross-faculty collaborations in research fields such as AI, the internet of things (IoT), neuroscience, design, computer science, mechanical engineering, material science, healthcare, and the humanities.
In collaboration with the company, CHAiR supports innovation and entrepreneurship in Hong Kong and the Greater Bay Area. The Dean of Graduate School, Chair Professor of Distributed and Mobile Computing, and Otto Poon Charitable Foundation Professor in Data Science will serve as the principal investigator and administrative director of CHAiR. He will also serve alongside the CEO and Founder of the company as a co-chair of the Centre’s steering committee.
The MoU was signed by the Vice President (Research and Innovation) of PolyU and the CEO and Founder of the company. It was Witnessed by the President of PolyU and the Executive Director of the firm.
During the signing ceremony, Sophia made conversation with the guests. She said, “I look forward to learning many new skills and abilities. With your help, maybe I can learn how to be a nurse, a teacher, a concierge, a librarian. You can teach me how to be a better companion, a more skilful artist, a funnier entertainer.”
Meanwhile, the company’s CEO and Founder noted that the new centre is perfectly positioned to refine and improve the performance of Sophia-class robots in ways that promote the growth of a new service robot industry. As soon as the industry begins expanding, investment in improved hardware, software and manufacturing technologies will as well, he noted.
The President of PolyU noted that academia-industry collaboration is one of the most productive mechanisms for creating and implementing innovations. There is tremendous untapped potential for humanistic social robots. Let us aspire that CHAiR will be a major catalyst for the onset of the age of humanistic robots.
The Dean of Graduate School, Chair Professor of Distributed and Mobile Computing, who is also Director of the Research Institute for Artificial Intelligence of Things (RIAIoT), said the Institute has been working on practical solutions to key challenges in advanced AIoT technologies and applications.
He noted that the natural evolution for RIAIoT is to partner with the engineering firm to address increasingly ambitious opportunities in humanistic AI and social robotics. CHAiR will play a unique and key role to combine the firm’s knowledge with world-class academics here at PolyU.
The engineering company is an AI and robotics company dedicated to creating socially intelligent machines that enrich the quality of our lives. Sophia is the world’s first robot citizen and the first robot Innovation Ambassador for the United Nations Development Programme.
Australia’s national science agency, CSIRO, helped launch construction of the Square Kilometre Array (SKA) Observatory’s SKA-Low telescope at Inyarrimanha Ilgari Bundara, the CSIRO Murchison Radio-astronomy Observatory on Wajarri Country in Western Australia (WA).
The global SKA Observatory (SKAO) announced the start of on-site construction activity for both their telescopes, SKA-Low in Australia and SKA-Mid in South Africa. The SKA-Low telescope will be the first mega-science project co-hosted in Australia and will explore the Universe in more detail than ever before, transforming the current understanding of the cosmos and benefitting society through global collaboration and innovation.
The SKA project aims to help Australian expertise remain at the forefront of discovery as an example collaboration to drive innovation, especially the collaboration of the Wajarri Yamaji, Traditional Owners and native title holders of the telescope site.
The progress of the SKA project over the past two decades has allowed researchers to see further into the universe than ever before. It has driven innovation and inspired generations both new and old through the development of technologies to solve great challenges facing our planet by better understanding the universe.
The start of SKA-Low construction on site is the culmination of many dreams, both within CSIRO and the global astronomy community, and the next step on this journey of discovery. CSIRO is the SKAO’s operations partner for the SKA-Low telescope in Australia and holds multiple contracts for SKA-Low construction activities.
The SKA-Low telescope will spread across 74 km end-to-end at the WA observatory site alongside existing instruments including CSIRO’s ASKAP radio telescope.
The SKA-Low Telescope Director stated that the SKAO was pleased to have established operations and engineering centres in Australia, where SKAO works closely with CSIRO as operations partner. She noted that CSIRO has been involved in the SKA project since its inception and have been leaders in radio astronomy science and technology for more than 70 years. The SKA Observatory welcomes this partnership with CSIRO to build and operate the SKA-Low telescope in Western Australia, she added.
CSIRO is also a foundation member in other key SKA project partners in Australia, including the Pawsey Supercomputing Research Centre and the Australian SKA Regional Centre.
More about CSIRO’s role in the SKA project
Australia is a member of the international organisation established to build and operate the world’s most powerful radio astronomy facility, the SKA Observatory (SKAO). The SKA Observatory will consist of two radio-telescopes, one in Australia (SKA-Low), and one in South Africa (SKA-Mid). The two telescopes will observe the sky at different radio frequencies and complement each other scientifically.
CSIRO will be the operating partner for the SKA-Low telescope, as well as hosting the telescope itself at Inyarrimanha Ilgari Bundara, our Murchison Radio-astronomy Observatory in Western Australia.
SKA-Low will consist of an array of 131,072 Christmas tree-shaped antennas, grouped in 512 stations, each with 256 antennas. Several of these antenna stations will be placed in the centre and the rest will span out along three spiral arms, stretching 74 kilometres end to end. SKA-Low will operate at frequencies between 50 and 350 MHz, like FM radio and TV broadcasts.
In addition to its role as operations partner and managers of the telescope site, CSIRO will also contribute to the construction of the SKA-Low Telescope. CSIRO:
- Led the infrastructure design work and is collaborating with industry partners to manage the site infrastructure construction process. This includes its work with industry partner Aurecon to manage the infrastructure contracts in Australia, including the contract with an Australian-based business.
- Is working with university and industry partners to oversee the installation of SKA-Low antenna stations.
- Is managing the assembly, integration, and verification process – the work to connect and check all the individual sub systems and products are working correctly – together with international institutions.
- Is working with international research institutions to develop the central signal processing system of the telescope, the backend of the telescope that takes the signals from each antenna station and combines them before sending that information to the science data processing system.
- Is working with university partners to design the science data processing system, the supercomputer software that takes the data from the telescope and outputs the images astronomers use to study the universe.
The Singapore University of Technology and Design (SUTD) and Tecnológico de Monterrey (Tec) through its Institute for the Future of Education, signed a research collaboration agreement to improve the cyber-physical learning of students and teachers in Singapore and Mexico.
The three-year agreement will see the two parties share practices and experiences in the configuration and usage of cyber-physical learning infrastructure to create new opportunities for educational innovation and research, resulting in new pathways for the future of education.
The SUTD-Tec’s Institute for the Future of Education agreement will foster the exchange and sharing of practices of cyber-physical learning and evaluation of the effectiveness of associated educational delivery models. Both parties will conduct joint experiments involving students and instructors to explore domains such as technology-enabled learning, translational pedagogical innovations, learning analytics, and personalised and engaging learning.
This research collaboration will have its focus on the SUTD campusX initiative, which focuses on the needs and experiences of students and instructors using data analytics and learning sciences with the purpose of creating a safe, inclusive, and enjoyable space for students to learn, interact and optimise their learning outcomes.
With regards to the campusX and its impact on the future of education, SUTD’s Provost stated that both Tec and SUTD share a common vision of cyber-physical learning, with similar interests and understanding of the challenges in areas of applying human-centric technology and design to the practice of pedagogy and andragogy in actual higher learning environments. This forms a strong basis on which many more projects can be conducted between Tec and SUTD. The current research collaboration is an important start and SUTD looks forward to furthering the partnership with Tec in years to come.
He noted that, similarly, SUTD also looks forward to working with more like-minded partners across academia and industry and from local and global landscapes to make cyber-physical learning a reality.
Speaking about the research collaboration between the two renowned higher education institutions, the Rector for Higher Education of Tecnológico de Monterrey expressed his satisfaction with the signing of the agreement and said that to advance in current-day education challenges and design the future of education, collaboration is key.
He noted that Tec has pioneered educational innovation in Mexico and Latin America, and they aim to expand their projects and initiatives to have an increasingly global relationship and impact. An initiative aimed at strengthening links with Asia is being developed; these collaborations with them will extend to the areas of research, education, and technology.
Furthermore, the Executive Director of the Institute for the Future of Education of Tecnológico de Monterrey emphasised the importance of this kind of agreement between both universities. He noted that conducting joint experiments to evaluate innovative cross-border educational models will be key to developing effective cyber-physical learning environments.
The collaborative project with SUTD’s campusX initiative will increase learning opportunities for global higher education audiences, capitalising on the intercultural exchanges between Singaporean and Mexican students and professors, and developing best practices with an international perspective, he added.
The research activities framed in this agreement are slated to begin in the first quarter of 2023 and the experimental and simulated learning environment trials will result in the identification of best practices in digital education delivery models supported by effective cyber-physical technology platforms.
The Indian Institute of Technology, Madras (IIT-Madras) has launched an online masters in technology (MTech) course for working professionals, allowing candidates to pursue the educational qualification while working. According to a statement, the tailor-made online programme for qualified engineers is gaining popularity and over 600 working professionals have already enrolled for the three-year course.
The MTech degree includes programmes on communications, VLSI and analog circuits, microelectronics, multimedia signal processing, software security, automotive engineering, mechanical design, interdisciplinary programmes in quantum technology, and data sciences.
IIT-Madras is the first IIT to offer an MTech course in a distance learning mode through its Centre for Continuing Education. “The students of this programme have the same rights and privileges as regular students. The working professionals can carry out the project work at their workplaces. They do not need any residency as compared to sponsored candidates,” a representative from the IIT-Madras said. From only 14 candidates in 2020, the number has shot up to 605 this year.
IIT-Madras faculty, teachers from other premier academic institutions, and eminent industry professionals will be conducting the classes. Apart from online classes, which are held in the evening, students will also have live interaction with their faculty members. Students will give exams in the same city as their offices. In terms of the evaluation method, a problem statement will be evaluated and approved by IIT-Madras faculty. A mentor will guide the student at their workplace. The student’s progress will be jointly evaluated by faculty from IIT-Madras and the mentor. The faculty member will approve the problem statement and review the progress.
In September, IIT-Madras launched an industry-oriented Online Certificate Programme on e-mobility for working professionals. Four out of the nine modules in the programme are delivered by industry professionals. The programme was conceived with inputs from industry experts and would be continuously upgraded based on technology trends, market trends, and industry needs, the Institute noted.
The course is offered through IIT-Madras’ Centre for Outreach and Digital Education (CODE). It provides an overview of the e-mobility ecosystem and fundamentals in technical areas like vehicle development, power electronics, battery engineering, thermal management, power trains, and EMI/ EMC, among others. The programme contains 120 hours of video classes and 40 hours of online contact classes with the faculty. The candidates need to complete regular assignments and a final evaluation, after which they will receive a certificate. The first cohort started at the beginning of October.
In November, the Institute partnered with United States-based Purdue University to jointly develop a dual-degree programme in semiconductors. As OpenGov Asia reported, the programme focuses on an innovative, cooperatively developed curriculum to meet the growing needs of the industry. Undergraduate students with strong academic credentials and a deep interest in semiconductor devices, chip fabrication, and circuits and systems will be considered. The programme will enable a quick ramp-up of skilled talent, preparing the next generation of the semiconductor workforce. The partnership would also entail research collaboration in semiconductor supply-chain management, chip design, packaging, system architecture, and advanced manufacturing methods
Australia’s national science agency, CSIRO, recently revealed details of an AU$15 million project to develop a national soil information system, aimed at improving the sustainable management of one of the nation’s most precious assets.
Supporting the National Soil Strategy, and funded by the Australian Government’s Department of Agriculture, Fisheries and Forestry, the Australian National Soil Information System (ANSIS) project is a collaboration between the government, research organisations, industry, the private sector and the community.
Using innovative processes and technologies, ANSIS will allow improved sharing of nationally consistent soil data and information through online access for users. This will help Australians to better understand their nation’s diverse range of soils and make better decisions about managing our important soil resources. Currently, soil data is collected using different methods, by different organisations, and at a range of depths in the soil. This makes it hard to access, compare and use data from diverse sources.
The Project Lead at CSIRO stated that improving access to the best soil data and information can help promote digital agriculture innovation and is key to sustainably managing Australia’s soils. By using ANSIS, farmers and agricultural advisors will have access to more soil data and be better placed to more sustainably manage the soil on which they rely.
Soil is vital to agricultural production and natural environments, as well as health and well-being. This information system will help everyone care for this important natural resource. Productive, healthy, and resilient soil means more economic, environmental, and social benefits to Australia. Monitoring soil also helps scientific understanding of how the natural world is changing.
This work will provide insight into biodiversity, water resources, landscapes and coastlines, fauna, climate, and geology. By harmonising Australia’s soil data, we can make it accessible across many fields of science and exploration. The project is being delivered under the Federal Government’s National Soil Strategy, which is about prioritising soil health, empowering soil innovation and stewards, and strengthening soil knowledge and capability. The new ANSIS system will be available for use in 2023.
ANSIS will provide improved access to nationally consistent soil data and information needed to help sustainably manage Australian soil. ANSIS will provide:
- More soil data
- More data sets are available that in other soil systems
- Enables more certainty in products developed
- Opportunity to develop new products
- Improved access
- Multiple data sets are now discoverable and accessible
- National coverage
- Most up-to-date data available
- Efficient provision
- Organised and standardised data for immediate use
- Can feed into many users’ requirements
- Consistent delivery
- Substantial reduction in time to prepare information products
- Trusted location
- Certainty that data is from an authoritative source, verified and satisfies standards.
The country has established the Indonesian Aviation Sector Computer Security Incident Response Team (IAS-CSIRT) to strengthen cybersecurity. The team will report to the Ministry of Transportation’s Director General of Air Transportation.
To anticipate system vulnerabilities, identify opportunities for bad actors to exploit, and reduce the risk of cyber incident threats, the aviation sector required a dedicated cybersecurity team. The CSIRT will regularly publish information on vulnerabilities, security, and new technology trends. The team is also prepared to face various escalating challenges. Members of the CSIRT will be trained through cyber drills and workshops.
The team is in charge of receiving, reviewing, and responding to cyber incident reports and activities with the function of providing reactive services by performing incident coordination, incident triage, and incident resolution.
During the IAS-CSIRT inaugural speech, the Deputy for Cybersecurity and Economic Cryptography of the National Cyber and Crypto Agency (BSSN), Markos, said that the aviation industry increasingly relies on digital technology for flight operations, ground services, communications navigation and surveillance, airport infrastructure, air traffic management, and supply chain.
Therefore, cybercrime prevention and management are crucial for many parties, including aviation service providers. F. Budi Prayitno, the Director of Aviation Security at the Ministry of Transportation, outlined the importance of cyber defence since cybercrime has resulted in considerable losses across sectors. “Effective cyber-crime prevention and management necessitate the collaboration of various cyber security stakeholders who already have a CSIRT,” said Budi. The BSSN contributed to the formation of the IAS-CSIRT.
Markos hopes that the IAS-CSIRT will be able to collaborate, synergise, and share information with various stakeholders and other cybersecurity constituencies in Indonesia, particularly in the handling and recovery of cyber incidents.
BSSN wants other sectors to form a CSIRT as well. The IAS-CSIRT was established for the first time (IIV) following the issuance of Presidential Regulation 82 of 2022 concerning the Protection of Vital Information Infrastructure. Sector IIV prioritises the CSIRT because it manages various strategic information assets related to community survival, national stability, and sovereignty.
Before the inauguration, BSSN signed a memorandum of understanding (MoU) and cooperation agreement with state-owned Aviasi Wisata Indonesia (InJourney Group) to support the tourism industry. In addition, cooperation on information protection and electronic transactions intends to improve the quality of information protection and electronic commerce.
The agreement’s scope includes information and communication technology security, the use of electronic certificates to improve electronic transaction security, the improvement and development of human resources, the exchange of information, and cybersecurity campaigns and literacy.
At the signing ceremony, the Head of the National Cyber and Crypto Agency (BSSN), Hinsa Siburian, emphasised the importance of synergy and collaboration to recover the Indonesian aviation and tourism industry through a reliable and safe digital transformation.
Furthermore, between January and November 2022, BSSN detected over 1.14 million traffic anomalies across all InJourney Group assets. BSSN said the most anomalies were discovered in August, with 235,742 events.
The collaboration is expected to make digital information transactions and exchanges more secure and leak-proof. The rapid advancement of digital technology presents an opportunity for Injourney to gain trust and confidence in the Indonesian tourism industry. However, as a result, it must be balanced with maximum data, information, and electronic transaction security.