We are creating some awesome events for you. Kindly bear with us.

MIT Researchers Utilise Data to Predict the Future

Whether predicting tomorrow’s weather, forecasting future stock prices, identifying missed retail sales opportunities, or estimating a patient’s risk of acquiring an illness, time-series data, which are a collection of observations recorded over time, will almost certainly be required. Making predictions with time-series data usually necessitates numerous data-processing steps and the use of advanced machine-learning techniques, which have a steep learning curve and are not easily accessible to non-experts.

MIT researchers built a system that directly combines prediction functionality on top of an existing time-series database to make these powerful tools more user-friendly. Their simplified interface, dubbed tspDB (time series predict database), handles all of the intricate modelling behind the scenes, allowing even non-experts to quickly create a forecast.

When it comes to two tasks, the new system outperforms state-of-the-art deep learning algorithms in terms of accuracy and efficiency: forecasting future values and filling in missing data points. One of the reasons tspDB is so successful is that it incorporates a novel time-series-prediction algorithm. This technique is particularly good at making predictions on multivariate time-series data, which includes multiple time-dependent variables. Temperature, dew point, and cloud cover, for example, all depend on previous values in a weather database.

The algorithm also calculates the volatility of a multivariate time series in order to provide the user a level of confidence in its forecasts. This technique can efficiently capture any time-series structure out there, even as the time-series data becomes more and more complex. The researchers have discovered the appropriate lens through which to examine the model complexity of time-series data.

For a single time series, the algorithm converted it to a matrix and used matrix estimation procedures. The main intellectual problem was figuring out how to make it work with several time series. After a few years of difficulty, the researchers discovered the solution: stack the matrices for each separate time series, consider it as a single large matrix, and apply the single time-series algorithm to it.

This naturally uses data from many time series — both inside each time series and across time, as they detail in their new paper. This recent publication also covers fascinating alternatives, such as seeing the multivariate time series as a three-dimensional tensor instead of translating it into a large matrix. A tensor is a multi-dimensional array of integers, sometimes known as a grid. This forged a promising link between the traditional area of time series analysis and the rapidly emerging subject of tensor estimation.

On real-world time-series datasets with inputs collected from the electrical grid, traffic patterns, and financial markets, they compared the updated mSSA against other state-of-the-art algorithms, including deep-learning methods.

On imputation, their program outperformed all but one of the other algorithms, and when it came to forecasting future values, it outperformed all but one of the other algorithms. The researchers also showed that their modified version of mSSA may be used to analyse any type of time-series data.

As reported by OpenGov Asia, MIT researchers have found that machine-learning models that are popular for image recognition tasks actually encode bias when trained on unbalanced data. This bias within the model is impossible to fix later on, even with state-of-the-art fairness-boosting techniques, and even when retraining the model with a balanced dataset.

So, the researchers came up with a technique to introduce fairness directly into the model’s internal representation itself. This enables the model to produce fair outputs even if it is trained on unfair data, which is especially important because there are very few well-balanced datasets for machine learning. The solution they developed not only leads to models that make more balanced predictions but also improve their performance on downstream tasks like facial recognition and animal species classification.

PARTNER

Qlik’s vision is a data-literate world, where everyone can use data and analytics to improve decision-making and solve their most challenging problems. A private company, Qlik offers real-time data integration and analytics solutions, powered by Qlik Cloud, to close the gaps between data, insights and action. By transforming data into Active Intelligence, businesses can drive better decisions, improve revenue and profitability, and optimize customer relationships. Qlik serves more than 38,000 active customers in over 100 countries.

PARTNER

CTC Global Singapore, a premier end-to-end IT solutions provider, is a fully owned subsidiary of ITOCHU Techno-Solutions Corporation (CTC) and ITOCHU Corporation.

Since 1972, CTC has established itself as one of the country’s top IT solutions providers. With 50 years of experience, headed by an experienced management team and staffed by over 200 qualified IT professionals, we support organizations with integrated IT solutions expertise in Autonomous IT, Cyber Security, Digital Transformation, Enterprise Cloud Infrastructure, Workplace Modernization and Professional Services.

Well-known for our strengths in system integration and consultation, CTC Global proves to be the preferred IT outsourcing destination for organizations all over Singapore today.

PARTNER

Planview has one mission: to build the future of connected work. Our solutions enable organizations to connect the business from ideas to impact, empowering companies to accelerate the achievement of what matters most. Planview’s full spectrum of Portfolio Management and Work Management solutions creates an organizational focus on the strategic outcomes that matter and empowers teams to deliver their best work, no matter how they work. The comprehensive Planview platform and enterprise success model enables customers to deliver innovative, competitive products, services, and customer experiences. Headquartered in Austin, Texas, with locations around the world, Planview has more than 1,300 employees supporting 4,500 customers and 2.6 million users worldwide. For more information, visit www.planview.com.

SUPPORTING ORGANISATION

SIRIM is a premier industrial research and technology organisation in Malaysia, wholly-owned by the Minister​ of Finance Incorporated. With over forty years of experience and expertise, SIRIM is mandated as the machinery for research and technology development, and the national champion of quality. SIRIM has always played a major role in the development of the country’s private sector. By tapping into our expertise and knowledge base, we focus on developing new technologies and improvements in the manufacturing, technology and services sectors. We nurture Small Medium Enterprises (SME) growth with solutions for technology penetration and upgrading, making it an ideal technology partner for SMEs.

PARTNER

HashiCorp provides infrastructure automation software for multi-cloud environments, enabling enterprises to unlock a common cloud operating model to provision, secure, connect, and run any application on any infrastructure. HashiCorp tools allow organizations to deliver applications faster by helping enterprises transition from manual processes and ITIL practices to self-service automation and DevOps practices. 

PARTNER

IBM is a leading global hybrid cloud and AI, and business services provider. We help clients in more than 175 countries capitalize on insights from their data, streamline business processes, reduce costs and gain the competitive edge in their industries. Nearly 3,000 government and corporate entities in critical infrastructure areas such as financial services, telecommunications and healthcare rely on IBM’s hybrid cloud platform and Red Hat OpenShift to affect their digital transformations quickly, efficiently and securely. IBM’s breakthrough innovations in AI, quantum computing, industry-specific cloud solutions and business services deliver open and flexible options to our clients. All of this is backed by IBM’s legendary commitment to trust, transparency, responsibility, inclusivity and service.

Send this to a friend