Richard Timperlake, SVP, EMEA at Confluent, outlines how strategic investments, overcoming legacy challenges, and a pivot towards data-driven decision-making are positioning real-time data streaming platforms as the backbone of tomorrow’s AI and business innovation.

As we move into 2025, already we are seeing exciting things taking place in the world of technology. Data, often described as the lifeblood of AI, is becoming more important than ever, with real-time data streaming at the forefront of innovation and decision-making.

At the same time, keeping up with these breakthroughs can be tough. From the proposed ‘Stargate’ project in the US, to the UK Government’s AI Opportunities Action Plan, the landscape is constantly changing — and businesses need technology that can accommodate that speed of change.

Enter: data streaming platforms (DSPs).

By delivering real-time insights and enabling swift action, DSPs are becoming the essential fuel for the next stage of AI and computing advancements, and they sit at the core of my predictions for 2025.

1. More stability, more investment… 

With the macroeconomic and the geopolitical situation reaching a more stable position than this time last year, organisations are now feeling more confident to make the necessary investments in data and AI. And we are already seeing this happening.

Over the past couple of months, many tech companies have taken the necessary steps to invest in data. Looking back on day two of the new US presidency, we can see a global example in the $500 billion deal between OpenAI, SoftBank, and Oracle termed ‘Stargate’ — an immense investment into new AI infrastructure for OpenAI in the United States.

In the UK, we’ve also seen government-driven investment in AI following the launch of the Government’s AI Opportunities Plan. The very first recommendation in the plan is “a long-term plan for [the] UK’s AI infrastructure needs, backed by a 10-year investment commitment.”

Such steps will help many organisations feel empowered to take that next step, investing further in their own AI and data to propel their business and keep up with competitors.

2. There will still be some resistance in the adoption of new technologies

The challenges of adopting new technologies still remain — and they aren’t just technical. Some sceptics still argue that ‘placing all eggs in the AI and data basket’ is inherently risky.

AI-driven decision-making can lack the transparency of traditional methods. Algorithms may make recommendations or automate tasks without the need for a human touchpoint. Over time, this is going to make AI a reality for businesses whether they adopt it or not — the superior analytics that AI-enabled competitors will benefit from will see them increasingly outperform their competitors.

Understandably, business leaders and employees may be hesitant to fully embrace AI if they don’t have a clear understanding of how these decisions are being made. But it’s a resistance to a new normal that is coming whether they like it or not.

Many businesses, especially those in industries like finance, healthcare, and manufacturing, are still dependent on conventional methods of processing data. Batch processing and rule-based decision-making showcase the limitations of legacy systems that can’t always support modern AI applications, despite being deeply embedded in organisational workflows and culture.

In order to stay competitive and relevant in their industry, these businesses need to adopt a DSP that will scale with the business and enable real-time insights, decision-making and most critically give customers the experience they demand in today’s world.

3. Data streaming will become a crucial component in the UK’s race to become an AI superpower

As we’ve mentioned, the UK Government’s AI Opportunities Action Plan is specifically intended to lay the groundwork for the country’s long-term AI future. Recommendation #49 is simply ‘drive AI adoption across the whole country’.

These plans include initiatives that will require an incredible amount of data, analysed and enriched in real time. To become a reality, DSPs must play a key role.

DSPs serve as the lifeline that continuously supplies the AI ‘brain’ with high-quality, real-time data, enabling faster, more accurate decisions. As organisations invest in AI and data, greater investment in data streaming technologies and supporting infrastructure, such as data centres and cloud providers, will be essential to handle the increased demands.

DSPs will also be at the forefront of breaking down many other barriers. Many organisations still grapple with fragmented data trapped in siloed systems, accessible only through complex, code-heavy processes that hinder innovation and the ability to respond in real-time. By adopting DSPs, organisations can integrate and act on their data seamlessly, improving agility.

4. Business leaders will need to lean on data-driven decision-making

As AI makes data more readily available, we will see many business leaders finally commit to a data-driven decision-making process this year.

The majority of businesses are still operating within very tight financial margins and success depends on delivering the right data to the right person at the right time. As such, many decisions are being made without all of the data needed to make a properly informed decision. According to a recent Confluent study, 90% of executives now need to make decisions “in real time,” yet 52% say data is already outdated by the time it reaches the C-suite. That means more than half (58%) of C-level leaders are forced to rely on gut instinct rather than data due to the difficulty of accessing reliable insights.

Usually, that’s due to the many challenges that companies face when attempting to unlock the full potential of their data. Fragmented systems and disconnected workflows frequently prevent decision-makers from accessing timely insights, as do traditional batch processing methods.

These obstacles highlight the pressing need for real-time DSPs, which can transform inaccessible data into actionable insights, and enable leaders to make faster, more informed decisions.

Data-streaming for all

As businesses increasingly adopt data streaming technologies — moving beyond initial applications to fuel deeper innovation — adoption is set to accelerate. In 2025, more organisations will come to recognise DSPs as an essential cornerstone of modern business success.