Ventana Research Analyst Perspectives

Seek Solace for Event-Driven Architectures and Applications

Posted by Matt Aslett on Apr 12, 2023 3:00:00 AM

I have written recently about the increasing importance of managing data in motion and at rest as the use of streaming data by enterprise organizations becomes more mainstream. While batch-based processing of application data has been a core component of enterprise IT architecture for decades, streaming data and event processing have often been niche disciplines typically reserved for organizations with the highest-level performance requirements. That has changed in recent years, driven by an increased reliance on streaming data and events to identify trends and anomalies and enable real-time responses through uninterrupted processing and analysis of data generated by applications, systems and devices on a continuous basis. Companies like Solace have been integral to the development of event-driven applications and increased adoption of event-driven architecture (EDA).

Read More

Topics: Data, Streaming Data & Events

Streaming Databases Enable Continuous Analysis and Data Persistence

Posted by Matt Aslett on Mar 23, 2023 3:00:00 AM

Success with streaming data and events requires a more holistic approach to managing and governing data in motion and data at rest. The use of streaming data and event processing has been part of the data landscape for many decades. For much of that time, data streaming was a niche activity, however, with standalone data streaming and event-processing projects run in parallel with existing batch-processing initiatives, utilizing operational and analytic data platforms. I noted that there has been an increased focus on unified approaches that enable the holistic management and governance of data in motion alongside data at rest. One example is the recent emergence of streaming databases designed to combine the incremental processing capabilities of stream-processing engines with the SQL-based analysis and persistence capabilities of traditional databases.

Read More

Topics: Analytics, Data, Digital Technology, Streaming Analytics, Analytics & Data, Streaming Data & Events, operational data platforms, Analytic Data Platforms

2023 Market Agenda for Data: Accelerating Data Agility

Posted by Matt Aslett on Jan 18, 2023 3:00:00 AM

Ventana Research recently announced its 2023 Market Agenda for Data, continuing the guidance we have offered for two decades to help organizations derive optimal value and improve business outcomes.

Read More

Topics: Cloud Computing, Data Governance, Data Management, Data, Digital Technology, data operations, Analytics & Data, Streaming Data & Events, operational data platforms, Analytic Data Platforms

The Data Pantry Accelerates Actionable Analytics for Decision-Making

Posted by Robert Kugel on Dec 22, 2022 3:00:00 AM

Ventana Research uses the term “data pantry” to describe a method of data storage (and the technology and process blueprint for its construction) created for a specific set of users and use cases in business-focused software. It’s a pantry because all the data one needs is readily available and easily accessible, with labels that are immediately recognized and understood by the users of the application. In tech speak, this means the semantic layer is optimized for the intended audience. It is stocked with data gathered from multiple sources and immediately available for analysis, forecasting, planning and reporting. This does away with the need for analysts to repeatedly perform data extraction, enrichment or transformation motions from the required source systems, all but eliminating the substantial amount of time analysts and business users routinely spend on data preparation.

Read More

Topics: Continuous Planning, Business Intelligence, Data Management, Business Planning, Data, Financial Performance Management, Enterprise Resource Planning, AI and Machine Learning, continuous supply chain, data operations, digital finance, profitability management, Analytics & Data, Streaming Data & Events

Databricks Lakehouse Platform Maximizes Analytical Value

Posted by Matt Aslett on Nov 16, 2022 3:00:00 AM

I have previously written about growing interest in the data lakehouse as one of the design patterns for delivering hydroanalytics analysis of data in a data lake. Many organizations have invested in data lakes as a relatively inexpensive way of storing large volumes of data from multiple enterprise applications and workloads, especially semi- and unstructured data that is unsuitable for storing and processing in a data warehouse. However, early data lake projects lacked structured data management and processing functionality to support multiple business intelligence efforts as well as data science and even operational applications.

Read More

Topics: Business Intelligence, Data Governance, Data Management, Data, AI and Machine Learning, Streaming Data & Events, Analytic Data Platforms

Cloudera Embraces SaaS with Data Lakehouse Launch

Posted by Matt Aslett on Oct 18, 2022 3:00:00 AM

Ventana Research’s Data Lakes Dynamics Insights research illustrates that while data lakes are fulfilling their promise of enabling organizations to economically store and process large volumes of raw data, data lake environments continue to evolve. Data lakes were initially based primarily on Apache Hadoop deployed on-premises but are now increasingly based on cloud object storage. Adopters are also shifting from data lakes based on homegrown scripts and code to open standards and open formats, and they are beginning to embrace the structured data-processing functionality that supports data lakehouse capabilities. These trends are driving the evolution of vendor product offerings and strategies, as typified by Cloudera’s recent launch of Cloudera Data Platform (CDP) One, described as a data lakehouse software-as-a-service (SaaS) offering.

Read More

Topics: Business Intelligence, Data Governance, Data Management, Data, AI and Machine Learning, data operations, Analytics and Data, Streaming Data & Events, operational data platforms, Analytic Data Platforms

Aerospike Has a Data Platform for Real-Time Intelligent Applications

Posted by Matt Aslett on Oct 6, 2022 3:00:00 AM

Earlier this year I described the growing use-cases for hybrid data processing. Although it is anticipated that the majority of database workloads will continue to be served by specialist data platforms targeting operational and analytic workloads respectively, there is increased demand for intelligent operational applications infused with the results of analytic processes, such as personalization and artificial intelligence-driven recommendations. There are multiple data platform approaches to delivering real-time data processing and analytics, including the use of streaming data and event processing and specialist, real-time analytic data platforms. We also see operational data platform providers, such as Aerospike, adding analytic processing capabilities to support these application requirements via hybrid operational and analytic processing.

Read More

Topics: Business Intelligence, Cloud Computing, Data, AI and Machine Learning, Streaming Data & Events, operational data platforms, Analytic Data Platforms

Confluent Addresses Data Governance for Data in Motion

Posted by Matt Aslett on Sep 9, 2022 3:15:00 AM

I recently wrote about the need for organizations to take a holistic approach to the management and governance of data in motion alongside data at rest. As adoption of streaming data and event processing increases, it is no longer sufficient for streaming data projects to exist in isolation. Data needs to be managed and governed regardless of whether it is processed in batch or as a stream of events. This requirement has resulted in established data management vendors increasing their focus on streaming data and event processing through product development as well as acquisitions. It has also resulted in streaming and event specialists, such as Confluent, adding centralized management and governance capabilities to their existing offerings as they seek to establish or reinforce the strategic importance of streaming data as part of a modern approach to data management.

Read More

Topics: Big Data, Cloud Computing, Data Governance, Streaming Analytics, Streaming Data & Events

Rockset Offers Cloud-Based Real-Time Analytics

Posted by Matt Aslett on Aug 30, 2022 3:00:00 AM

I have written recently about increased demand for data-intensive applications infused with the results of analytic processes, such as personalization and artificial intelligence (AI)-driven recommendations. Almost one-quarter of respondents (22%) to Ventana Research’s Analytics and Data Benchmark Research are currently analyzing data in real time, with an additional 10% analyzing data every hour. There are multiple data platform approaches to delivering real-time data processing and analytics and more agile data pipelines. These include the use of streaming and event data processing, as well as the use of hybrid data processing to enable analytics to be performed on application data within operational data platforms. Another approach, favored by a group of emerging vendors such as Rockset, is to develop these data-intensive applications on a specialist, real-time analytic data platform specifically designed to meet the performance and agility requirements of data-intensive applications.

Read More

Topics: Cloud Computing, Data, Streaming Analytics, Analytics & Data, Streaming Data & Events, operational data platforms, Analytic Data Platforms

Streaming Data Success Relies on Managing Data in Motion and At Rest

Posted by Matt Aslett on Aug 16, 2022 3:00:00 AM

I recently noted that as demand for real-time interactive applications becomes more pervasive, the use of streaming data is becoming more mainstream. Streaming data and event processing has been part of the data landscape for many decades, but for much of that time, data streaming was a niche activity. Although adopted in industry segments with high-performance, real-time data processing and analytics requirements such as financial services and telecommunications, data streaming was far less common elsewhere. That has changed significantly in recent years, fueled by the proliferation of open-source and cloud-based streaming data and event technologies that have lowered the cost and technical barriers to developing new applications able to take advantage of data in-motion. This is a trend we expect to continue, to the extent that streaming data and event processing becomes an integral part of mainstream data-processing architectures.

Read More

Topics: Big Data, Data, Streaming Analytics, Analytics & Data, Streaming Data & Events

DataStax Provides a Platform for Data in Motion and at Rest

Posted by Matt Aslett on Jul 27, 2022 3:00:00 AM

Streaming data has been part of the industry landscape for decades but has largely been focused on niche applications in segments with the highest real-time data processing and analytics performance requirements, such as financial services and telecommunications. As demand for real-time interactive applications becomes more pervasive, streaming data is becoming a more mainstream pursuit, aided by the proliferation of open-source streaming data and event technologies, which have lowered the cost and technical barriers to developing new applications that take advantage of data in motion. Ventana Research’s Streaming Data Dynamic Insights enables an organization to assess its relative maturity in achieving value from streaming data. I assert that by 2024, more than one-half of all organizations’ standard information architectures will include streaming data and event processing, allowing organizations to be more responsive and provide better customer experiences.

Read More

Topics: Data, Streaming Analytics, Streaming Data & Events, operational data platforms

Data-Driven Agenda for Organizations

Posted by Matt Aslett on Jul 21, 2022 3:00:00 AM

When joining Ventana Research, I noted that the need to be more data-driven has become a mantra among large and small organizations alike. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. Being data-driven is clearly something to aspire to. However, it is also a somewhat vague concept without clear definition. We know data-driven organizations when we see them — the likes of Airbnb, DoorDash, ING Bank, Netflix, Spotify, and Uber are often cited as examples — but it is not necessarily clear what separates the data-driven from the rest. Data has been used in decision-making processes for thousands of years, and no business operates without some form of data processing and analytics. As such, although many organizations may aspire to be more data-driven, identifying and defining the steps required to achieve that goal are not necessarily easy. In this Analyst Perspective, I will outline the four key traits that I believe are required for a company to be considered data-driven.

Read More

Topics: embedded analytics, Analytics, Business Intelligence, Data Governance, Data Integration, Data, Digital Technology, natural language processing, data lakes, AI and Machine Learning, data operations, Digital Business, Streaming Analytics, data platforms, Analytics & Data, Streaming Data & Events

Disentangling and Demystifying Data Mesh and Data Fabric

Posted by Matt Aslett on Jun 2, 2022 3:00:00 AM

I recently wrote about the potential benefits of data mesh. As I noted, data mesh is not a product that can be acquired, or even a technical architecture that can be built. It’s an organizational and cultural approach to data ownership, access and governance. While the concept of data mesh is agnostic to the technology used to implement it, technology is clearly an enabler for data mesh. For many organizations, new technological investment and evolution will be required to facilitate adoption of data mesh. Meanwhile, the concept of the data fabric, a technology-driven approach to managing and governing data across distributed environments, is rising in popularity. Although I previously touched on some of the technologies that might be applicable to data mesh, it is worth diving deeper into the data architecture implications of data mesh, and the potential overlap with data fabric.

Read More

Topics: Analytics, Business Intelligence, Data Governance, Data Integration, Data, AI and Machine Learning, data operations, data platforms, Streaming Data & Events

Real-Time Data Processing Requires More Agile Data Pipelines

Posted by Matt Aslett on Apr 26, 2022 3:00:00 AM

I recently wrote about the importance of data pipelines and the role they play in transporting data between the stages of data processing and analytics. Healthy data pipelines are necessary to ensure data is integrated and processed in the sequence required to generate business intelligence. The concept of the data pipeline is nothing new of course, but it is becoming increasingly important as organizations adapt data management processes to be more data driven.

Read More

Topics: Analytics, Business Intelligence, Data Governance, Data Integration, Data, Digital Technology, Digital transformation, data lakes, AI and Machine Learning, data operations, Digital Business, data platforms, Analytics & Data, Streaming Data & Events

Don’t Rely on Dashboards for Real-Time Analytics

Posted by David Menninger on Mar 31, 2022 3:00:00 AM

I have written previously that the world of data and analytics will become more and more centered around real-time, streaming data. Data is created constantly and increasingly is being collected simultaneously. Technology advances now enable organizations to process and analyze information as it is being collected to respond in real time to opportunities and threats. Not all use cases require real-time analysis and response, but many do, including multiple use cases that can improve customer experiences. For example, best-in-class e-commerce interactions should provide real-time updates on inventory status to avoid stock-out or back-order situations. Customer service interactions should provide real-time recommendations that minimize the time to resolution. Location-based offers should be targeted at the customer’s current location, not their location several minutes ago. Another domain where real-time analyses are critical is internet of things (IoT) applications. Additionally, use cases like predictive maintenance require timely information to prevent equipment failures that help avoid additional costs and damage.

Read More

Topics: business intelligence, Analytics, Internet of Things, Data, Digital Technology, AI and Machine Learning, Streaming Analytics, Analytics & Data, Streaming Data & Events

The Benefits of Data Mesh Extend to Organizational and Cultural Change

Posted by Matt Aslett on Mar 29, 2022 3:00:00 AM

Data mesh is the latest trend to grip the data and analytics sector. The term has been rapidly adopted by numerous vendors — as well as a growing number of organizations —as a means of embracing distributed data processing. Understanding and adopting data mesh remains a challenge, however. Data mesh is not a product that can be acquired, or even a technical architecture that can be built. It is an organizational and cultural approach to data ownership, access and governance. Adopting data mesh requires cultural and organizational change. Data mesh promises multiple benefits to organizations that embrace this change, but doing so may be far from easy.

Read More

Topics: Analytics, Business Intelligence, Data Governance, Data Integration, Data, Digital Technology, Digital transformation, data lakes, data operations, Digital Business, data platforms, Analytics & Data, Streaming Data & Events

Data Observability is Key to Ensuring Healthy Data Pipelines

Posted by Matt Aslett on Feb 22, 2022 3:00:00 AM

I recently described the emergence of hydroanalytic data platforms, outlining how the processes involved in generating energy from a lake or reservoir were analogous to those required to generate intelligence from a data lake. I explained how structured data processing and analytics acceleration capabilities are the equivalent of turbines, generators and transformers in a hydroelectric power station. While these capabilities are more typically associated with data warehousing, they are now being applied to data lake environments as well. Structured data processing and analytics acceleration capabilities are not the only things required to generate insights from data, however, and the hydroelectric power station analogy further illustrates this. For example, generating hydroelectric power also relies on pipelines to ensure that the water is transported from the lake or reservoir at the appropriate volume to drive the turbines. Ensuring that a hydroelectric power station is operating efficiently also requires the collection, monitoring and analysis of telemetry data to confirm that the turbines, generators, transformers and pipelines are functioning correctly. Similarly, generating intelligence from data relies on data pipelines that ensure the data is integrated and processed in the correct sequence to generate the required intelligence, while the need to monitor the pipelines and processes in data-processing and analytics environments has driven the emergence of a new category of software: data observability.

Read More

Topics: Analytics, Data Governance, Data, Digital Technology, data lakes, AI and Machine Learning, data operations, data platforms, Streaming Data & Events

Incorta Unifies Data Processing to Accelerate Analytics & BI

Posted by Matt Aslett on Feb 16, 2022 3:00:00 AM

As I stated when joining Ventana Research, the socioeconomic impacts of the pandemic and its aftereffects have highlighted more than ever the differences between organizations that can turn data into insights and are agile enough to act upon it and those that are incapable of seeing or responding to the need for change. Data-driven organizations stand to gain competitive advantage, responding faster to worker and customer demands for more innovative, data-rich applications and personalized experiences. One of the key methods that accelerates business decision-making is reducing the lag between data collection and data analysis.

Read More

Topics: Analytics, Business Intelligence, Data Integration, Data, data lakes, AI and Machine Learning, data operations, data platforms, Streaming Data & Events

Hybrid Data Processing Use Cases

Posted by Matt Aslett on Feb 11, 2022 3:00:00 AM

I recently described how the data platforms landscape will remain divided between analytic and operational workloads for the foreseeable future. Analytic data platforms are designed to store, manage, process and analyze data, enabling organizations to maximize data to operate with greater efficiency, while operational data platforms are designed to store, manage and process data to support worker-, customer- and partner-facing operational applications. At the same time, however, we see increased demand for intelligent applications infused with the results of analytic processes, such as personalization and artificial intelligence-driven recommendations. The need for real-time interactivity means that these applications cannot be served by traditional processes that rely on the batch extraction, transformation and loading of data from operational data platforms into analytic data platforms for analysis. Instead, they rely on analysis of data in the operational data platform itself via hybrid data processing capabilities to accelerate worker decision-making or improve customer experience.

Read More

Topics: embedded analytics, Analytics, Business Intelligence, Data, Digital Technology, AI and Machine Learning, data platforms, Analytics & Data, Streaming Data & Events

Managing Data Effectively in 2022: Ventana Research Market Agenda

Posted by Matt Aslett on Feb 1, 2022 3:00:00 AM

Ventana Research recently announced its 2022 Market Agenda for Data, continuing the guidance we have offered for nearly two decades to help organizations derive optimal value and improve business outcomes.

Read More

Topics: Data Governance, Data Integration, Data, data lakes, data operations, data platforms, Streaming Data & Events

Content not found