Ventana Research Analyst Perspectives

The Vendor Assessment Guide for Data Platforms: Ranked and Rated

Posted by Matt Aslett on Jan 12, 2023 3:00:00 AM

I am happy to share insights from our latest Ventana Research Value Index, which assesses how well vendors’ offerings meet buyers’ requirements. The 2023 Data Platforms Value Index is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect real-world criteria incorporated in a request for proposal to data platform vendors that support the spectrum of operational and analytic use cases. Using this methodology, we evaluated vendor submissions in seven categories: five relevant to the Product Experience: Adaptability, Capability, Manageability, Reliability and Usability, and two related to the Customer Experience: Total Cost of Ownership/Return on Investment and Validation.

This research-based index evaluates the full business and information technology value of data platform offerings. I encourage you to learn more about our Value Index and its VR_VI_Data_Platforms_Logo-1effectiveness as a vendor selection and Request for Information/Request for Proposal tool.

Our Value Index for Data Platforms represents technology vendors and products that provide both analytic and operational capabilities. It is designed to provide a holistic view of a vendor’s ability to serve a combination of both operational and analytic workloads with either a single data platform product or set of data platform products. Our assessment also considered whether the functionality in question was available from a vendor in a single offering, or as a suite of products or cloud services. Technology vendors that primarily serve and provide only analytic or operational capabilities are represented in separate Value Index research reports.

The 2023 Data Platforms Value Index evaluates the following vendors that offer products to address key elements of data platforms, supporting a combination of both operational and analytic workloads: Actian, Amazon Web Services, Cloudera, EDB, Google, IBM, InterSystems, MariaDB, Microsoft, Oracle, PingCAP, SAP and SingleStore. Three of the 13 suppliers responded positively to our requests for information and provided completed questionnaires and demonstrations, while two suppliers provided more limited information for the research.

Online material that was generally available was used for the analysis, along with briefings and any information the vendor provided. Vendors that meet our inclusion criteria but do not participate in our Value Index are assessed on publicly available information, which could have significant impact to the Value Index classification and rating. This report includes products generally available as of September 30, 2022.

Unlike many IT analyst firms that rank vendors from an IT-only perspective or consider futures or vision over what is available in the products today, Ventana Research has designed the Value Index to provide a balanced perspective of vendors and products that is rooted in an understanding of business drivers and needs. This approach not only reduces cost and time but also minimizes the risk of making a decision that is bad for the business.

Using the Value Index will enable your organization to select data platforms that achieve the levels of organizational efficiency and effectiveness needed to create engaging digital experiences that meet buyer, consumer, customer and partner needs. We urge organizations to do a thorough job of evaluating data platform products and services, and offer this Value Index as both the results of our in-depth analysis of these vendors and as an evaluation methodology. In addition to evaluating existing suppliers, the Value Index can be used to provide evaluation criteria for new projects. Applying our research can shorten the cycle time when creating an RFP.

The 2023 Value Index for Data Platforms finds IBM first on the list, with Oracle in second and InterSystems in third. Companies that place in the top three in any category earn the Value Index Leader designation. IBM has done so in five of the seven categories, Oracle in four and InterSystems in three. Actian, Amazon Web Services, Microsoft and SAP placed in the top three in two categories, and MariaDB in one category. They are all Value Index Leaders.


The overall Value Index performance chart provides a visual representation of how vendors rate across product and customer experience. Vendors with products scoring higher in a weighted rating of the five Product Experience categories place farther to the right. The combination of ratings for the two Customer Experience categories determines the placement on the vertical axis. As a result, vendors that place closer to the upper right are “exemplary” and rated higher than those closer to the lower left and identified as vendors of “merit.” Vendors that excelled at customer experience over product experience have an “assurance” rating, and those excelling instead in product experience have an “innovative” rating.

We warn that close vendor placement should not be taken to imply that the packages evaluated are functionally identical or equally well suited for use by every organization or for a specific process. Although there is a high degree of commonality in how organizations handle data, there are many idiosyncrasies and differences in data platform functionality that may make one vendor’s offering a better fit than another’s for a particular organization’s needs.

All of the products we evaluated are feature-rich, but not all the capabilities they offer are equally valuable to users or support everything needed across the entire life cycle of use. Moreover, the existence of too many capabilities may be a negative factor for an organization if it introduces unnecessary complexity. Nonetheless, you may decide that a larger number of functions is a plus, especially if some of them match your organization’s established practices or support an initiative that is driving the purchase of new software.

Issues beyond features and functions or vendor assessments may become a deciding factor. For example, an organization may face budget constraints such that the TCO evaluation can tip the balance to one vendor or another. This is where the Value Index methodology and appropriate category weighting can be applied to determine the best fit of vendors and products to your specific needs.

We have made every effort to encompass in this Value Index the functional requirements and capabilities of our research blueprint. Even so, there may be additional areas that affect which vendor and products best fit your particular requirements. Therefore, while this research is complete as it stands, utilizing it in your own organizational context is critical to ensure that products deliver the highest level of support for your projects in this area.

You can find more details on our site as well as in the Value Index Market Report.


Matt Aslett

Topics: Cloud Computing, Data, Digital Technology, Analytics and Data, operational data platforms, Analytic Data Platforms

Matt Aslett

Written by Matt Aslett

Matt leads the expertise in Digital Technology covering applications and technology that improve the readiness and resilience of business and IT operations. His focus areas of expertise and market coverage include: analytics and data, artificial intelligence and machine learning, blockchain, cloud computing, collaborative and conversational computing, extended reality, Internet of Things mobile computing and robotic automation. Matt’s specialization is in operational and analytical use of data and how businesses can modernize their approaches to business to accelerate the value realization of technology investments in support of hybrid and multi-cloud architecture. Matt has been an industry analyst for more than a decade and has pioneered the coverage of emerging data platforms including NoSQL and NewSQL databases, data lakes and cloud-based data processing. He is a graduate of Bournemouth University.