Welcome back -

Services for Organizations

Using our research, best practices and expertise, we help you understand how to optimize your business processes using applications, information and technology. We provide advisory, education, and assessment services to rapidly identify and prioritize areas for improvement and perform vendor selection

Consulting & Strategy Sessions

Ventana On Demand

    Services for Investment Firms

    We provide guidance using our market research and expertise to significantly improve your marketing, sales and product efforts. We offer a portfolio of advisory, research, thought leadership and digital education services to help optimize market strategy, planning and execution.

    Consulting & Strategy Sessions

    Ventana On Demand

      Services for Technology Vendors

      We provide guidance using our market research and expertise to significantly improve your marketing, sales and product efforts. We offer a portfolio of advisory, research, thought leadership and digital education services to help optimize market strategy, planning and execution.

      Analyst Relations

      Demand Generation

      Product Marketing

      Market Coverage

      Request a Briefing

        Ventana Research Analyst Perspectives

        << Back to Blog Index

        The Vendor Assessment Guide for Data Platforms: Ranked and Rated

        I am happy to share insights from our latest Ventana Research Value Index, which assesses how well vendors’ offerings meet buyers’ requirements. The 2023 Data Platforms Value Index is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect real-world criteria incorporated in a request for proposal to data platform vendors that support the spectrum of operational and analytic use cases. Using this methodology, we evaluated vendor submissions in seven categories: five relevant to the Product Experience: Adaptability, Capability, Manageability, Reliability and Usability, and two related to the Customer Experience: Total Cost of Ownership/Return on Investment and Validation.

        This research-based index evaluates the full business and information technology value of data platform offerings. I encourage you to learn more about our Value Index and its VR_VI_Data_Platforms_Logo-1effectiveness as a vendor selection and Request for Information/Request for Proposal tool.

        Our Value Index for Data Platforms represents technology vendors and products that provide both analytic and operational capabilities. It is designed to provide a holistic view of a vendor’s ability to serve a combination of both operational and analytic workloads with either a single data platform product or set of data platform products. Our assessment also considered whether the functionality in question was available from a vendor in a single offering, or as a suite of products or cloud services. Technology vendors that primarily serve and provide only analytic or operational capabilities are represented in separate Value Index research reports.

        The 2023 Data Platforms Value Index evaluates the following vendors that offer products to address key elements of data platforms, supporting a combination of both operational and analytic workloads: Actian, Amazon Web Services, Cloudera, EDB, Google, IBM, InterSystems, MariaDB, Microsoft, Oracle, PingCAP, SAP and SingleStore. Three of the 13 suppliers responded positively to our requests for information and provided completed questionnaires and demonstrations, while two suppliers provided more limited information for the research.

        Online material that was generally available was used for the analysis, along with briefings and any information the vendor provided. Vendors that meet our inclusion criteria but do not participate in our Value Index are assessed on publicly available information, which could have significant impact to the Value Index classification and rating. This report includes products generally available as of September 30, 2022.

        Unlike many IT analyst firms that rank vendors from an IT-only perspective or consider futures or vision over what is available in the products today, Ventana Research has designed the Value Index to provide a balanced perspective of vendors and products that is rooted in an understanding of business drivers and needs. This approach not only reduces cost and time but also minimizes the risk of making a decision that is bad for the business.

        Using the Value Index will enable your organization to select data platforms that achieve the levels of organizational efficiency and effectiveness needed to create engaging digital experiences that meet buyer, consumer, customer and partner needs. We urge organizations to do a thorough job of evaluating data platform products and services, and offer this Value Index as both the results of our in-depth analysis of these vendors and as an evaluation methodology. In addition to evaluating existing suppliers, the Value Index can be used to provide evaluation criteria for new projects. Applying our research can shorten the cycle time when creating an RFP.

        The 2023 Value Index for Data Platforms finds IBM first on the list, with Oracle in second and InterSystems in third. Companies that place in the top three in any category earn the Value Index Leader designation. IBM has done so in five of the seven categories, Oracle in four and InterSystems in three. Actian, Amazon Web Services, Microsoft and SAP placed in the top three in two categories, and MariaDB in one category. They are all Value Index Leaders.


        The overall Value Index performance chart provides a visual representation of how vendors rate across product and customer experience. Vendors with products scoring higher in a weighted rating of the five Product Experience categories place farther to the right. The combination of ratings for the two Customer Experience categories determines the placement on the vertical axis. As a result, vendors that place closer to the upper right are “exemplary” and rated higher than those closer to the lower left and identified as vendors of “merit.” Vendors that excelled at customer experience over product experience have an “assurance” rating, and those excelling instead in product experience have an “innovative” rating.

        We warn that close vendor placement should not be taken to imply that the packages evaluated are functionally identical or equally well suited for use by every organization or for a specific process. Although there is a high degree of commonality in how organizations handle data, there are many idiosyncrasies and differences in data platform functionality that may make one vendor’s offering a better fit than another’s for a particular organization’s needs.

        All of the products we evaluated are feature-rich, but not all the capabilities they offer are equally valuable to users or support everything needed across the entire life cycle of use. Moreover, the existence of too many capabilities may be a negative factor for an organization if it introduces unnecessary complexity. Nonetheless, you may decide that a larger number of functions is a plus, especially if some of them match your organization’s established practices or support an initiative that is driving the purchase of new software.

        Issues beyond features and functions or vendor assessments may become a deciding factor. For example, an organization may face budget constraints such that the TCO evaluation can tip the balance to one vendor or another. This is where the Value Index methodology and appropriate category weighting can be applied to determine the best fit of vendors and products to your specific needs.

        We have made every effort to encompass in this Value Index the functional requirements and capabilities of our research blueprint. Even so, there may be additional areas that affect which vendor and products best fit your particular requirements. Therefore, while this research is complete as it stands, utilizing it in your own organizational context is critical to ensure that products deliver the highest level of support for your projects in this area.

        You can find more details on our site as well as in the Value Index Market Report.


        Matt Aslett


        Matt Aslett
        Director of Research, Analytics and Data

        Matt Aslett leads the software research and advisory for Analytics and Data at Ventana Research, now part of ISG, covering software that improves the utilization and value of information. His focus areas of expertise and market coverage include analytics, data intelligence, data operations, data platforms, and streaming and events.


        Our Analyst Perspective Policy

        • Ventana Research’s Analyst Perspectives are fact-based analysis and guidance on business, industry and technology vendor trends. Each Analyst Perspective presents the view of the analyst who is an established subject matter expert on new developments, business and technology trends, findings from our research, or best practice insights.

          Each is prepared and reviewed in accordance with Ventana Research’s strict standards for accuracy and objectivity and reviewed to ensure it delivers reliable and actionable insights. It is reviewed and edited by research management and is approved by the Chief Research Officer; no individual or organization outside of Ventana Research reviews any Analyst Perspective before it is published. If you have any issue with an Analyst Perspective, please email them to ChiefResearchOfficer@ventanaresearch.com

        View Policy

        Subscribe to Email Updates

        Posts by Month

        see all

        Posts by Topic

        see all

        Analyst Perspectives Archive

        See All