Services for Organizations

Using our research, best practices and expertise, we help you understand how to optimize your business processes using applications, information and technology. We provide advisory, education, and assessment services to rapidly identify and prioritize areas for improvement and perform vendor selection

Consulting & Strategy Sessions

Ventana On Demand

    Services for Investment Firms

    We provide guidance using our market research and expertise to significantly improve your marketing, sales and product efforts. We offer a portfolio of advisory, research, thought leadership and digital education services to help optimize market strategy, planning and execution.

    Consulting & Strategy Sessions

    Ventana On Demand

      Services for Technology Vendors

      We provide guidance using our market research and expertise to significantly improve your marketing, sales and product efforts. We offer a portfolio of advisory, research, thought leadership and digital education services to help optimize market strategy, planning and execution.

      Analyst Relations

      Demand Generation

      Product Marketing

      Market Coverage

      Request a Briefing


        Ventana Research Analyst Perspectives

        << Back to Blog Index

        The Buyers Guide for Data Observability Classifies and Rates Vendors

        I am happy to share insights gleaned from our latest Buyers Guide, an assessment of how well vendors’ offerings meet buyers’ requirements. The Ventana Research 2023 Data Observability Buyers Guide is the distillation of a year of market and product research by Ventana Research. Drawing on our Benchmark Research, we apply a structured methodology built on evaluation categories that reflect the real-world criteria incorporated in a request for proposal to data vendors supporting the spectrum of data observability. Using this methodology, we evaluated vendor submissions in seven categories: five relevant to the product experience Adaptability, Capability, Manageability, Reliability and Usability and two related to the customer experience TCO/ROI and vendor Validation. 

        This research-based index evaluates the full business and information technology value of data observability software offerings. I encourage you to learn more about our Buyers Guide VR_BG_Data_Observability_Logoand its effectiveness as a vendor selection and RFI/RFP tool. 

        This Buyers Guide research evaluates the following vendors that offer products for data observability as we define it: Acceldata, Collibra, DataKitchen, IBM, Monte Carlo, Precisely and Stonebranch. Two of these seven suppliers responded positively to our requests for information and provided completed questionnaires and demonstrations to aid our analysis of their data observability products. Along with briefings and information where provided, all online material that was generally available was used for the analysis. This report includes products generally available as of August 30, 2023. 

        The following vendors declined to participate or did not respond to our invitation: Collibra, IBM, Precisely and Stonebranch. To organizations considering products from these vendors, we recommend extra scrutiny as part of the software assessment because they did not make their technology available for the Value Index evaluation process. 

        Unlike many IT analyst firms that rank vendors from an IT-only perspective or focus on a specific type of data observability, Ventana Research has designed the Buyers Guide to provide a balanced perspective, rooted in an understanding of business drivers and needs. This approach not only reduces cost and time but also minimizes the risk of making a decision that is bad for the business. 

        Using the Buyers Guide will enable your organization to achieve levels of efficiency and effectiveness needed to optimize data observability. 

        We urge organizations to do a thorough job of evaluating data observability offerings in this Buyers Guide as both the results of our in-depth analysis of these vendors and as an evaluation methodology. The Value Index can be used to evaluate existing suppliers, plus provides evaluation criteria for new projects. Using it can shorten the cycle time for an RFP. 

        The Buyers Guide for Data Observability in 2023 finds Monte Carlo first on the list, followed by IBM and Acceldata.  

        Companies that rated in the top three of any category including the product and customer experience dimensions earn the designation of Leader.  

        The Leaders in Product Experience are:  

        • Monte Carlo.
        • IBM.
        • Acceldata. 

        The Leaders in Customer Experience are: 

        • IBM. 
        • Monte Carlo.
        • Collibra. 

        The Leaders across any of the seven categories are: 

        • IBM and Monte Carlo, which has achieved this rating in seven of the seven categories. 
        • Acceldata in four categories. 
        • Collibra in two categories.
        • Precisely in one category. 

        The overall performance chart provides a visual representation of how vendors rate across product and customer experience. Vendors with products scoring higher in a weighted rating of the five product experience categories place farther to the right. The combination of ratings for the two customer experience categories determines their placement on the vertical axis. As a result, vendors that place closer to the upper-right are “exemplary” and rated higher than those closer to the lower-left and identified as vendors of “merit.” Vendors that excelled at customer experience over product experience have an “assurance” rating, and those excelling instead in product experience have an “innovative” rating. 

        Ventana_Research_BG_Data_Observability_2023_2x2

        Note that close vendor scores should not be taken to imply that the packages evaluated are functionally identical or equally well-suited for use by every organization or process. Although there is a high degree of commonality in how organizations handle data observability, there are many idiosyncrasies and differences that can make one vendor’s offering a better fit than another. 

        After more than a decade of technological advances, all the products we evaluated are feature-rich, but not all the capabilities they offer are equally valuable to users. Moreover, the existence of too many capabilities may be a negative factor for an organization if it introduces unnecessary complexity. Nonetheless, an organization may decide that a larger number of options is a plus, especially if some of them match its established practices or better support a new initiative that is driving the purchase of new software. 

        Features, functions and vendor assessments are not the only deciding factors. For example, an organization may face budget constraints such that the TCO evaluation can tip the scale to one vendor or another. This is where the Value Index methodology and appropriate weighting can be applied to determine the best fit of vendors and products to an organization’s specific needs. 

        Our firm has made every effort to encompass in this Buyers Guide the overall product and customer experience from our data observability blueprint, which we believe reflects what a well-crafted RFP should contain. Even so, there may be additional areas that affect which vendor and products best fit an organization’s particular requirements. Therefore, while this research is complete as it stands, utilizing it in your own organizational context is critical to ensure that products deliver the highest level of support for your projects. 

        You can find more details on our site as well as in the Buyers Guide Report. 

        Regards,

        Matt Aslett

        Authors:

        Matt Aslett
        Director of Research, Data and Analytics

        Matt leads the expertise for Data, covering technology that improves the utilization and value of data and analytics. His focus areas of expertise and market coverage include analytic data platforms, data governance, data management, data operations, operational data platforms, and streaming data and events.

        JOIN OUR COMMUNITY

        Our Analyst Perspective Policy

        • Ventana Research’s Analyst Perspectives are fact-based analysis and guidance on business, industry and technology vendor trends. Each Analyst Perspective presents the view of the analyst who is an established subject matter expert on new developments, business and technology trends, findings from our research, or best practice insights.

          Each is prepared and reviewed in accordance with Ventana Research’s strict standards for accuracy and objectivity and reviewed to ensure it delivers reliable and actionable insights. It is reviewed and edited by research management and is approved by the Chief Research Officer; no individual or organization outside of Ventana Research reviews any Analyst Perspective before it is published. If you have any issue with an Analyst Perspective, please email them to ChiefResearchOfficer@ventanaresearch.com

        View Policy

        Our Analysts

        Subscribe to Email Updates

        Posts by Month

        see all

        Posts by Topic

        see all


        Analyst Perspectives Archive

        See All