Traditional on-premises data processing solutions have led to a hugely complex and expensive set of data silos where IT spends more time managing the infrastructure than extracting value from the data. Big data architectures have attempted to solve the problem with large pools of cost-effective storage, but in doing so have often created on-premises management and administration challenges. These challenges of acquiring, installing and maintaining large clusters of computing resources gave rise to cloud-based implementations as an alternative. Public cloud is becoming the new center for data as organizations migrate from static on-premises IT architectures to global, dynamic and multi-cloud architectures.
Organizations are always looking to improve their ability to use data and AI to gain meaningful and actionable insights into their operations, services and customer needs. But unlocking value from data requires multiple analytics workloads, data science tools and machine learning algorithms to run against the same diverse data sets. Organizations still struggle with limited data visibility and insufficient insights, which are often caused by a multitude of reasons such as analytic workloads running independently, data spread across multiple data centers, data governance, etc. In our ongoing benchmark research project, we are researching the ways in which organizations work with big data and the challenges they face.
The annual Ventana Research Digital Innovation Awards showcases advances in the productivity and potential of business applications, as well as technology that contributes significantly to improved efficiency and productivity in the processes and the performance of an organization. Our goal is to recognize technology and vendors that have introduced noteworthy digital innovations that advance business and IT.
Topics: Analytics, Collaboration, Data Governance, Data Lake, Data Preparation, IOT, Data, Information Management (IM), Digital Technology, blockchain, Conversational Computing, AI and Machine Learning, collaborative computing, mobile computing, extended reality
A data lake is a centralized repository designed to house big data in structured, semi-structured and unstructured form. I have been covering the data lake topic for several years and encourage you to check out an earlier perspective called Data Lakes: Safe Way to Swim in Big Data? for background. Our data lake research has uncovered some points to consider in your efforts, and I’d like to offer a deeper dive into our findings.
Every organization performing analytics with multiple employees needs to collaborate. They should be collaborating in the analytics process and in communicating the results of those analyses. As I continue my evaluation of analytics and data vendors, I have to admit some disappointment at the level of collaborative capabilities some analytics vendors provide. To be fair, the level of capabilities vary widely, but I expected collaborative capabilities to be more uniformly available as a standard feature in analytics technologies by now. I had anticipated that three-quarters of analytics vendors would include collaboration capabilities. More than half the vendors I have evaluated support some comments and discussion in their products, only a few have incorporated social recognition and wall posting as part of their collaborative capabilities. So, what impact does a lack of analytics collaboration have on organizations undergoing digital transformation?