Data quality monitoring. Data testing. Data observability. Say that five times fast. Are they different words for the same thing? Unique approaches to the same problem? Something else entirely? And more importantly-do you really need all three? Like everything in data engineering, data quality management is evolving at lightning speed. The meteoric rise of data and AI in … [Read more...] about The Past, Present, and Future of Data Quality Management: Understanding Testing, Monitoring, and Data Observability in 2024
big data engineer
How to Evaluate the Best Data Observability Tools
Data observability has been one of the hottest emerging data engineering technologies the last several years. This momentum shows no signs of stopping with data quality and reliability becoming a central topic in the data product and AI conversations taking place across organizations of all types and sizes. Benefits of data observability include: Increasing data trust and … [Read more...] about How to Evaluate the Best Data Observability Tools
Building Ethical AI Starts with the Data Team – Here’s Why
When it comes to the technology race, moving quickly has always been the hallmark of future success. Unfortunately, moving too quickly also means we can risk overlooking the hazards waiting in the wings. It's a tale as old as time. One minute you're sequencing prehistoric mosquito genes, the next minute you're opening a dinosaur theme park and designing the world's first … [Read more...] about Building Ethical AI Starts with the Data Team – Here’s Why
Will GenAI Replace Data Engineers? No – And Here’s Why.
These days, keeping up with the latest advancements in GenAI is harder than saying "multimodal model." It seems like every week some shiny new solution launches with the lofty promise of transforming our lives, our work, and the way we feed our dogs. Data engineering is no exception. Already in the wee months of 2024, GenAI is beginning to upend the way data teams think about … [Read more...] about Will GenAI Replace Data Engineers? No – And Here’s Why.
The Data ROI Pyramid: A Method for Measuring & Maximizing Your Data Team
As recently as a year ago, about half of the data leaders we spoke with felt the business value of their team sold itself. Today, maximizing and measuring data team ROI is near the top of every data leader's agenda. Most data team ROI formulas focus on some version of the following calculation: Lift / investment = ROI. And while there's certainly value in its simplicity, it … [Read more...] about The Data ROI Pyramid: A Method for Measuring & Maximizing Your Data Team
