So you want to implement generative AI? That’s great news! You can count yourself among the majority of IT decision makers who have also seen the potential of this transformative tech. While GenAI has ...

Never before have the challenges of big data–how we store it, manage it, govern it, and use it–been so pressing. Advances in artificial intelligence may be the driving force in 2024, but that doesn’t ...

Access to more information does not necessarily lead to better decision making, according to a new study from Oracle. Though 83% of those surveyed agree that access to more data should make decisions ...

Dbt isn’t the only vendor to find that data quality is getting worse. Data observability vendor Monte Carlo published a report a year ago that came to a similar conclusion. The vendor’s State of Data ...

In this age of information, to say that the volume of data is exploding is a stark understatement. This big bang of big data is estimated to grow from 33 zettabytes in 2018 to 175 zettabytes by 2025, ...

The data landscape experienced significant changes in 2023, presenting new opportunities (and potential challenges) for data engineering teams. I believe we will see the following this year in the ...

In fact, storing data in Hadoop using those raw formats is terribly inefficient. Plus, those file formats cannot be stored in a parallel manner. Since you’re using Hadoop in the first place, it’s ...

First, we’ll define and demystify these terms. Second, I’ll share some key business use cases that cannot be solved with traditional relational data catalogs. Finally, I’ll wrap it up by getting ...

The data we have now is huge. But size, it turns out, is a relative thing. And according to the IDC, the sum of the world’s data – the DataSphere — will grow from 33 zettabytes in 2018 to a ...

With nearly half of the data and workloads in the cloud, managing cloud spending is the top challenge facing organizations, according to the latest report by Flexera, the company that specializes in ...

We’ve entered a period of punctuated equilibrium in the evolution of big data over the past month, thanks to community congregating around open table formats and metadata catalogs for storing data and ...

It’s possible that Marche was off a bit in his timing. For starters, schools have already started to respond to the plagiarism threat posed by ChatGPT, with bans in place in public school districts in ...