Databricks: Get ready for the "lakebase"
Today: Databricks floats a new portmanteau for the ever-evolving world of data infrastructure, a widespread Google Cloud outage takes down sites around the world, and the latest enterprise moves.
Last year at the Databricks Data & AI Summit Ghodsi pledged to bring Delta Lake and Iceberg together in a "USB-C format" for data. The communities behind both formats have made progress toward that goal, but the last mile is tricky, and new tools could let end users worry about other problems.
Companies working with vector databases have to balance performance, cost, and speed as they try to get apps into production. Pinecone's new update promises to thread that needle.
No one really agrees on a strict definition of "agent," but recent breakthroughs in large-language models have allowed companies to build enhanced versions of chatbots that can respond to natural-language queries with a plan of action.
Now that open data formats are here to stay, unifying them to remove incompatibilities will be a challenge. Delta Lake and Iceberg get all the attention, but tech developed by the creators of Hudi could make it happen.
Tech and media leaders are increasingly worried that the push to use generative AI to automate analytical business tasks could produce a generation of workers that never develop the foundation to do the job well at a senior level.
As Snowflake and Databricks gear up for back-to-back user conferences in early June, their customers are increasingly betting on open storage formats that give them new flexibility.
Rowan Trollope started work as the new CEO of Redis earlier this year in February, arguably a low point for enterprise tech growth. Redis hasn't been immune to those trends, but it has also enjoyed the spoils of the generative AI hype cycle.
The speed, flexibility, and efficiency provided by newer data tools have become much more important than simply dumping "Big Data" into a storage facility and running relatively simple analytical queries.