Confluent expands partnership with Databricks
Data streaming company Confluent has expanded its partnership with Databricks to help enterprises access real-time data for AI-driven decision-making. The expanded agreement will combine Confluent’s data streaming platform with Databricks’ Data Intelligent Platform to support the efficient development of AI applications.
Databricks CEO Ali Ghodsi said the partnership is aimed at addressing one of the major hurdles to the development of AI applications capable of enabling better decision-making and customer experiences — the divide between operating systems where data is generated and analytical systems where data is used to develop insights.
“For companies to maximise returns on their AI investments, they need their data, AI, analytics and governance all in one place,” he said. “As we help more organisations build data intelligence, trusted enterprise data sits at the centre. We are excited that Confluent has embraced Unity Catalog and Delta Lake as its open governance and storage solutions of choice, and we look forward to working together to deliver long-term value for our customers.”
To address these challenges, Databricks and Confluent have announced bi-directional integration between Confluent’s Tableflow with Delta Lake and Databricks’ Unity Catalog, an open governance system for data and AI.
Tableflow with Delta Lake makes operational data available immediately to Delta Lake’s ecosystem. The combined solution will support any engine or AI tool including Apache Spark, Trino, Polars, DuckDB and Daft.
Meanwhile custom integrations between Tableflow and Databricks’ Unity Catalog are said to ensure metadata is automatically applied to data exchanged between platforms, while Confluent’s Stream Governance suite will provide upstream governance and metadata to measure and ensure the quality of data used in Unity Catalog.
The combined capabilities aim to ensure Databricks data is easily accessible by any processor across the enterprise, to enable seamless integration between enterprise applications, analytics and governance.
Databricks unveils new suite of AI tools
Databricks' new AI tools are designed to assist enterprise customers in bringing AI agent...
Study finds one-third of tech professionals switched jobs in the past two years
Heavy workloads and long hours were cited as the top stressors for IT professionals, while firms...
Human error damaging productivity for Aussie IT teams
Research commissioned by Tanium suggests that 43% of Australian IT teams are spending up to three...
