Matillion has launched Retrieval Augmented Generation (RAG) and pushdown AI components for Databricks – bringing AI and LLMs directly into data pipelines.
Ciaran Dynes, Chief Product Officer, Matillion, said: “Bringing our RAG and AI prompt components to general availability with Databricks is a huge step forward toward making the productivity benefits of GenAI available to every member of the data engineering team.
“GenAI presents an amazing opportunity for organizations to start making sense of their unstructured data. However, as always, the greatest challenge is still preparing the data for use. With Matillion AI, users can design using our no-code / low-code platform and 100% pushdown the running of the data pipelines to Databricks Data Intelligence Platform. With our new AI prompt component, data engineers can rapidly extract meaning from their data and combine it with existing data in their data warehouse on Databricks.”
Roger Murff, VP of Technology Partners, Databricks, said: “Together, we are enabling our customers to extract maximum value from their data while delivering true data intelligence on Databricks.
“We are bringing AI to data engineers while helping our customers become data and AI companies themselves.”
Matillion has a long-standing partnership with Databricks delivering integration and pushdown into its Databricks SQL data warehouse.
In March, Matillion launched its platform to unify pushdown ELT and pushdown GenAI to allow data engineers to build analytics and AI pipelines faster.
