Data Intelligence and AI Copilots at the Databricks World Tour

Data Intelligence and AI Copilots at the Databricks World Tour

Accelerating data transformation with AI to deliver insights

Accelerating data transformation with AI to deliver insights

Matt Turner
Assistant Director of R&D
Texas Rangers Baseball Club
October 29, 2024

Table of Contents

The Prophecy team kicked off a busy fall at the Databricks World Tour stops in London and New York. The events were buzzing with overflowing keynotes, great sessions, and Data Intelligence: putting AI to work for all your data.

As we gear up for the next leg of the tour, we’re looking forward to continuing the conversations and seeing everyone in Munich, Chicago, Amsterdam, and Atlanta.

Delivering data intelligence

At the NYC keynote, Naveen Rao, VP of AI at Databricks, made the strong case for data intelligence as organizations start to leverage generative AI. "GenAI applications need to understand your enterprise data — and they need to produce high-quality outputs that are well-governed and continuously evaluated for accuracy."

Data transformation is a big part of that vision. Organizations have made great strides in bringing diverse data together in the Databricks Data Intelligence Platform. However, many teams still struggle to get to the clean, trusted, and timely data they need.

Migrating from legacy ETL to Databricks

Prophecy Data Transformation Copilot bridges the data engineering gap with AI and helps everyone deliver data intelligence.

Drew Davis, Data & Analytics Manager at Amgen’s Finance Insights Technology group, shared his team’s journey at the New York event. His team delivers key financial data across Amgen, providing insights that impact operations and research.

To improve their data delivery, the team moved from using spreadsheets to workflows with Alteryx linked to other data tools. This helped them deliver insights, but with disjointed systems, the need for manual security, and the requirement for specialized skills meant the team couldn’t keep up with new demands for data. To consolidate systems and speed data delivery, the team planned to modernize their platform with Databricks. However, to make the switch, they needed to migrate the existing Alteryx workflows and manually coding them was taking too much time and threatening the cutover date. 

To speed the process, the team turned to Prophecy. With visual and AI copilot pipeline development, the team was able to rapidly recreate key Alteryx workflows. And with Prophecy’s Data Migration Copilot, they could automatically migrate Alteryx workflows to Spark, greatly speeding the migration. With Prophecy, the team was able meet their cutover date and fully leverage Databricks. They are now seeing 20% or more faster data processing and doubling KPI update rates, improving financial insights and aiding the development of treatments.

Catch Drew’s full story in this webinar.

Data Transformation Copilot in London

Prophecy’s Martin Caley and Matt Darwin took to the stage in London to share how Prophecy Data Transformation Copilot is changing how Fortune 500 companies tackle data transformation and deliver the clean, trusted, timely data they need to better serve customers, improve efficiency, and comply with regulations. 

With an interactive session and demo, Martin and Matt shared how customers like CZ, the Netherlands second largest insurance provider, are using Prophecy to speed their modernization to Databricks and enable all data users.

With an intuitive visual interface, powerful AI, and compiler technology, Prophecy enables all Databricks users - data engineers, data analysts and data scientists to be more productive.

Connecting with the Databricks community

The Prophecy teams weren’t just on the stage. At our booths in London and New York we connected with partners, customers and friends. And we stepped out with the Databricks community, hosting happy hours in New York and London with our partners Anamalo and CelebalTech.

See you at the next stop

Join us at the upcoming Databricks Data + AI World Tour events in Munich, Chicago, Amsterdam, and Atlanta to discover how you can revolutionize your data pipelines and unlock new possibilities for your organization.

Ready to give Prophecy a try?

You can create a free account and get full access to all features for 21 days. No credit card needed. Want more of a guided experience? Request a demo and we’ll walk you through how Prophecy can empower your entire data team with low-code ETL today.

Ready to give Prophecy a try?

You can create a free account and get full access to all features for 14 days. No credit card needed. Want more of a guided experience? Request a demo and we’ll walk you through how Prophecy can empower your entire data team with low-code ETL today.

Get started with the Low-code Data Transformation Platform

Meet with us at Gartner Data & Analytics Summit in Orlando March 11-13th. Schedule a live 1:1 demo at booth #600 with our team of low-code experts. Request a demo here.

Related content

PRODUCT

A generative AI platform for private enterprise data

LıVE WEBINAR

Introducing Prophecy Generative AI Platform and Data Copilot

Ready to start a free trial?

Visually built pipelines turn into 100% open-source Spark code (python or scala) → NO vendor lock-in
Seamless integration with Databricks
Git integration, testing and CI/CD
Available on AWS, Azure, and GCP
Try it Free

Lastest blog posts

Events

Success With AI Takes Data, Big Data!

Matt Turner
October 7, 2024
October 7, 2024
October 7, 2024
ETL modernization

Weigh Your Options As You Move Off Alteryx

Raj Bains
November 18, 2024
November 18, 2024
November 18, 2024
Data Lakehouse

Load Data into Databricks Delta Lake in 5 Minutes

Shashank Mishra
August 29, 2024
August 29, 2024
August 29, 2024