Gartner held their annual Data & Analytics Summit in Orlando last week, bringing together 5000 D&A leaders for three days of wisdom, conversation, and some good old-fashioned fun. 

It’s an exciting time for the data world and the event was buzzing. The keynote and sessions emphasized that the value of data is well understood, but AI is bringing new energy and promise to the field. What’s holding everyone back? Access to trusted data to put it all into action.

Our conversations at the Prophecy booth and in the hallways were centered around how to alleviate the bottleneck caused by data transformation - i.e., getting raw data into a state that’s ready for AI and analytics. To unlock data, organizations need to take a different approach - one that enables all data users in the business to transform data on their own. Our customers, including Johnson & Johnson, are leveraging Prophecy’s unique combination of visual development and cloud-ready code to do just that.

Johnson & Johnson’s Transformation Shines

Terry Bouziotis, the Senior Director, Data Engineering and Science, gave a great example of taking a new approach in his presentation “How J&J Unlocks Supply Chain Agility Through Self-Service Data Transformation”. 

Data is a critical part of J&J’s delivery of their medical devices and treatments. To bring together data from 270+ sources across the supply chain, the J&J data team created the Common Data Layer using Databricks. By combining these sources, the J&J team can evaluate end to end quality, see the impact of training, and understand and help mitigate risk.

But putting this into action, especially as the data continued to grow, was a challenge. The process to transform this data into data objects that are ready to power analytics was not keeping up with growth of the data and the demand for new insights. Using a traditional ‘business spec’ approach, it took dozens of steps and about several days to create a single data object. Much of the time was the back and forth defining and refining the spec between the business subject matter experts and the data engineers.
With Prophecy, J&J took a different approach. They were able to get the business experts to transform data themselves, reducing the needless back and forth with data engineers. The new process was down to less than ten steps in a fraction of the time.

The results have been dramatic. Terry reported in the session that in just 6 months the team has:

• Achieved a 60% reduction in data transformation costs
• Increased data pipeline creation speed by 150%
• Delivered 10x more data objects

And, more importantly, they unlocked supply chain data that helps J&J deliver their life changing products. 

The Future of Data Transformation…Is Fun!

Terry was not the only data superstar to join Prophecy at the conference. Former Gartner analyst Sanjeev Mohan and Ravit Jain from The Ravit Show! co-hosted a dinner with us for our friends in the data community on Monday night at Il Mulino. The food was excellent, surpassed only by the company and conversation!

The next day, Sanjeev and Ravit were back at the Prophecy booth with Prophecy CEO Raj Bains for a special episode of the Ravit Show, live from our booth!

Ravit and Raj discussed how Prophecy Data Copilot is applying generative AI to help people create pipelines and expressions with natural language and help everyone document and better understand their data transformations. Catch the full episode here.

As Raj laid out in his foundational whitepaper, The Future of Data Transformation, organizations need to take a new approach to meet the current moment and scale data, users, and pipelines. The future of data transformation is all about “giving superpowers to the data engineers, data scientists, and everyone working with data.”

Thanks for the great show Ravit!

Experience Prophecy

Prophecy customers are changing the game by getting everyone in the organization involved, bringing more people directly into data projects and delivering on a key pillar and theme for the conference:  collective intelligence.

See why Prophecy has a 4.8 rating on Gartner Peer Insights and why the Future of Data Transformation is already here.

‍Click here to request a personalized demo.