Prophecy on Databricks Lakehouse accelerates data transformations to supercharge investment decisions
“Prophecy removes the engineering barriers that were blocking our ability to help our clients drive investment value with data. Now anyone on our team can go from data to insights much faster, without having to speak to a team of engineers.”
Equipped with a low-code data platform that all data users can use, Waterfall has fast-tracked data engineering workflows, reducing the time to prepare and transform data from up to 3 weeks to about ½ a day — a 42x performance gain.
The benefits of faster data engineering have been felt downstream, as business users (trade desk) are now receiving actionable data within 2 hours compared to 48 hours — a 24x improvement — when they were dependent on the engineering team.
And with repeatable frameworks in place, data pipelines can be standardized and easily shared across teams, reducing overall effort and operational errors.
With the tools in place for all data users to accelerate data onboarding, the data operations team has been able to shift their focus toward more strategic tasks like data governance in an effort to address data quality problems before they reach the end user. With Prophecy in place, it's clear that Waterfall’s focus on leveraging data to improve investment decisions is paying off and will continue to drive their business into the future.
