‍Prophecy Introduces Fully Governed Self-Service Data Preparation for Databricks SQL

‍PALO ALTO, Calif.—March 27, 2025—Analysts need clean, trusted data to fuel AI projects and inform their strategic decisions. Central data teams worry about keeping data safe and well-governed, and they never have time to prepare all the data the business needs. For large organizations, the disconnect between data analysts and data engineers is a constant source of frustration, delay, and missed opportunity.

Prophecy has the solution. Today, it launched Prophecy 4.0, the latest version of its AI-driven data integration platform for pipeline development, deployment, and automation. Optimized for organizations running Databricks SQL, Databricks’ serverless intelligent data warehouse, Prophecy 4.0 is the first data integration platform to address the needs of analysts in the business, delivering self-service, production-ready data preparation that operates within guardrails defined by central IT.

“Organizations have put their most valuable data assets into Databricks, and Prophecy 4.0 makes it easier than ever to make that data available to analysts,” said Roger Murff, VP of Technology Partners at Databricks. “And because Prophecy is natively integrated with the Databricks Data Intelligence Platform, platform teams get centralized visibility and control over user access, compute, costs, and more.”

Prophecy 4.0 introduces an intuitive new AI-powered interface designed specifically for data analysts, further simplifying data preparation while extending critical capabilities, including:

• Secure data loading from commonly used sources such as SFTP, SharePoint, Salesforce, and Excel or CSV files from analysts’ desktops
• Last-mile data operations, allowing analysts to seamlessly send results to Tableau and notify stakeholders via email
• Built-in automation with a drag-and-drop interface that lets analysts run and validate pipelines, without the need for separate tools

Prophecy empowers data platform teams at every step with governance-first capabilities that includes access controls, cost management, and standards for quality. 

The latest release strengthens this commitment with:

• Simplified version control, allowing analysts to easily share pipelines with expert data engineers who can refine and optimize them before deploying to production
• New, at-a-glance data profiles that drive users’ trust in data with visibility into data distribution, data completeness, and other key attributes
• Packages, which help enforce standardized, compliant pipelines while making it easy for users to assemble new workflows from reusable, governed components. 
• Preventing unexpected disruptions with real-time pipeline observability, ensuring analysts and engineers can track pipeline performance, detect failures early, and reduce downtime

In a recent survey of data executives, 50% of respondents said they struggled to hire data engineers, and 53% said they had trouble scaling their team to meet demand. No matter how hard they try, no matter how fast they hire, their efforts are never enough.

"Modern data environments are highly distributed, diverse, and dynamic. This is a challenge for enterprises, which increasingly want to give non-technical users easy access to corporate data. Solutions like Prophecy 4.0, which combine GenAI and no-code visual interfaces with a high degree of automation, can have a significant impact on enterprise performance by making self-serve data preparation available to non-technical users while maintaining strict control over permissions, cloud spend, and other important aspects of data governance," said Stewart Bond, Vice President, Data Intelligence and Integration Software, IDC.

In addition to its rich feature set, Prophecy 4.0’s unified architecture eliminates the rework and errors common with siloed systems. 

“We’ve visited companies where analysts would outline data workflows in their data prep tools and then engineers downstream would recode the entire pipeline from scratch with their ETL software. It was a huge waste of time and energy. With Prophecy 4.0, everything is done once. Analysts can design and publish pipelines whenever they want, with security, performance, and data access standards predefined by IT,” said Prophecy CEO Raj Bains.

For a deep dive into Prophecy 4.0, sign up for Prophecy’s webinar on April 24. Further details about Prophecy 4.0 are available on the Prophecy website.

About Prophecy
Prophecy is the world’s most advanced data integration platform, uniquely addressing the needs of analysts in the business while ensuring governance and compliance with guardrails set by central data platform teams. Native to Databricks, Prophecy empowers analysts to accelerate AI and analytics by simplifying and automating data preparation with cutting-edge AI-driven capabilities. Fortune 500 companies, including the largest institutions in banking, insurance, healthcare & life sciences, and technology, rely on Prophecy to deliver clean, trusted, and timely data at scale. By enabling self-service data transformation within an enterprise-wide governance framework, Prophecy makes all data users more productive, allowing them to seamlessly develop, deploy, and monitor data pipelines on cloud data platforms. Organizations trust Prophecy for the most demanding workloads, powering tens of thousands of pipelines that deliver massive volumes of data for AI and analytics.

Media Contacts
Chris Ulbrich
Firebrand Communications for Prophecy 
415-848-9175
prophecy@firebrand.marketing