Our blog
Resources and insights
The latest industry news, interviews, technologies, and resources.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
We care about your data in our Privacy Policy.
Data Strategy
9
min read
12 Must-Have Skills for Data Analysts to Avoid Career Obsolescence
Discover the critical data analyst skills modern organizations demand, including both technical and soft skills.
Events + Announcements
7
min read
Prophecy vs. Databricks Lakeflow Designer
A practical guide for teams evaluating Prophecy and Lakeflow Designer
Events + Announcements
5
min read
Data + AI for everyone: highlights from the 2025 Databricks Summit
The hot topic? Access to data for all users
Events + Announcements
7
min read
Agent-Powered Pipeline Development: Designed for Humans, Built for Production
Prophecy’s latest release democratizes pipeline development with AI agents, keeps humans in the loop
Data Strategy
10
min read
How Data Domains Break the Cycle of Endless Analytics Backlogs
Discover how data domains replace centralized bottlenecks with distributed ownership. Stop waiting for data engineering teams.
Data Strategy
10
min read
From Data Mess to Business Success Through Strategic Data Curation
Learn how data curation turns your data from a cost center to a growth driver and enhances business success.
Data Strategy
8
min read
How to Stop Playing Data Detective and Build Lineage That Actually Works
Discover why data lineage implementations fail and the solutions that fix them.
Events + Announcements
5
min read
Get ready! AI agents, booth chats, and must-see Prophecy events at the 2025 Data + AI Summit
The Prophecy team will be everywhere at the Databricks Summit next week - make sure to catch us!
Events + Announcements
3
min read
Prophecy at Databricks Data + AI Summit 2025
Taming impossible data, agents and the impact of GenAI at our biggest data event of the year!
Data Governance
12
min read
Building a Self-Service Data Governance Framework in Databricks With Prophecy
Stop choosing between control and access. Learn how to build a robust Databricks governance framework that enables true self-service analytics without compromising security, powered by Prophecy.
Data Governance
9
min read
How Modern Self-Service Analytics Tools Are Empowering Non-Technical Users
Discover how self-service analytics tools are empowering non-technical users, enabling data access and insights without coding, streamlining decision-making.
Data Strategy
10
min read
Breaking Down Silos: 8 Ways to Build Data Literacy Between Technical and Business Teams
Discover 8 effective ways to build data literacy across business and technical teams, breaking down barriers and enhancing collaboration for data-driven success.
Prophecy for Databricks
5
min read
Unlocking Databricks for Data Analysts: Simplify Data Preparation with Prophecy
Prophecy and Databricks are redefining how teams build and manage data pipelines on Databricks SQL.
Events + Announcements
min read
Self-Service Data Preparation Without the Risk
Prophecy Introduces Fully Governed Data Preparation for Databricks SQL
Events + Announcements
5
min read
5 Takeaways from the Gartner Data & Analytics Summit
Prophecy and data leaders embrace the GenAI moment at Gartner 2025
Data Strategy
2
min read
The Five Dysfunctions of a Data Team
Data teams and analysts are inadvertently siloed into different parts of their organizations. These are the 5 data dysfunctions that breed this situation.
Data Engineering
9
min read
Data Pipelines: Optimize and Modernize Your Data Strategy
Explore best practices and modern examples in data pipeline strategy. Learn to boost business success with scalable and reliable data solutions.
Data Engineering
5
min read
Survey says… GenAI is reshaping data teams
Our new survey shows that data leaders are embracing GenAI and bracing for new challenges
Events + Announcements
4
min read
3 Ways to Connect with Prophecy at the Gartner Data & Analytics Summit!
Join the Prophecy team in Orlando to see how genAI is reshaping data teams
Events + Announcements
5
min read
Prophecy takes in $47M, to scale up and reimagine data integration with AI
ETL Modernization
5
min read
Five Predictions: Data Integration in 2025
The clock strikes noon on Shadow IT
ETL Modernization
5
min read
Gliding into the data wonderland
Bringing data teams together for the holidays
Events + Announcements
5
min read
Data Intelligence and AI Copilots at the Databricks World Tour
Accelerating data transformation with AI to deliver insights
Events + Announcements
4
min read
Success With AI Takes Data, Big Data!
Prophecy team was out in force at one of the data world’s biggest events
Prophecy for Databricks
5
min read
Load Data into Databricks Delta Lake in 5 Minutes
Discover how Prophecy revolutionizes your data operations.
Events + Announcements
4
min read
Delivering AI and Data Value at CDOIQ 2024
Prophecy attended the CDOIQ Symposium last week in Boston.
Prophecy for Databricks
6
min read
Airflow and Databricks: Shorten the Learning Curve with Prophecy
Maximize productivity without the complexity.
Events + Announcements
6
min read
Databricks Data + AI Summit 2024: AI Shapes a Copilot Future
Databricks held their annual Data+AI Summit in San Francisco last week at Moscone Center.
Events + Announcements
3
min read
AI, Copilot and Authors at Databricks Data and AI Summit 2024
Prophecy’s booth will be hopping with book signings, Copilots, and the latest on data and AI
Data Integration Platform
4
min read
The Case for Data Transformation Copilots
How copilots will change data transformation, and in the process evolve beyond conversational interfaces
Events + Announcements
5
min read
AI, the Texas Rangers, and Aetion at Databricks Data + AI Summit 2024
Prophecy brings championship winning data, critical healthcare data, and AI for data transformation to DAIS 2024
Data Integration Platform
3
min read
Data engineers and business data users: end the back-and-forth
We’ve written before about the challenge of having too few data engineers. There is another problem.
Events + Announcements
5
min read
Announcing Prophecy University
Inaugural course addresses the growing data engineering skills gap through agile, self-paced training
Events + Announcements
4
min read
Gartner Data & Analytics Summit 2024 - that’s a wrap!
Johnson & Johnson takes center stage with Prophecy
Data Integration Platform
5
min read
Too much data work. Too few data engineers. How to make it scale.
Struggling with data transformation? Hiring more data engineers is not the answer. Learn how low-code data transformation unlocks the full potential of your users and your data.
Events + Announcements
5
min read
Johnson & Johnson Takes Center Stage with Prophecy at Gartner Data & Analytics 2024
Join us in Orlando to witness the future of data transformation
Events + Announcements
3
min read
Webinar spotlight – The future of data transformation
Join our webinar and see why self-service is the future of data transformation, through unified visual & code technology
Events + Announcements
3
min read
Modern Data’s Stuck
Events + Announcements
3
min read
Prophecy at Databricks Data+AI World Tour: Empowering Data Democratization #DAIWT
Join us in this exciting journey and discover how Prophecy's self-service solutions are revolutionizing the data landscape.
Events + Announcements
5
min read
Announcing Prophecy Package Builder and Package Hub: Data engineering, standardized.
With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Prophecy Package Builder and Prophecy Package Hub.
Data Integration Platform
5
min read
Prompt engineering vs. fine tuning: Which approach is right for your enterprise generative AI strategy?
In this blog, we'll take a look at the differences between prompt engineering and fine-tuning, and provide insights into each approach
Data Integration Platform
3
min read
Enterprise data and the taming of the Generative AI frontier
Companies can train small, domain-specific language models in a matter of hours or days rather than weeks or months provided they have governed and accurate training inputs.
Data Integration Platform
4
min read
SQL models are easy to deploy and orchestrate with Prophecy
Stop getting stuck managing SQL files, start making progress for your business today
ETL Modernization
6
min read
Understanding ETL Modernization
Everything you need to know to accelerate ETL modernization
Events + Announcements
4
min read
Prophecy and all things Data + AI Summit - that’s a wrap!
Get an exciting recap from Databricks Data + AI summit including Prophecy’s announcements around low-code data engineering and generative AI app development
Data Integration Platform
8
min read
How HealthVerity leverages Prophecy for unmatched data privacy and compliance
Data Integration Platform
9
min read
Introducing the Prophecy Generative AI Platform
Build powerful gen AI applications on private enterprise data in just hours
Data Integration Platform
5
min read
Introducing Prophecy Data Copilot
Unlock the power of generative AI in data engineering with Prophecy’s Data Copilot.
Events + Announcements
10
min read
Prophecy at Data + AI Summit
Top 10 reasons to visit Prophecy at Data + AI Summit 2023
Events + Announcements
8
min read
Webinar spotlight — Moneyball: How the Texas Rangers use low-code data engineering and analytics to identify MVPs
Join this webinar to learn how the Texas Rangers are creating a competitive advantage in professional baseball by using data analytics and AI to improve player performance and evaluate new talent.
Data Integration Platform
2
min read
Getting started with low-code
Let's create a pipeline using Prophecy's visual, low-code interface for Spark.
Data Integration Platform
5
min read
Use Spark interims to troubleshoot and polish low-code Spark pipelines: Part 2
In Part 1, we learned an easy way to troubleshoot a data pipeline using historical, read-only metadata. Now, I want to dig in and polish my individual spark data frames.
Data Integration Platform
6
min read
Getting started with low-code SQL
Empowering business data users to quickly and easily build scalable data pipelines on the lakehouse
Prophecy for Databricks
3
min read
Data engineering for the data lakehouse: Four guiding principles
A rising number of enterprises are adopting the lakehouse to unite their analytics projects and foster innovation on a shared, cloud-based platform.
ETL Modernization
5
min read
3 ways Prophecy modernizes ETL on Databricks
By modernizing the ETL process on Databricks, Prophecy can provide organizations with a more agile, scalable, and cost-effective solution for managing their data.