The current approach to data pipeline development is like the “Wild West'' and simply isn't working. Why? Data practitioners have lacked a way to leverage standardized data operations, such as transformations and jobs. Data platform teams have lacked a way to easily create and share standard operations with upstream users. 

The result:  Longer pipeline development times. Increased maintenance. And constant exception-handling as data engineers work to fix issues caused by the use of non-standard operations.

Say goodbye to the wild west. Say hello to data engineering, standardized.

With the release of Prophecy 3.2, we are thrilled to announce two game-changing capabilities: Package Builder and Package Hub. Together, these innovations are designed to revolutionize how you manage and develop your data pipelines, making data operations standardized, efficient, and scalable for the entire company.

Standardization for data teams - out of the box

Data platform teams need an easier way to enable data practitioners to develop data pipelines efficiently and in a standardized way. But how do we get there? By establishing standards and automation, facilitating collaboration, and promoting efficiency. 

With Package Builder, engineering teams gain an intuitive tool for standardized creation of packaged operations, including transformations, jobs, and functions. You can now easily reuse code and enforce best practices across your data operations, eliminating manual and error-prone processes. 

You can then securely share the package through Package Hub — boosting cross-team collaboration and driving standardization of coding best practices across your organization. 

Package Builder and Package Hub offer a range of benefits, including:

• Streamlined pipeline development: Effortlessly create packages, reuse code for diverse use cases, and ensure adherence to coding best practices.
• Enhanced collaboration: Say goodbye to firefighting as Package Hub fosters cross-team collaboration, improving productivity and goal achievement.
• Enforcement of software best practices: Packages are built with high quality code that is reusable across projects.

Ready to learn more?

To dive deeper into Package Builder and Package Hub, please check out the following resources:

• Documentation - Walk through a step-by-step guide on getting started with Prophecy Package Builder and Package Hub.
• Architecture guide - Gain a deeper understanding of the underlying infrastructure that powers Prophecy's data transformation platform.
• 21-day trial - Take the first step toward elevating your data operations to new heights.