REQUEST A DEMO
Image
Image

Complete Enterprise Product

Designed to make Data Engineering Teams exceed expectations and demands.

Provide business with Insights faster.

Group 67 Created with Sketch.
Image

TALENT TRANSFORMATION

Make your development, test and support team succeed on Spark.

Image

ACCELERATED SPEED

Accelerate your development and deployment process.

Prophecy Designer

Unique and intuitive design environment that helps you design superior workflows on Spark.

Image

Code = Visual IDE

Two views of Spark code in Git for different developers.

Image

Open Source

Spark code in Git is 100% open source.

Image

Component Framework

Standardized components that are extensible

Image

Interactive Debugging

Step-by-step interactive execution on Spark for development and debugging.

Image

Tests

Unit test, integration test and data quality test support.

Image

Prophecy Hub

Enterprise-grade Metadata system that gets you faster and smarter insights about your data assets.

Image

Manage All Assets

Store Organizational, Technical and Execution metadata with support for browsing, graph traversal and text search interfaces.

Image

Multi Spark Integration

We support multiple Hive and Spark metastores integrating data distribution and statistics into Prophecy Hub. We also integrate with external metastores such as on-prem Hadoop and AWS Glue catalog..

Image

Extensible

Use Prophecy Hub API to add new entities (such as datasets) and new aspects (such as schemas). We support adding custom aspects (json) to existing entities.

Image

Geo-distributed

Get a single view of your metadata across multiple clouds.

Image

Data Governance

Enhance governance and trust for your data.

Image

Column Level Lineage

View column level lineage at systems, project and workflow level. Per column, get the summary of transformations done on source data to produce its value.

Image

Tag Propagation

Propagate column level tags across data engineering pipelines to ensure that your sensitive data is appropriately tagged with privacy and security restrictions.

Image

Import External Sources

Add lineage for existing sources by running Prophecy Crawler on your Git repositories. We currently support Spark and Hive code.

Image

Cloud Execution

Image
Image

Simplified Cloud Execution

All clouds provide Spark service. Execution of data engineering workflows on these Spark services requires scheduling, clusters lifetime management, cluster sizing.

Multi-Cloud Support

Prophecy supports a single view across multiple execution Fabrics. The workflows can be run on different Fabrics when equivalent Datasets are present on these.

Fabrics

Fabric is our virtual equivalent of on-premise big data clusters. This allows you to have separate environments for test, integration and production. This is a basic unit that supports multi cloud and continuous deployment .

Secure Deployment

Prophecy can install on any Kubernetes, whether on premise or on public cloud as a Kubernetes Operator. In public cloud, we can run within your VPC, in addition to being available as a hosted service.

Group 56 Created with Sketch.

Agility with Continuous Integration & Deployment

Bring the speed of DevOps to Data Engineering with automation tools

Image

Continuous Integration

Unit Tests

We can auto-generate high coverage (90%+) unit tests for your existing workflows and accelerate writing new ones. Every modification (git commit) runs unit tests to maintain high quality of workflows.

Image

Continuous Deployment

Integration tests. Data quality tests.

We accelerate data quality tests (including auto-generation of suggested tests) that can ensure production of correct data for downstream tests, as well as warn no changes in data patters.

Image

Parallel runs

On promotion request, we run current and new workflows on the same data in parallel and give you data comparison, performance comparison, and downstream impact analysis of changed data columns to enable easy and fast promotion.

Image

Prophecy Transpiler

Convert legacy ETL workflows to Spark with high automation.

Prophecy Transpilers

Prophecy has transpilers, or cross compilers for formats and languages of Legacy ETL providers that provide highly automated modernization of your existing ETL workflows. Our expertise in moving multiple Enterprises allows you to move faster, more reliably and lower risk.

Image