Prophecy

Low-code data engineering for Spark and SQL

Series B
Palo Alto, CA
Founded 2017

About

Founded in 2017 and headquartered in San Diego, Prophecy is a low-code data transformation platform that generates production-quality Apache Spark code from a visual pipeline editor. Engineers drag and drop transformations and SQL nodes while the platform writes idiomatic Scala or PySpark code committed to Git—preserving full code ownership with no proprietary lock-in. Prophecy 3.0 added low-code SQL support to enable business analysts to self-serve data preparation alongside engineers. The platform runs on Databricks and all major clouds. Prophecy is backed by Databricks, Insight Partners, and SignalFire, and is trusted by Fortune 50 enterprises running thousands of ETL workloads. It competes with dbt Cloud and Matillion for transformation-layer workloads.

Products

  • Prophecy — AI-powered tool for visual data preparation and analysis with scalable cloud integration and enterprise governance.
    Customer sectors: business analysts, data engineers, enterprise teams
  • Prophecy Express — Rapid deployment offering guaranteeing your first production success within 90 days for enterprise teams.
    Customer sectors: enterprise teams, data leaders
  • Agentic Data Prep & Analysis — End-to-end solution turning raw data into trusted insights with visual workflows and AI on cloud platforms.
    Customer sectors: data analysts, enterprise IT, business intelligence
  • Enterprise Express — Entry-level enterprise offering to start and scale Prophecy usage company-wide with governance and support.
    Customer sectors: enterprise IT, data platform teams

Market research & competitive positioning

Source-backed TAM / SAM / SOM sizing, displacement analysis, and an interactive peer positioning map for Prophecy — available to members.

Related Companies

Other startups in Data Management Platforms