Managed Service for Apache Spark (formerly Dataproc) pricing

Get hands-on experience with Managed Service for Apache Spark and Google Cloud with $300 in free credit and free monthly usage of 20+ products.

Managed Service for Apache Spark (formerly Dataproc) pricing

Pricing for Managed Service for Apache Spark depends on your chosen deployment mode: serverless or clusters.

Both models offer access to Lightning Engine, our next-generation vectorized execution engine that delivers up to 4.9x faster performance than open source Spark and up to 2x the price-performance over the leading high-speed Spark alternative.

Pricing Overview

Serverless: Pay only for the exact resources consumed during job execution (per-second billing). You can choose between standard and premium performance tiers. Compare serverless performance tiers in greater detail.
Clusters: Pay a flat management fee based on cluster uptime, Lightning Engine add-on (if selected), plus the cost of the underlying Compute Engine VMs and Persistent Disks.

For both deployment types, you pay for incurred Google Cloud Storage, BigQuery storage, and network egress charges.

Serverless pricing

With the serverless deployment model, you pay only for the resources you use. You are billed per second based on Data Compute Units (DCUs), shuffle storage, and any attached accelerators. Scale-to-zero ensures you never pay for idle capacity.

Serverless deployments offer two performance tiers to match your workload requirements:

Standard: Ideal for cost-effective batch processing, data transformations, and general-purpose Spark ETL.
Premium: Powered by Lightning Engine. Ideal for demanding workloads, interactive data science, and GPU-accelerated AI/ML.

Compare serverless performance tiers in greater detail

Note: The following rates are examples for the us-central1 region.

Data Compute Unit (DCU) pricing

The DCU rate shown below is an hourly / monthly rate. It is prorated and billed per second, with a 1-minute minimum charge.

Show discount options

Type	Default (USD) per hour ^*	BigQuery CUD - 1 Year^* (USD)	BigQuery CUD - 3 Year^* (USD)
Data Compute Unit (standard)	$0.06	$0.054	$0.048
Data Compute Unit (premium)	$0.089	$0.0801	$0.0712

^* Each consumption model has a unique ID. You may need to opt-in to be eligible for consumption model discounts. Click here to learn more.

If you pay in a currency other than USD, the prices listed in your currency on Cloud Platform SKUs apply.

Interactive workloads are charged at premium.

Shuffle storage pricing

The shuffle storage rate shown below is an hourly / monthly rate. It is prorated and billed per second, with a 1-minute minimum charge for standard shuffle storage and a 5-minute minimum charge for premium shuffle storage. Premium shuffle storage can only be used with premium compute unit.