Databricks SQL Warehouse Types: Serverless, Pro, and Classic Explained

Keebo Blog | Databricks SQL Warehouse Types

Databricks SQL is no longer “just Spark with a SQL layer.” It’s a warehouse‑style surface with serverless elasticity, opinionated governance defaults, and fast‑moving engine work aimed at BI concurrency.

Every Databricks SQL warehouse carries a type. That single field decides which execution features your queries can reach.

Most teams set it once and never look again. Then a dashboard gets slow, and the fix everyone reaches for is a bigger warehouse. Sometimes the real problem is that the warehouse cannot run the optimizations the query needs.

There are three types of Databricks SQL warehouses in general availability, plus a fourth in beta. This post covers what each type gives you and how sizing and scaling behave. It also shows how to read your own telemetry first.

What a Databricks SQL Warehouse Is

A SQL warehouse is a compute resource for querying data on Databricks. It backs the SQL editor, dashboards, alerts, and every business intelligence (BI) tool connected through a JDBC or ODBC endpoint.

Each warehouse has a size, a scaling range, an auto stop timer, a release channel, and a type. Size and scaling get most of the attention. Type is the field that quietly caps what the other three can do.

Comparing SQL Warehouse Types

FeatureClassicProServerless
Photon engineYesYesYes
Predictive I/ONoYesYes
Intelligent Workload ManagementNoNoYes
Typical startup time2 to 6 secondsAbout 4 minutesAbout 4 minutes
Compute locationYour cloud accountYour cloud accountDatabricks account
Default auto stop45 minutes45 minutes10 minutes
Minimum auto stop10 minutes10 minutes5 minutes in the UI
Source: Databricks SQL warehouse types documentation.

The startup row matters more than it looks. A pro warehouse sits idle for 45 minutes, then takes four minutes to wake up. A serverless warehouse resumes in seconds. Analysts feel that difference every morning.

SQL Serverless Warehouses

Serverless warehouses are the only type that supports Intelligent Workload Management, and they support Photon and Predictive I/O as well. In feature terms, serverless is the complete set.

Databricks positions serverless for extract, transform, and load (ETL) work, BI, and exploratory analysis. In practice, the workloads that gain most are the bursty ones. Morning dashboard refreshes, ad hoc analyst queries, and jobs with idle gaps all benefit. Each one pays the startup cost repeatedly.

Two behaviors distinguish serverless at runtime.

Admission is predictive. Intelligent Workload Management estimates what a query needs, then checks available capacity. Queries start when capacity exists and queue when it does not.

Autoscaling reacts in seconds, not minutes. When queue wait times climb, the autoscaler provisions additional clusters quickly. When demand falls, it releases them just as quickly.

Serverless is not universal. It requires a supported region, and some networking patterns rule it out. That is where pro warehouses earn their place.

SQL Serverless is best for:

  • Interactive BI dashboards with unpredictable traffic
  • Ad-hoc analysis with sporadic usage patterns
  • Development/testing environments
  • Workloads with frequent idle periods

Pro SQL Warehouses

Pro warehouses run in your own cloud account. You keep control of the networking, and the compute sits inside your virtual private cloud.

Pro supports Photon and Predictive I/O. It does not support Intelligent Workload Management, so scaling follows the older rules described below.

Choose Pro when one of these applies:

  • Your region does not offer serverless.
  • You need custom networking, private endpoints, or specific egress controls.
  • You query on-premises or external databases through Lakehouse Federation.
  • Your workspace still uses a legacy external Hive metastore.

Startup takes roughly four minutes. Plan the auto stop timer around that. Every wake-up is a four-minute wait for whoever opened the dashboard.

Classic SQL Warehouses

Classic warehouses also run in your cloud account and also take about four minutes to start. The difference is the feature list.

Classic supports Photon and nothing else. No Predictive I/O. No Intelligent Workload Management. Databricks describes it as entry-level performance intended for interactive data exploration.

If a Classic warehouse is serving production dashboards today, that is worth revisiting. The queries are running without an optimization layer that Pro and Serverless both include at no configuration cost.

Guidance for choosing Classic SQL Warehouses:

  • Budget is the primary constraint
  • Running simple SQL without complex transformations
  • Workload runs continuously for 8+ hours

Lakehouse Real-Time: The Fourth Option

Databricks offers a specialized serverless type in beta. Lakehouse Real-Time, written Lakehouse//RT, targets sub-second read queries at high concurrency.

It is built for serving analytical data to applications, operational analytics, and dashboards with hundreds to thousands of concurrent users. Sizes run from Small to X-Large.

The constraints are real:

  • Reads only. No INSERT, UPDATE, DELETE, MERGE, or DDL.
  • ANSI-compliant SQL only.
  • Queries run against Unity Catalog tables, with managed tables preferred.
  • Connections use the Statement Execution API.
  • No GEOGRAPHY or GEOMETRY types, no Python user-defined functions, and no row-level security.
  • You cannot upgrade an existing SQL warehouse into Lakehouse//RT.

It remains in beta, and Databricks states that performance characteristics and supported features will change before general availability. Treat it as a candidate for a serving layer, not a replacement for your analytics warehouses.

What Each Type Actually Unlocks

The comparison table is only useful if you know what the three features do.

Photon

Photon is the native vectorized query engine, written in C++ rather than running on the Java Virtual Machine. It processes data in columnar batches so modern CPUs can apply one instruction across many values.

Photon is enabled by default on all SQL warehouses. Databricks reports up to 5x better price and performance against industry-standard TPC-DS benchmarks.

Photon does not accelerate everything. Queries under about two seconds are dominated by planning overhead. User-defined functions, RDD APIs, and Dataset APIs fall back to the Spark runtime. Stateful streaming is unsupported.

Predictive I/O

Predictive I/O covers two distinct sets of optimizations.

For reads, it uses deep learning to predict which rows will match a filter. It then skips decoding columns and rows the query does not need. Less data leaves cloud storage, and less of it gets decoded.

For updates and deletes, it uses deletion vectors instead of rewriting whole files. A single-row change no longer forces a full file rewrite.

Predictive I/O requires Photon, and it requires a serverless or pro warehouse. This is the single clearest reason to move a classic warehouse.

Intelligent Workload Management

Intelligent Workload Management (IWM) is serverless only. It predicts the resources a new query needs and checks whether capacity exists.

If capacity exists, the query starts. If not, it queues. IWM watches the queue continuously and provisions more clusters when wait times grow. It releases capacity as soon as demand drops.

This is why serverless handles spiky concurrency well. Classic and pro warehouses scale on a slower, rule-based schedule.

Sizing and Scaling

Warehouse size sets the cluster shape. For classic and pro warehouses, the mapping is published.

Cluster SizeWorkers
2X-Small1
X-Small2
Small4
Medium8
Large16
X-Large32
2X-Large64
3X-Large128
4X-Large256
5X-Large512

Serverless uses the same size names. Databricks notes that instance types may differ, while the price-to-performance ratio stays comparable.

Size and scaling solve different problems. Size determines how fast a single large query runs. Scaling determines how many queries run at once. A slow report needs a bigger size. A queue needs more clusters.

Databricks recommends roughly one cluster for every 10 concurrent queries. The default for a new warehouse is a minimum and a maximum of one cluster, so concurrency is opt-in.

Classic and pro warehouses scale on fixed rules:

  • 2 to 6 minutes of estimated load adds 1 cluster.
  • 6 to 12 minutes adds 2 clusters.
  • 12 to 22 minutes adds 3 clusters.
  • Beyond 22 minutes, it adds 3 clusters plus 1 more per additional 15 minutes.
  • A query that waits 5 minutes in the queue triggers a scale-up.
  • Fifteen consecutive minutes of low demand triggers a scale-down.

The queue caps at 1,000 queries for every warehouse type.

Read those rules next to the serverless behavior. On a classic warehouse, a queued query can wait five minutes before scaling even begins. On serverless, IWM is already reacting.

Defaults to Be Aware Of

Databricks does not pick the same default everywhere.

ScenarioUI DefaultAPI Default
Region supports serverlessServerlessClassic
Region doesn’t support serverlessProClassic
Legacy external Hive metastoreProClassic

A warehouse built by hand and one built by Terraform can land on different types. Same workspace, different behavior. The API requires enable_serverless_compute: true alongside warehouse_type: pro to produce a serverless warehouse.

Set the type explicitly in every template and every script. Inherited defaults are how classic warehouses quietly accumulate.

The Setting That Never Stays Right

Picking a type is a one-time decision. Keeping a warehouse well configured is not.

Query mixes shift when a team ships a new dashboard. Concurrency patterns move when someone reschedules a job. Data volumes grow, cache hit rates fall, and the size that fit last quarter starts spilling. Nothing in the platform tells you the moment a configuration stopped matching the workload.

While manual optimization requires constant monitoring and adjustment, automated solutions like Keebo can dynamically optimize warehouse sizing and auto stop management, delivering significant cost savings without operational overhead.

Autonomous Warehouse Optimization with Keebo

Keebo treats warehouse configuration as a continuously tuned system rather than a fixed choice. Our agentic artificial intelligence (AI) engine reads how your workloads actually run. It then adjusts configuration in real time, inside your performance guardrails.

Keebo Warehouse Optimization continuously tunes Databricks SQL Serverless warehouses. Multi-layer guardrails hold performance steady while Databricks Unit efficiency improves.

Databricks SQL Warehouse FAQs

Can I Convert a Warehouse Into Lakehouse Real-Time?

No. Databricks documents that existing SQL warehouses cannot be upgraded to Lakehouse//RT.

How Many Clusters Do I Need?

Databricks suggests about one cluster per 10 concurrent queries. New warehouses default to a single cluster.

How Are SQL Warehouses Priced?

SQL Warehouses bill DBUs per second with a one-second minimum. Serverless bundles compute in the DBU rate. Pro and Classic add cloud instance costs. Auto-stop has minimum idle times, and idle periods still incur charges.