# Underuse of serverless compute for jobs and notebooks

Canonical: https://www.pointfive.co/efficiency-hub/inefficiencies/underuse-of-serverless-compute-for-jobs-and-notebooks

Databricks Serverless Compute is now available for jobs and notebooks, offering a simplified, autoscaled compute environment that eliminates cluster...

By: Matt Weingarten

Updated: 2026-09-28

[Cloud Efficiency Hub](https://www.pointfive.co/efficiency-hub) 

# Underuse of Serverless Compute for Jobs and Notebooks

The short version

Databricks Serverless Compute is now available for jobs and notebooks, offering a simplified, autoscaled compute environment that eliminates cluster provisioning, reduces idle overhead, and removes the need to manage instance types.

Matt Weingarten

Databricks service

[Databricks Serverless Compute](https://www.pointfive.co/efficiency-hub/cloud-services/databricks-serverless-compute)

Category

[Compute](https://www.pointfive.co/efficiency-hub/service-category/compute)

Reference

CER-0182

Type

Suboptimal Tier or SKU

## Explanation

Why the waste happens and who it affects.

For short-running, bursty, or interactive workloads, Serverless can significantly reduce cost by billing only for execution time. However, Serverless is not universally available or compatible with all workload types and libraries. Organizations that exclusively rely on traditional clusters may be missing emerging opportunities to reduce spend and simplify operations by leveraging Serverless where appropriate.

## Billing model

The pricing dimensions that drive this cost.

Databricks Serverless is billed based on:

Execution time only

Costs accrue only during active job runtime

- Databricks Units (DBUs): Based on usage, abstracted from specific VM types

- No direct infrastructure charges - Databricks manages the underlying infrastructure

Compared to traditional clusters, Serverless eliminates idle charges and provisioning overhead, and can reduce total compute spend for appropriate workloads.

## How to detect

4 checks to find it in your estate.

- Query system tables to identify jobs or notebooks that run on traditional clusters despite short runtimes or high idle time

- Review whether Serverless Jobs Compute is enabled and available in the workspace

- Assess workload compatibility with Serverless requirements and feature support

- Analyze historical cluster usage for patterns that suggest better alignment with Serverless

## How to fix

4 ways to remove the waste.

- Pilot Serverless for eligible workloads, such as short, periodic jobs or ad-hoc notebooks

- Use compute policies or templates to promote Serverless adoption where appropriate

- Retain traditional clusters for workloads with unsupported libraries or long-lived compute patterns

- Monitor performance and cost impact to guide incremental rollout and inform future defaults

## Documentation

Vendor references for pricing and configuration.

- [Run your Lakeflow Jobs with serverless compute for workflows  docs.databricks.com](https://docs.databricks.com/aws/en/jobs/run-serverless-jobs)

- [Databricks Pricing  databricks.com](https://www.databricks.com/product/pricing)

- [Serverless compute limitations  docs.databricks.com](https://docs.databricks.com/aws/en/compute/serverless/limitations)

- [Monitor the cost of serverless compute  docs.databricks.com](https://docs.databricks.com/aws/en/admin/system-tables/serverless-billing)

## Related inefficiencies

[Browse the library](https://www.pointfive.co/efficiency-hub)

- Databricks Serverless Compute  CER-0527

### [Performance-Optimized Serverless Mode for Non-Time-Sensitive Databricks Jobs](https://www.pointfive.co/efficiency-hub/inefficiencies/performance-optimized-serverless-mode-for-non-time-sensitive-databricks-jobs)

Serverless Lakeflow Jobs and Lakeflow pipelines can run in one of two performance modes. Performance-optimized mode, the default, keeps warm compute ready so work starts and runs faster. Standard mode uses less compute and starts within...

Compute

- Databricks Clusters  CER-0116

### [Lack of Graviton Usage in Databricks Clusters](https://www.pointfive.co/efficiency-hub/inefficiencies/lack-of-graviton-usage-in-databricks-clusters)

Databricks supports AWS Graviton-based instances for most workloads, including Spark jobs, data engineering pipelines, and interactive notebooks. These instances offer significant cost advantages over traditional x86-based VMs, with...

Compute

- Databricks Workflows  CER-0114

### [Inefficient Use of Job Clusters in Databricks Workflows](https://www.pointfive.co/efficiency-hub/inefficiencies/inefficient-use-of-job-clusters-in-databricks-workflows)

When multiple tasks within a workflow are executed on separate job clusters - despite having similar compute requirements - organizations incur unnecessary overhead. Each cluster must initialize independently, adding latency and cost. This...

Compute

---
Source: the public page above. Product screenshots and illustrative interfaces are examples, not live customer data.

