The only agent that thinks for itself

Autonomous Monitoring with self-learning AI built-in, operating independently across your entire stack.

Unlimited Metrics & Logs
Machine learning & MCP
5% CPU, 150MB RAM
3GB disk, >1 year retention
800+ integrations, zero config
Dashboards, alerts out of the box
> Discover Netdata Agents

Centralized metrics streaming and storage

Aggregate metrics from multiple agents into centralized Parent nodes for unified monitoring across your infrastructure.

Stream from unlimited agents
Long-term data retention
High availability clustering
Data replication & backup
Scalable architecture
Enterprise-grade security
> Learn about Parents

Fully managed cloud platform

Access your monitoring data from anywhere with our SaaS platform. No infrastructure to manage, automatic updates, and global availability.

Zero infrastructure management
99.9% uptime SLA
Global data centers
Automatic updates & patches
Enterprise SSO & RBAC
SOC2 & ISO certified
> Explore Netdata Cloud

Deploy Netdata Cloud in your infrastructure

Run the full Netdata Cloud platform on-premises for complete data sovereignty and compliance with your security policies.

Complete data sovereignty
Air-gapped deployment
Custom compliance controls
Private network integration
Dedicated support team
Kubernetes & Docker support
> Learn about Cloud On-Premises

Powerful, intuitive monitoring interface

Modern, responsive UI built for real-time troubleshooting with customizable dashboards and advanced visualization capabilities.

Real-time chart updates
Customizable dashboards
Dark & light themes
Advanced filtering & search
Responsive on all devices
Collaboration features
> Explore Netdata UI

Monitor on the go

Native iOS and Android apps bring full monitoring capabilities to your mobile device with real-time alerts and notifications.

iOS & Android apps
Push notifications
Touch-optimized interface
Offline data access
Biometric authentication
Widget support
> Download apps

The future of infrastructure observability

See our strategic direction across AI-native observability, full-stack signals, operational intelligence, and enterprise platform maturity.

AI-native observability
Full-stack signal coverage
Operational intelligence
Enterprise platform maturity
Agent releases every 6 weeks
Cloud continuous delivery
> Explore Product Roadmap

Best energy efficiency

True real-time per-second

100% automated zero config

Centralized observability

Multi-year retention

High availability built-in

Zero maintenance

Always up-to-date

Enterprise security

Complete data control

Air-gap ready

Compliance certified

Millisecond responsiveness

Infinite zoom & pan

Works on any device

Native performance

Instant alerts

Monitor anywhere

AI-native observability

Continuous delivery

Open source foundation

80% Faster Incident Resolution

AI-powered troubleshooting from detection, to root cause and blast radius identification, to reporting.

True Real-Time and Simple, even at Scale

Linearly and infinitely scalable full-stack observability, that can be deployed even mid-crisis.

90% Cost Reduction, Full Fidelity

Instead of centralizing the data, Netdata distributes the code, eliminating pipelines and complexity.

See and Map Your Entire Network

Live topology, flow analytics, and SNMP device and trap monitoring — unified with your full-stack observability.

Control Without Surrender

SOC 2 Type 2 certified with every metric kept on your infrastructure.

Integrations

800+ collectors and notification channels, auto-discovered and ready out of the box.

800+ data collectors
Auto-discovery & zero config
Cloud, infra, app protocols
Notifications out of the box
> Explore integrations
Real Results
46% Cost Reduction

Reduced monitoring costs by 46% while cutting staff overhead by 67%.

— Leonardo Antunez, Codyas

Zero Pipeline

No data shipping. No central storage costs. Query at the edge.

From Our Users
"Out-of-the-Box"

So many out-of-the-box features! I mostly don't have to develop anything.

— Simon Beginn, LANCOM Systems

No Query Language

Point-and-click troubleshooting. No PromQL, no LogQL, no learning curve.

Enterprise Ready
67% Less Staff, 46% Cost Cut

Enterprise efficiency without enterprise complexity—real ROI from day one.

— Leonardo Antunez, Codyas

SOC 2 Type 2 Certified

Zero data egress. Only metadata reaches the cloud. Your metrics stay on your infrastructure.

Full Coverage
800+ Collectors

Auto-discovered and configured. No manual setup required.

Any Notification Channel

Slack, PagerDuty, Teams, email, webhooks—all built-in.

Built for the People Who Get Paged

Because 3am alerts deserve instant answers, not hour-long hunts.

Every Industry Has Rules. We Master Them.

See how healthcare, finance, and government teams cut monitoring costs 90% while staying audit-ready.

Monitor Any Technology. Configure Nothing.

Install the agent. It already knows your stack.
From Our Users
"A Rare Unicorn"

Netdata gives more than you invest in it. A rare unicorn that obeys the Pareto rule.

— Eduard Porquet Mateu, TMB Barcelona

99% Downtime Reduction

Reduced website downtime by 99% and cloud bill by 30% using Netdata alerts.

— Falkland Islands Government

Real Savings
30% Cloud Cost Reduction

Optimized resource allocation based on Netdata alerts cut cloud spending by 30%.

— Falkland Islands Government

46% Cost Cut

Reduced monitoring staff by 67% while cutting operational costs by 46%.

— Codyas

Real Coverage
"Plugin for Everything"

Netdata has agent capacity or a plugin for everything, including Windows and Kubernetes.

— Eduard Porquet Mateu, TMB Barcelona

"Out-of-the-Box"

So many out-of-the-box features! I mostly don't have to develop anything.

— Simon Beginn, LANCOM Systems

Real Speed
Troubleshooting in 30 Seconds

From 2-3 minutes to 30 seconds—instant visibility into any node issue.

— Matthew Artist, Nodecraft

20% Downtime Reduction

20% less downtime and 40% budget optimization from out-of-the-box monitoring.

— Simon Beginn, LANCOM Systems

Pay per Node. Unlimited Everything Else.

One price per node. Unlimited metrics, logs, users, and retention. No per-GB surprises.

Free tier—forever
No metric limits or caps
Retention you control
Cancel anytime
> See pricing plans

What's Your Monitoring Really Costing You?

Most teams overpay by 40-60%. Let's find out why.

Expose hidden metric charges
Calculate tool consolidation
Customers report 30-67% savings
Results in under 60 seconds
> See what you're really paying

Your Infrastructure Is Unique. Let's Talk.

Because monitoring 10 nodes is different from monitoring 10,000.

On-prem & air-gapped deployment
Volume pricing & agreements
Architecture review for your scale
Compliance & security support
> Start a conversation

Monitoring That Sells Itself

Deploy in minutes. Impress clients in hours. Earn recurring revenue for years.

30-second live demos close deals
Zero config = zero support burden
Competitive margins & deal protection
Response in 48 hours
> Apply to partner

Per-Second Metrics at Homelab Prices

Same engine, same dashboards, same ML. Just priced for tinkerers.

Community: Free forever · 5 nodes · non-commercial
Homelab: $90/yr · unlimited nodes · fair usage
> Get the Homelab Plan

$1,000 Per Referral. Unlimited Referrals.

Your colleagues get 10% off. You get 10% commission. Everyone wins.

10% of subscriptions, up to $1,000 each
Track earnings inside Netdata Cloud
PayPal/Venmo payouts in 3-4 weeks
No caps, no complexity
> Get your referral link
Cost Proof
40% Budget Optimization

"Netdata's significant positive impact" — LANCOM Systems

Calculate Your Savings

Compare vs Datadog, Grafana, Dynatrace

Savings Proof
46% Cost Reduction

"Cut costs by 46%, staff by 67%" — Codyas

30% Cloud Bill Savings

"Reduced cloud bill by 30%" — Falkland Islands Gov

Enterprise Proof
"Better Than Combined Alternatives"

"Better observability with Netdata than combining other tools." — TMB Barcelona

Real Engineers, <24h Response

DPA, SLAs, on-prem, volume pricing

Why Partners Win
Demo Live Infrastructure

One command, 30 seconds, real data—no sandbox needed

Zero Tickets, High Margins

Auto-config + per-node pricing = predictable profit

Homelab Ready
Free Video Course

8-episode Netdata tutorial by LearnLinux.tv

76k+ GitHub Stars

3rd most starred monitoring project

Worth Recommending
Product That Delivers

Customers report 40-67% cost cuts, 99% downtime reduction

Zero Risk to Your Rep

Free tier lets them try before they buy

AI Support Assistant, Available 24/7

Nedi has access to all official documentation, source code, and resources. Ask any question about Netdata—responds in your language.

Deployment & configuration
Troubleshooting & sizing
Alerts & notifications
Evidence-based answers
> Ask Nedi now

Never Fight Fires Alone

Docs, community, and expert help—pick your path to resolution.

Learn.netdata.cloud docs
Discord, Forums, GitHub
Premium support available
> Get answers now

60 Seconds to First Dashboard

One command to install. Zero config. 850+ integrations documented.

Linux, Windows, K8s, Docker
Auto-discovers your stack
> Read our documentation

76,000+ Engineers Strong

615+ contributors. 1.5M daily downloads. One mission: simplify observability.

Per-Second. 90% Cheaper. Data Stays Home.

Side-by-side comparisons: costs, real-time granularity, and data sovereignty for every major tool.

See why teams switch from Datadog, Prometheus, Grafana, and more.

> Browse all comparisons
Edge-Native Observability, Born Open Source
Per-second visibility, ML on every metric, and data that never leaves your infrastructure.
Founded in 2016
615+ contributors worldwide
Remote-first, engineering-driven
Open source first
> Read our story
Promises We Publish—and Prove
12 principles backed by open code, independent validation, and measurable outcomes.
Open source, peer-reviewed
Zero config, instant value
Data sovereignty by design
Aligned pricing, no surprises
> See all 12 principles
Edge-Native, AI-Ready, 100% Open
76k+ stars. Full ML, AI, and automation—GPLv3+, not premium add-ons.
76,000+ GitHub stars
GPLv3+ licensed forever
ML on every metric, included
Zero vendor lock-in
> Explore our open source
Build Real-Time Observability for the World
Remote-first team shipping per-second monitoring with ML on every metric.
Remote-first, fully distributed
Open source (76k+ stars)
Challenging technical problems
Your code on millions of systems
> See open roles
Meet the Team Behind Netdata
Conferences, meetups, and tradeshows where you can see Netdata in action and talk to the engineers who build it.
Live demos and deep dives
Book 1-on-1 meetings
Talks and panel sessions
Event recaps and photos
> See all events
Talk to a Netdata Human in <24 Hours
Sales, partnerships, press, or professional services—real engineers, fast answers.
Discuss your observability needs
Pricing and volume discounts
Partnership opportunities
Media and press inquiries
> Book a conversation
Your Data. Your Rules.
On-prem data, cloud control plane, transparent terms.
Trust & Scale
76,000+ GitHub Stars

One of the most popular open-source monitoring projects

SOC 2 Type 2 Certified

Enterprise-grade security and compliance

Data Sovereignty

Your metrics stay on your infrastructure

Validated
University of Amsterdam

"Most energy-efficient monitoring solution" — ICSOC 2023, peer-reviewed

ADASTEC (Autonomous Driving)

"Doesn't miss alerts—mission-critical trust for safety software"

Community Stats
615+ Contributors

Global community improving monitoring for everyone

1.5M+ Downloads/Day

Trusted by teams worldwide

GPLv3+ Licensed

Free forever, fully open source agent

Why Join?
Remote-First

Work from anywhere, async-friendly culture

Impact at Scale

Your work helps millions of systems

$ guides / pgbouncer / pgbouncer-wait-time-vs-query-time ▌

Operations Guides

PgBouncer wait time vs query time: is it the pool or the database?

Your application is slow. PgBouncer sits between the application and PostgreSQL, so the first question is always the same: is the latency coming from the pool itself, or from the database behind it? Operators routinely get this split wrong. They see high end-to-end latency, blame PostgreSQL, spend an hour in pg_stat_statements, and then discover avg_query_time was 5ms the whole time while avg_wait_time was 2000ms. The database was fast. The pool was too small.

PgBouncer exposes exactly the two numbers needed to answer this question, and they measure different things. avg_wait_time is queuing delay injected by PgBouncer: time clients spend in the wait queue before a server connection is assigned. avg_query_time is PostgreSQL execution time as seen by PgBouncer: from sending the query to the backend until the complete response comes back. Reading only one of them guarantees a wrong diagnosis. Reading them together, plus avg_xact_time, resolves the attribution in one command.

This article is the working reference for that split: what each metric actually measures, the decision matrix for assigning blame, and the checks to confirm before you touch pool_size or start hunting slow queries.

What this means

Every request through PgBouncer has two latency phases:

  1. Queue phase. The client has sent a query but no server connection is free. It waits in a FIFO queue until one becomes available. PgBouncer accumulates this as wait time. In a healthy deployment this phase is effectively zero.
  2. Execution phase. The client has a server connection and its query runs on PostgreSQL. This is query time, and it includes the network round trip between PgBouncer and the backend.

The two phases are causally linked but owned by different components:

  • High wait time + low query time. The database is executing fast, but all server connections are busy so clients queue. The pool is undersized, or connections are being held too long. Fix on the PgBouncer side: raise pool_size, or find what is holding connections.
  • Low wait time + high query time. Clients get a server connection immediately, then sit waiting on PostgreSQL. The pool is fine. Fix on the PostgreSQL side: slow queries, lock contention, I/O saturation.
  • Both high. Usually a cascade: slow queries hold connections longer, the pool saturates, and queuing begins. The root cause is PostgreSQL, but the visible symptom includes queue depth. Fix PostgreSQL first; do not raise pool_size to absorb a backend problem, that just moves the queue into the database.
  • avg_xact_time much larger than avg_query_time. The gap is idle-in-transaction time: clients hold a server connection between statements while doing application work. This looks like “pool too small” but the fix is application behavior, not pool size.

One version caveat that changes how you read avg_wait_time: before PgBouncer 1.23.0 the calculation did not divide by the number of clients, so it reported something closer to “wait time per second” than a true average. Values could be absurdly large and were not comparable across deployments. The fix shipped in 1.23.0 (PR #727), which also added total_server_assignment_count and avg_server_assignment_count to SHOW STATS as the denominator. On versions older than 1.23.0, treat avg_wait_time with suspicion and use maxwait from SHOW POOLS as your primary wait signal.

A second caveat on avg_query_time: PgBouncer does not parse SQL, so BEGIN and COMMIT count as separate queries. A transaction of BEGIN, one 30ms SELECT, COMMIT is counted as three queries, which inflates query count and deflates avg_query_time. When the numbers do not line up with what PostgreSQL reports, check avg_xact_time instead. Confirmed by GitHub issue #959.

Common causes

CauseWhat it looks likeFirst thing to check
Pool undersized for the workloadavg_wait_time high, avg_query_time normal, sv_active = pool_size, cl_waiting > 0SHOW POOLS: sv_active vs pool_size per (database, user)
Slow backend (indexes, locks, I/O)avg_query_time elevated, avg_wait_time low or rising as a consequencepg_stat_statements / pg_stat_activity on PostgreSQL
Idle-in-transaction holding connectionsavg_xact_time » avg_query_time, sv_active high but PostgreSQL shows “idle in transaction”pg_stat_activity WHERE state = ‘idle in transaction’
Long transactions in session modesv_active reflects long-held sessions, wait time grows under loadSHOW SERVERS: active connections with old request_time
server_reset_query overheadavg_query_time mildly elevated with no slow queries visibleIs DISCARD ALL slow on this backend (many temp tables)?
PgBouncer event loop saturationAll metrics confusing, admin console slow, one CPU core at 100%top -p $(pgrep pgbouncer); time SHOW LISTS
Administrative PAUSEcl_waiting spikes, sv_active drops to zeroSHOW DATABASES: paused/disabled columns

Quick checks

All read-only. Run against the admin console:

# The core split: averages per database (stable column layout)
psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -Atc "SHOW STATS_AVERAGES;"

# Current queue state per pool: cl_waiting, sv_active, sv_idle, maxwait
psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -Atc "SHOW POOLS;"

# Which server connections are held and for how long (request_time on active)
psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -Atc "SHOW SERVERS;"

# Confirm the database is not administratively paused or disabled
psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -Atc "SHOW DATABASES;"

# PgBouncer version: avg_wait_time semantics changed in 1.23.0
psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -Atc "SHOW VERSION;"

# Event loop health: admin console should answer in well under 50ms
time psql -h /var/run/postgresql -p 6432 -U pgbouncer pgbouncer -c "SHOW LISTS;" > /dev/null

Notes on reading the output:

  • Values in SHOW STATS_AVERAGES are per-second rates (counts) and microseconds (times), averaged over stats_period (default 60s). Short spikes get smoothed.
  • Reference SHOW STATS columns by name, not position. Column positions shift across versions (1.23 added server_assignment_count, 1.24 added prepared statement counters). SHOW STATS_AVERAGES has a simpler, more stable layout.
  • Total counters (total_query_time, total_wait_time, total_xact_count) are cumulative since startup and reset on restart. Prefer the avg_* columns, or compute deltas between two samples yourself, e.g. delta(total_query_time) / delta(total_query_count).

How to diagnose it

  1. Rule out administrative state first. Check SHOW DATABASES for paused = 1 or disabled = 1. During PAUSE, cl_waiting spikes and sv_active drops to zero by design. Every other signal is meaningless until you confirm normal operation.
  2. Check PgBouncer itself. Time an admin console command. If SHOW LISTS takes more than about 200ms, the single-threaded event loop is strained and every metric downstream is suspect. Check process CPU: PgBouncer pinned at 100% of one core distorts both wait and query time. Normal is under 5%.
  3. Pull the three averages. From SHOW STATS_AVERAGES, compare wait_time, query_time, and xact_time per database. Convert microseconds to milliseconds before comparing; mixing units is a common source of wrong conclusions.
  4. Apply the decision matrix below to assign the latency to pool, database, or transaction shape.
  5. Confirm on the second component. If the matrix says “pool,” verify with SHOW POOLS: sv_active at pool_size, sv_idle at zero, cl_waiting above zero, maxwait climbing. If it says “database,” verify on PostgreSQL with pg_stat_activity and pg_stat_statements. If it says “idle in transaction,” run the pg_stat_activity query in the Fixes section and correlate with SHOW SERVERS request_time.
  6. Check which pool. Stats are per database; pools are per (database, user). One saturated pool can hide inside a healthy aggregate. Look at SHOW POOLS row by row, not at a global rollup.
flowchart TD
    A[App latency high] --> B{paused or disabled?}
    B -- yes --> Z[Expected maintenance behavior]
    B -- no --> C{Admin console fast?
CPU below 100% of one core?} C -- no --> D[PgBouncer event loop is the problem] C -- yes --> E{avg_wait_time high?} E -- yes --> F{avg_query_time also high?} F -- no --> G[Pool too small or
connections held too long] F -- yes --> H[Backend slow, pool saturated
as consequence: fix PostgreSQL first] E -- no --> I{avg_query_time high?} I -- yes --> J[Database is slow:
pg_stat_statements, locks, I/O] I -- no --> K{avg_xact_time much
greater than avg_query_time?} K -- yes --> L[Idle-in-transaction:
fix application behavior] K -- no --> M[Latency is outside PgBouncer:
check network and app tier]

Metrics and signals to monitor

SignalWhy it mattersWarning sign
avg_wait_time (SHOW STATS_AVERAGES, microseconds)Queuing delay injected by PgBouncer itselfSustained above 100,000 us (100 ms); any large deviation from baseline
avg_query_timeBackend execution time through PgBouncer, includes PgBouncer-to-PostgreSQL networkSustained increase above 2x rolling baseline
avg_xact_timeHow long each transaction holds a server connectionavg_xact_time » avg_query_time means idle-in-transaction
cl_waiting (SHOW POOLS)Clients queued right now; the primary saturation signalAny non-zero value sustained over 60 seconds
maxwait (SHOW POOLS)Age of the oldest waiter; the user-facing worst caseAbove 5 s is user-visible; approaching query_wait_timeout (default 120 s) means disconnects
sv_active / pool_sizePool utilization; the leading indicator before queuing startsSustained above 85%; at 100% the next request queues
sv_idleReady reserve in transaction mode; inventory, not wasteZero sustained means no headroom left
avg_server_assignment_count (1.23+)Pool turnover; denominator of the corrected avg_wait_timeDrop with stable query rate suggests exhaustion
Admin console latencyEvent loop health; if this is slow, all metrics are suspectAbove 200 ms consistently

Fixes

Pool undersized: high wait, low query time

The database is fast but there are not enough server connections. Raise default_pool_size or the per-database pool_size, then RELOAD. Sizing guidance from the pool’s own math: required_pool_size is roughly transactions_per_second x avg_xact_time_in_seconds. Leave headroom for bursts; keep sv_idle above zero at peak. If reserve_pool_size is configured and regularly drawn from, the base pool is chronically undersized: the reserve is for spikes, not steady state. Keep the sum of all pool sizes under roughly 80% of PostgreSQL max_connections, accounting for superuser_reserved_connections and other PgBouncer instances targeting the same backend.

Backend slow: low wait, high query time

Do not touch pool_size; adding connections against a slow database just adds load. Work the PostgreSQL side: pg_stat_statements for the slowest calls, pg_stat_activity for lock waits, disk I/O on the database host. Also check server_reset_query: the default DISCARD ALL runs on connection return in session mode, and if the backend is slow to execute it (for example, many temp tables to clean), that overhead shows up inside avg_query_time and masquerades as “the database being slow.”

Idle in transaction: avg_xact_time » avg_query_time

The gap between the two averages is the time applications hold server connections while doing non-database work. No pool size fixes this; it only buys time. Confirm on PostgreSQL:

# Find connections holding transactions open without running queries
psql -h <postgres-host> -U <user> -d <db> -c \
"SELECT pid, state, now() - xact_start AS xact_duration, query
 FROM pg_stat_activity
 WHERE state = 'idle in transaction'
 ORDER BY xact_duration DESC;"

Trace offenders back through PgBouncer: SHOW SERVERS gives the link column for active connections, SHOW CLIENTS maps it to a source address. The durable fix is application-side (commit promptly, do not span transactions across application work). As a guardrail, consider PostgreSQL’s idle_in_transaction_session_timeout to auto-terminate the worst offenders; coordinate with the application team, since terminating a transaction rolls it back.

Both high: cascade

Slow queries hold connections, the pool saturates, and the queue grows. Killing the right query frees the pool faster than any config change. Identify long-running backends and cancel them with pg_cancel_backend or pg_terminate_backend. This is disruptive: the client through PgBouncer receives an error and the transaction rolls back. Coordinate before terminating anything in production.

Event loop saturation

If PgBouncer itself is the bottleneck (one core at 100%, slow admin console), the split metrics will mislead you. Usual drivers are TLS handshakes at high connection churn, excessive logging, or extremely high query rates. Options: offload TLS to a proxy in front, or scale out with multiple PgBouncer processes via so_reuseport, aggregating stats across processes when you monitor.

Prevention

  • Alert on the pair, never one metric. A wait-time alert without a query-time check will send you to the wrong component. Include paused/disabled state as a suppression condition so maintenance windows do not page.
  • Alert on sustained maxwait, not on cl_waiting > 0. Brief queuing during bursts is normal in transaction mode. maxwait above a threshold that reflects your application timeout separates “burst” from “stuck.”
  • Track the xact-to-query gap as a standing ratio. A rising avg_xact_time / avg_query_time ratio is idle-in-transaction developing weeks before it exhausts the pool.
  • Upgrade past 1.23.0 for trustworthy avg_wait_time. On older versions, build dashboards and alerts around maxwait instead.
  • Watch headroom, not just incidents. sv_idle trending toward zero, or sv_active/pool_size trending up over weeks, is the queue forming before it exists. That is the time to resize, not during the incident.

How Netdata helps

  • Netdata collects SHOW POOLS, SHOW STATS, and SHOW STATS_AVERAGES per database, so avg_wait_time, avg_query_time, and avg_xact_time are graphed on the same timeline and the split is visible at a glance.
  • Per-pool cl_waiting and maxwait are captured at high resolution, catching short queuing bursts that a 60-second polling loop would smooth away.
  • The avg_xact_time vs avg_query_time gap is visible as two diverging series, surfacing idle-in-transaction before it exhausts the pool.
  • sv_active against configured pool_size gives the utilization ratio that leads cl_waiting, so you see saturation forming rather than arriving.
  • Host-level CPU for the PgBouncer process sits next to the pooler metrics, which makes the “is it the event loop?” check a one-screen correlation instead of a separate SSH session.