Client_Connections_aborted is a cumulative counter in stats_mysql_global. What matters is the rate of change, not the absolute value. A sustained non-zero rate means clients are failing to establish or maintain connections through ProxySQL.
The diagnostic question is whether aborts come from ProxySQL actively rejecting connections (authentication failures, connection limits), clients disconnecting improperly (timeouts, crashes, protocol mismatches), or the Client Error Limit feature banning source addresses. The Access_Denied_* counters in the same stats table identify which. If aborts rise while the Questions rate drops, clients are experiencing a real outage. If Questions is stable, the impact may be limited to a subset of clients.
What this means
Client_Connections_aborted counts client connections that failed during establishment or were closed improperly. Compare it against Client_Connections_created, which counts successful new connections. If both rise together, you have connection churn (rapid connect/disconnect cycling). If aborted rises while created stays flat, existing connections are being killed or rejected at a higher rate.
ProxySQL tracks three authentication rejection counters alongside the abort counter:
Access_Denied_Wrong_Password- wrong password attemptsAccess_Denied_Max_Connections- rejected because globalmysql-max_connectionswas reachedAccess_Denied_Max_User_Connections- rejected because a per-user connection limit was hit
Correlating these with Client_Connections_aborted is the fastest path to root cause. If none are rising, the aborts are not auth-related. Look at protocol issues, client-side timeouts, or the Client Error Limit feature.
Common causes
| Cause | What it looks like | First thing to check |
|---|---|---|
| Credential mismatch or rotation | Access_Denied_Wrong_Password rising in step with aborts | mysql_users table vs deployed app credentials |
| Global connection limit hit | Access_Denied_Max_Connections rising; Client_Connections_connected near mysql-max_connections | mysql-max_connections value and current connected count |
| Per-user connection limit hit | Access_Denied_Max_User_Connections rising for a specific user | stats_mysql_users for per-user utilization |
| Client Error Limit banning addresses | client_host_error_killed_connections rising; aborts from specific IPs | mysql-client_host_error_counts and mysql-client_host_cache_size settings |
| Client-side timeout during handshake | Aborts rising but no Access_Denied_* counter moves; log entries about unhealthy connections | mysql-connect_timeout_client value and client connect timeout settings |
| Authentication plugin incompatibility | Access_Denied_Wrong_Password rising after MySQL backend upgrade; caching_sha2_password involved | ProxySQL version vs auth plugin support matrix |
| Pre-auth vulnerability exploitation | Unexplained abort spike, no credential changes, versions 2.0.18-3.0.8 | ProxySQL version and CVE-2026-48773 advisory |
Quick checks
All queries run against the admin interface on port 6032. These are read-only and safe to run during an incident.
# Check abort rate and access denied breakdown
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT Variable_Name, Variable_Value
FROM stats_mysql_global
WHERE Variable_Name IN (
'Client_Connections_aborted',
'Client_Connections_created',
'Client_Connections_connected',
'Access_Denied_Wrong_Password',
'Access_Denied_Max_Connections',
'Access_Denied_Max_User_Connections'
);"
Take two readings 30-60 seconds apart and compute the delta. A rate of 0 with a high absolute value means the problem has already passed.
# Check per-user connection utilization
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT username, frontend_connections, frontend_max_connections
FROM stats_mysql_users
ORDER BY frontend_connections DESC;"
# Check Client Error Limit activity
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT Variable_Name, Variable_Value
FROM stats_mysql_global
WHERE Variable_Name LIKE '%client_host_error%';"
# Check global connection limit settings
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT variable_name, variable_value
FROM global_variables
WHERE variable_name IN (
'mysql-max_connections',
'mysql-connect_timeout_client',
'mysql-client_host_error_counts',
'mysql-client_host_cache_size'
);"
# Check per-errno error breakdown (ProxySQL 2.x)
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT * FROM stats_mysql_errors
ORDER BY last_seen DESC LIMIT 20;"
# Check recent client sessions and their source addresses
mysql -u admin -p -h 127.0.0.1 -P 6032 -e "
SELECT user, cli_host, hostgroup, db, command, time_ms
FROM stats_mysql_processlist
ORDER BY user;"
# Check for unhealthy connection log entries
grep "Closing unhealthy client connection" /var/lib/proxysql/proxysql.log | tail -20
How to diagnose it
flowchart TD
A["Client_Connections_aborted rate > 0"] --> B{"Access_Denied_Wrong_Password rising?"}
B -->|Yes| C["Credential mismatch: check mysql_users"]
B -->|No| D{"Access_Denied_Max_Connections rising?"}
D -->|Yes| E["Global limit: check mysql-max_connections"]
D -->|No| F{"Access_Denied_Max_User_Connections rising?"}
F -->|Yes| G["Per-user limit: check stats_mysql_users"]
F -->|No| H["Non-auth: check Client Error Limit, timeouts, protocol"]Determine the rate. Two readings 30-60 seconds apart give the delta. A sustained rate confirms an active issue.
Correlate with
Access_Denied_*counters. Apply the same delta approach to all three. Whichever rises in step with the aborts identifies the rejection cause.If
Access_Denied_Wrong_Passwordis rising, compare the password inmysql_usersagainst what the application uses. Check whether a credential rotation was performed on the MySQL backend but not propagated to ProxySQL. Also verify the monitor credentials (mysql-monitor_username/mysql-monitor_password) are valid, since monitor failures cause a different cascade.If
Access_Denied_Max_Connectionsis rising, checkClient_Connections_connectedagainstmysql-max_connections(default 2048). If connected is near the limit, investigate whether a single application is consuming disproportionate connections, or whether the limit is too low for current load. See ProxySQL client connections at mysql-max_connections for frontend saturation details.
If
Access_Denied_Max_User_Connectionsis rising, querystats_mysql_usersto find which user is at their per-user limit. Themax_connectionscolumn inmysql_userscontrols this.If no
Access_Denied_*counter is rising, the aborts are not authentication rejections. Check these possibilities:- Client Error Limit: If
mysql-client_host_error_countsis greater than 0 (default 0, meaning disabled), ProxySQL bans source addresses that exceed the error threshold. Checkclient_host_error_killed_connectionsinstats_mysql_globalfor evidence. - Client-side timeouts: If clients have connect timeouts shorter than
mysql-connect_timeout_client(default 10000 ms), or if ProxySQL is slow to complete the handshake due to backend latency during auth, clients may give up first. - Protocol mismatch: Version-specific issues with
caching_sha2_password(MySQL 8 default auth plugin) cause silent auth failures on ProxySQL versions that lack full support. - Unhealthy disconnects: If
mysql-log_unhealthy_connectionsis true (default), check the ProxySQL log for “Closing unhealthy client connection” entries.
- Client Error Limit: If
Check error codes. If available, per-hostgroup and per-user error breakdowns provide MySQL errno detail. Error 1045 means access denied. Error 1040 means too many connections from the backend. ProxySQL internal errors (9000+ range) indicate proxy-side failures.
Verify Questions rate. If
Questionsdrops while aborts rise, the service is degraded for clients. IfQuestionsis stable, the impact may be limited to a subset of connections.
Metrics and signals to monitor
| Signal | Why it matters | Warning sign |
|---|---|---|
Client_Connections_aborted rate | Direct measure of client-side connection failures | Sustained rate above 0 for more than 2 minutes |
Access_Denied_Wrong_Password rate | Credential mismatch or brute-force attack | Sustained increase correlating with abort rate |
Access_Denied_Max_Connections rate | Global connection capacity exhausted | Any sustained increase |
Access_Denied_Max_User_Connections rate | Per-user capacity exhausted | Any sustained increase |
Client_Connections_connected vs mysql-max_connections | Frontend saturation approaching | Connected count above 80% of limit |
Client_Connections_created rate | Distinguishes churn from rejection | Created spiking alongside aborted means connect/disconnect cycling |
Questions rate | Confirms real service impact | Drop below 10% of baseline while aborts rise |
client_host_error_killed_connections | Client Error Limit actively banning addresses | Rising when feature is enabled |
generated_error_packets | ProxySQL generating error responses | Sustained increase |
Fixes
Credential mismatch
If Access_Denied_Wrong_Password is the cause, update the credentials in ProxySQL’s mysql_users table:
UPDATE mysql_users SET password='...' WHERE username='...';
LOAD MYSQL USERS TO RUNTIME;
SAVE MYSQL USERS TO DISK;
If the monitor credentials are also stale, update them separately:
SET mysql-monitor_password='...';
LOAD MYSQL VARIABLES TO RUNTIME;
SAVE MYSQL VARIABLES TO DISK;
The three-layer config model (MEMORY, RUNTIME, DISK) means the change is not live until LOAD TO RUNTIME and not durable across restarts until SAVE TO DISK. Missing either step is a common operational error.
Global connection limit
If Client_Connections_connected is near mysql-max_connections (default 2048), increasing the limit provides immediate relief:
SET mysql-max_connections=4096;
LOAD MYSQL VARIABLES TO RUNTIME;
SAVE MYSQL VARIABLES TO DISK;
Before raising the limit, verify the host has sufficient file descriptors. Each connection consumes approximately one file descriptor. Check ulimit -n and current FD usage via /proc/<pid>/fd. If FD exhaustion is the actual bottleneck, raising mysql-max_connections will not help.
Also investigate whether a single application or user is consuming disproportionate connections. A connection leak in one service can starve all others sharing the ProxySQL instance.
Per-user connection limit
If Access_Denied_Max_User_Connections is the cause, adjust the max_connections column for the affected user in mysql_users, or redistribute connections across multiple users.
Client Error Limit
If client_host_error_killed_connections is rising and the Client Error Limit feature is enabled (mysql-client_host_error_counts > 0), review whether the threshold is too aggressive for legitimate traffic patterns. A misconfigured application that generates auth errors can get its source IP banned, which then affects all clients behind the same NAT or load balancer.
Authentication plugin incompatibility
If you recently upgraded MySQL backends to 8.x and see auth failures cascading, check whether caching_sha2_password is the default auth plugin on the backend. ProxySQL support for this plugin is version-dependent:
- Pre-2.0.2: no support for
caching_sha2_password - 2.0.2 through 2.5.x: frontend support requires cleartext password storage and
admin-hash_passwordsset tofalse - 2.6.0+: full support for both frontend and backend
If you cannot upgrade ProxySQL immediately, configure the MySQL backend to use mysql_native_password for accounts that connect through the proxy.
Security: check for vulnerability exploitation
If aborts spike without any credential change, deployment, or capacity change, and you are running ProxySQL versions 2.0.18 through 3.0.8, check for CVE-2026-48773. This pre-authentication heap memory corruption vulnerability in first-packet handling allows a remote unauthenticated client to trigger an oversized first packet length, causing recv() to write past a fixed input buffer. If you suspect exploitation, upgrade immediately and review ProxySQL logs for abnormal connection patterns from unexpected source addresses.
Prevention
- Correlate aborts with access denied counters in alerts. A bare
Client_Connections_abortedalert is ambiguous. Alerting on aborts plus a specificAccess_Denied_*counter gives the on-call engineer immediate context. - Set per-user connection limits. Without per-user limits in
mysql_users, a single misbehaving application can consume all frontend connections. Setmax_connectionsper user based on expected usage. - Monitor per-user utilization. Track
frontend_connectionsrelative tofrontend_max_connectionsfromstats_mysql_users. Alert above 90% to catch saturation before rejections. - Gate cold-start alerts with uptime. Use
ProxySQL_Uptime > 600as a condition to avoid false alarms during restart, when empty connection pools cause brief connection failures. - Keep credentials in sync across systems. Credential rotation should update the MySQL backend, ProxySQL
mysql_users, and ProxySQL monitor credentials in the same change window. - Verify auth plugin compatibility before MySQL upgrades. Check the ProxySQL version’s support for the target MySQL authentication plugins before upgrading backends.
How Netdata helps
- Per-second collection of
Client_Connections_abortedand allAccess_Denied_*counters, so rate-of-change is visible without manual delta calculations. - Abort rate correlated with
Questionsrate on the same dashboard, making it obvious whether the service is degraded or only a subset of clients is failing. - Per-user connection tracking from
stats_mysql_users, surfacing which users are approaching theirfrontend_max_connectionslimit before rejections begin. - Anomaly scoring on the abort rate, separating a genuine spike from normal post-deployment churn or periodic credential rotation windows.
- Composite alerting that can gate on
ProxySQL_UptimeandClient_Connections_non_idleto suppress cold-start and idle-instance false positives.
Related guides
- ProxySQL backend connection pool exhausted: queries queuing for a free connection
- ProxySQL backend flapping between ONLINE and SHUNNED: monitor-induced oscillation
- ProxySQL OFFLINE_SOFT vs OFFLINE_HARD vs SHUNNED: what each backend status means
- ProxySQL backend SHUNNED: why a healthy backend gets pulled out of rotation
- ProxySQL client connections at mysql-max_connections: frontend saturation and rejected clients
- ProxySQL ConnERR climbing: backend connection errors and how to localise them
- ProxySQL ConnPool_get_conn_failure rising: the most direct pool-starvation signal
- ProxySQL hostgroup_locked connections: reading the multiplexing-health ratio
- How ProxySQL actually works in production: a mental model for operators
- ProxySQL error 9001 Max connect timeout reached while reaching hostgroup
- ProxySQL monitor check failures: connect, ping, read-only, and replication-lag probes failing
- ProxySQL MySQL_Monitor_Workers is zero: health checks stopped and status is stale






