Robot Umpires Didn’t Remove Human Judgment — They Created a New Baseball Skill
MLB’s first season with the ABS challenge system did more than correct missed ball-strike calls. With catchers, hitters and pitchers showing dramatically different success rates, knowing when an umpire is wrong has quietly become a measurable part of playing baseball.
Major League Baseball introduced the Automated Ball-Strike challenge system to answer a familiar question:
Was that pitch really a strike?
By the end of its first regular season, however, the system had created a much more interesting one.
How good are players at knowing the answer?
The first full season of ABS challenges has provided something baseball never previously had at the major-league level: thousands of measurable decisions in which a player disagreed with a ball-strike call and immediately put that judgment to the test.
The results suggest that challenging an umpire is not random.
Across MLB, 54% of challenges resulted in the original call being overturned.
But the success rate changed significantly depending on who initiated the challenge.
Catchers succeeded 59% of the time.
Hitters were successful on 49%.
Pitchers managed only 40%.
That gap matters.
Baseball introduced ABS primarily as an officiating technology. What it may have accidentally introduced is a new competitive skill.
The strike zone is no longer just something players argue about
Players have disagreed with umpires for as long as balls and strikes have existed.
A hitter takes a pitch, hears "strike" and turns toward the plate umpire in disbelief.
A pitcher paints the edge, watches the umpire call ball and stares toward home plate.
A catcher holds his glove for another second, hoping the presentation will somehow change a decision that has already been made.
Until now, those reactions were mostly impossible to evaluate.
Maybe the player was right.
Maybe he was emotional.
Maybe he had a better view.
Maybe he simply wanted the call.
ABS changes that relationship.
A player can now challenge.
Seconds later, everyone in the stadium receives an answer.
That means a previously subjective baseball instinct has become measurable.
Did the player correctly identify a missed call?
Catchers have an obvious advantage — and the numbers show it
It is not especially surprising that catchers were the best challengers during the system's first season.
They spend their professional lives studying pitches from inches behind the strike zone.
They know where the target was.
They see the ball arrive.
They feel where their glove receives it.
They understand how different pitches move through the zone and how umpires typically react to them.
Modern catching has also become increasingly technical.
Organizations already evaluate receiving, blocking, pop time, game calling and the subtle mechanics of how catchers present pitches.
ABS may have added another category:
Challenge judgment.
A 59% success rate does not mean catchers possess perfect knowledge of the zone.
It means they were substantially better at identifying incorrect calls than pitchers, who succeeded only 40% of the time.
That 19-percentage-point difference is too interesting to dismiss as noise.
The person closest to the pitch appears to have information that matters.
Pitchers may be the worst people to ask
Pitchers finishing last is equally revealing.
From the mound, every borderline pitch has emotional context.
The pitcher knows where he intended to throw it.
He knows how good the pitch felt leaving his hand.
He knows how badly he needs the strike.
None of those things determine whether the ball actually crossed the zone.
A pitcher who believes he dotted the corner may be evaluating execution rather than location.
The distinction sounds small.
ABS makes it measurable.
If pitchers consistently challenge less successfully than catchers, teams eventually have to respond strategically.
The question stops being:
"Does the pitcher think that was a strike?"
It becomes:
"Who on this team should be trusted to make that decision?"
Those are very different questions.
A challenge has value because it can be lost
The strategic element exists because teams do not receive unlimited failed challenges.
Under MLB's system, each team begins a game with two challenges. A successful challenge is retained; an unsuccessful one is lost.
That turns every challenge into a resource-management decision.
A borderline call in the second inning may matter.
But will the team need that challenge more in the eighth?
Should a hitter challenge strike two with nobody on base?
Should a catcher challenge ball four with runners aboard?
Should a pitcher be allowed to initiate a challenge when the early evidence suggests pitchers are substantially worse at judging borderline calls?
The rules are simple.
The decisions created by them are not.
And the later a game gets, the more valuable certainty becomes.
Data from the first season showed players becoming more aggressive with challenges in the ninth inning, exactly what game theory would predict when an expiring resource can no longer be saved for later.
A challenge unused when the game ends has no value.
Suddenly, knowing the strike zone is only half the problem.
Knowing when to spend your right to question it is the other half.
Baseball has seen this happen before
New rules frequently create skills nobody originally intended to measure.
The pitch clock was designed to shorten games.
It also created a new form of pressure management. Pitchers had to control tempo. Hitters had to reset routines. Catchers had to communicate information more efficiently.
Restrictions on defensive positioning were designed to change where fielders could stand.
They also changed the value of range and defensive anticipation.
The larger bases and disengagement limits were designed partly to encourage action on the basepaths.
They changed the mathematics of stealing.
ABS belongs to the same category.
Its purpose is straightforward: correct obvious mistakes without completely removing the human plate umpire.
Its consequences are broader.
Once a challenge can change an at-bat, players and teams inevitably begin searching for ways to become better at challenging.
Teams will eventually optimize this
The first season should be treated as the beginning of the experiment, not its conclusion.
Players are still learning the system.
So are coaching staffs.
But baseball organizations rarely leave measurable advantages unexplored for long.
Teams can study where their successful challenges occur.
They can identify which catchers have unusually strong judgment.
They can examine whether certain pitchers consistently overestimate the width of the zone.
They can determine whether hitters are better at challenging high and low pitches than inside and outside pitches.
They can study count, inning, score and leverage.
Eventually, clubs may even develop internal challenge probabilities.
A catcher believes a pitch missed.
The dugout knows that catcher historically succeeds on similar challenges.
The game state determines how valuable overturning the call would be.
What began as an argument with an umpire becomes a decision model.
That is modern baseball.
The human umpire hasn't disappeared
There is an irony at the center of the system.
For years, the debate over automated balls and strikes was framed as humans versus machines.
Either umpires would call the strike zone, or computers would.
MLB ultimately chose something more complicated.
Humans still make the calls.
Technology checks them.
But another human has to decide when the machine should be asked.
That final step changes everything.
The player is not merely subject to the strike zone anymore.
He is evaluating the evaluator.
And because challenges are limited, being correct matters.
A catcher who recognizes missed calls better than his opponents can preserve challenges.
A hitter with exceptional spatial awareness may rescue an at-bat.
A pitcher who repeatedly challenges emotionally may cost his team a resource it desperately needs later.
Those differences can now affect games.
The next baseball skill may already be here
Nobody will put "ABS Challenge: 65" on the back of a baseball card.
At least not yet.
But baseball has spent decades turning previously invisible abilities into measurable ones.
Pitch framing barely existed in mainstream statistical conversation before tracking data revealed how valuable it could be.
Exit velocity changed how hitting was evaluated.
Spin rate changed how pitchers were developed.
Route efficiency changed how teams examined defense.
ABS challenge data may eventually do something similar on a much smaller scale.
The first season has already shown that players are not equally good at identifying missed calls.
Catchers appear better than hitters.
Hitters appear better than pitchers.
Game situation changes behavior.
And every successful challenge preserves the opportunity to challenge again.
Robot umpires were supposed to reduce the importance of human error.
Instead, MLB created a system in which recognizing human error has value.
That may be the most baseball outcome imaginable.
For Baseball Dream players
For an Agent in Baseball Dream, this is a useful reminder that player development does not have to end with obvious physical tools. Baseball constantly creates value from awareness, judgment and decision-making — abilities that can separate two otherwise similar players. As the real sport evolves, traits such as discipline, vision and baseball IQ can become more important because the rules themselves create new situations in which those skills matter.