Pepys

Blog

Does audio quality affect transcription accuracy? Yes – and here's how much, by the numbers.

A tour of the published ASR research – SNR, noise, reverberation, mic distance, sample rate, and compression – and how each one moves word error rate before the model gets a say.

By Pepys ·

The short version

As signal-to-noise ratio falls from 20 dB to 0 dB, one provider's production analysis shows word error rate climbing from roughly 3.5% to over 70%. Audio quality sets the ceiling on accuracy: reverberation adds 2 to 15 points, a distant microphone can drop accuracy from 95% to 61%, and telephone-band audio roughly doubles errors. Record close, quiet, and uncompressed.

One number quietly predicts the rest: signal-to-noise ratio

Before a transcription model hears a single word, one measurement has already narrowed how well it can possibly do: the signal-to-noise ratio, or SNR – the gap in decibels between the voice you want and the background you don't. One ASR provider's production-metrics analysis maps that gap straight onto accuracy, and the curve is steep. At 20 dB SNR (a quiet room, close mic) it reports a word error rate around 3.5%. At 15 dB, roughly 7%. At 10 dB, about 15%. At 5 dB, near 35%. At 0 dB, where voice and noise are equally loud, it passes 70%.

The important part is the shape. The penalty is not linear – it accelerates through the 2 to 14 dB band, which is exactly where that same analysis says most real-world recordings land. A few decibels of extra noise near the clean end cost you almost nothing; the same few decibels near the messy end can double your errors.

Those figures come from a single provider's synthesis rather than one controlled experiment, so treat them as the shape of the effect, not a universal constant. But the shape is what matters, and every study below traces the same outline: the recording, not the model, decides most of it.

Background noise doesn't only lose words – it invents them

Noise doesn't just muffle speech; it changes what the model does with the gaps. In a 2022 study in Frontiers in Signal Processing, an open-source engine (DeepSpeech) trained on clean speech scored a 12% word error rate on clean audio and 79% once the same speech was pushed through added noise and network distortion – nearly seven times worse, for words that were, to a human ear, still there.

There is a subtler failure hiding in that number. A 2026 preprint that stress-tested modern models reports that Whisper, at low SNR, makes among the fewest deletions but the most insertions: it fills uncertain stretches with plausible, confident, wrong text rather than leaving them blank. Bad audio, in other words, doesn't only produce gaps in your transcript. It can produce fluent sentences that were never said, which is worse, because they read as true. That preprint is not yet peer-reviewed, so take the mechanism as indicative.

If your recordings have several people talking at once, that is its own accuracy problem, and a common one – we cover it in how well AI handles crosstalk.

The benchmark-to-production gap

This is why a model's headline accuracy and the transcript you actually get can look like two different products. The same provider analysis puts a modern engine near 8.7% word error rate on controlled medical dictation – clean, single speaker, good mic – and above 50% on real multi-speaker clinical conversation, citing a clinical study for a 2.8 to 5.7 times degradation from benchmark to production. Nothing about the model changed. The audio did.

Benchmarks are recorded to be transcribed. Your meeting was not. When you read that a tool is "95% accurate," the honest question is: on what audio? We pull that thread in how accurate AI transcription really is and in our own accuracy benchmark.

Reverberation: the same words, in an echoey room

Distance and hard walls add a second, quieter enemy: reverberation, the smeared echo of a voice bouncing around a live room. A 2026 benchmark took 1,600 clean LibriSpeech utterances and convolved each with real room impulse responses – the same words, digitally moved into echoey rooms – then measured the cost.

Whisper's large-v3 model took a reverb penalty of 2.31 percentage points. The tiny model took 15.50. Size buys resilience: a bigger model absorbs room acoustics that a small one cannot, but even the best model pays something for the echo. (This is a preprint, so read the exact points as directional.) The practical read: a carpeted, curtained, small room will out-transcribe a beautiful glass-walled conference room every time.

Microphone distance: the far-field cliff

Move the microphone and you move the accuracy, sometimes off a cliff. A controlled corpus (SPEECON) recorded the same speakers at four distances at once, so distance was the only thing that changed. On a headset mic 2 cm from the mouth, digit recognition hit 95.22%. At a hands-free 10 cm, 92.44%. At a middle distance of 0.5 to 1 m, 89.54%. At a far-talk mic 3 m away, 61.18% – a third of the accuracy gone, from nothing but distance.

The research on messier speech agrees. In the CHiME-5 challenge, built from conversational dinner-party audio, the baseline system scored 47.9% word error rate on close-talk binaural mics and 81.3% on a distant Kinect array: a 33.4-point gap for the identical conversation, decided entirely by which microphone you read from.

Both of those results come from older HMM and DNN systems, so read the magnitudes as the direction and rough scale of the effect; a modern model is more resilient. But the cliff is still there, and the lesson is cheap to apply: get the mic close to the mouth. It beats almost anything you can do afterward.

Sample rate and bandwidth: a floor you can't raise later

Some quality you can fix in post. Bandwidth is not one of them – once the high frequencies are gone, they are gone. Telephone-band audio is sampled at 8 kHz, which discards everything above roughly 4 kHz, and that band carries the fricatives and sibilants (the f, s, sh, th sounds) that tell "fine" from "sign."

A Microsoft study measured the toll. The same voice-search system scored 27.47% word error rate on 16 kHz wideband audio and 53.51% on 8 kHz narrowband – roughly double the errors for the same speech. A model trained only on wideband degraded further still, from 29.96% to 71.23%, when handed narrowband input.

The rule that falls out is simple: keep your recordings at 16 kHz or better, and don't route them through anything telephone-grade. This is an older system on a small vocabulary, so modern numbers would be lower, but the 8-versus-16 kHz gap holds in kind. Bandwidth is one quality factor among several; accent is another, treated in transcribing accented English.

Compression: bitrate barely matters, until it doesn't

Compression is the one place the research offers reassurance. In the same SPEECON study, re-encoding close-talk audio as MP3 at 24 kbps – a file about a tenth of the original size – cost only about 3% accuracy with one feature set and 6% with another. Moderate compression is nearly free.

The collapse comes at the very bottom. At 8 kbps, accuracy fell from 95.22% to 21.02%. Below a threshold, the codec throws away the speech itself, and there is no model good enough to recover it. So the guidance is narrow and specific: don't fear a reasonable MP3 or AAC, but never hand a transcription tool an 8 kbps voice-note-of-a-voice-note. Light compression, or none, is the safe setting.

A modern model helps – but it can't rescue a bad recording

None of this means the model doesn't matter. Today's large, weakly-supervised models tolerate messy real-world audio far better than the supervised systems that came before them. Whisper's own paper reports a 55.2% average relative reduction in errors versus a strong supervised model on out-of-distribution audio, at near-identical clean-speech accuracy (around 2.7% on test-clean). That is real, and it is why a current engine is worth using.

But that is generalization headroom, not a rescue. The same body of research is clear that machines still need a higher SNR than human listeners to reach the same accuracy – bad audio remains bad audio, and the model overcomes less of it than we would like. Among models tested in one psychometric study, wav2vec 2.0 came closest to human performance; see the psychometrics of ASR. The order of operations is the whole lesson: the recording sets the ceiling, and the model works underneath it.

That is where Pepys sits, honestly. Pepys runs a current large speech model – the class of model shown here to handle messy audio best – so you start from a high floor. But every study above says the same thing: most of the win is upstream. Record close. Kill the background noise and the echo. Keep it at 16 kHz or better, lightly compressed or not at all. A modern model plus a quick review pass does the rest. This post is the why; the companion guide on improving transcription accuracy is the what-to-do. When your audio is clean, you can turn it into text and expect the numbers on this page to fall in your favor. For where AI transcription still hits its limits, see the limits in 2026.

Figures on this page are quoted from the studies linked below, several of them 2026 preprints; last verified 2026-07-13.

Questions, answered

What's the single biggest factor in transcription accuracy?

Signal-to-noise ratio – the gap between the voice and the background. In one ASR provider's production analysis, as SNR falls from 20 dB to 0 dB, word error rate climbs from roughly 3.5% to over 70%, and the penalty accelerates in the 2 to 14 dB band where most real recordings sit. Everything else (distance, echo, bandwidth, compression) mostly works by changing this number.

Does recording at a higher sample rate help?

Up to a point. Moving from 8 kHz telephone-band to 16 kHz roughly halved word error rate in a Microsoft study (53.51% down to 27.47%), because the discarded 4 to 8 kHz band carries the fricatives and sibilants that distinguish similar words. Past about 16 kHz the gains shrink, so 16 kHz is the practical floor – most engines resample to it anyway.

Will a better AI model fix a bad recording?

No. Modern weakly-supervised models tolerate messy audio far better than older ones – Whisper's paper reports a 55.2% average relative error reduction versus a supervised model on out-of-distribution audio – but that is headroom, not a rescue. Research shows machines still need a higher SNR than human listeners for the same accuracy. The recording sets the ceiling.

Is a phone voice memo good enough?

Often yes, if you record close and in a quiet room. The killers are distance (accuracy fell from 95.22% at 2 cm to 61.18% at 3 m in one corpus), echoey rooms (a 2.31 to 15.50 point reverb penalty depending on model size), and heavy compression (8 kbps collapsed one system from 95.22% to 21.02%). A close mic in a quiet room beats an expensive mic across the room.

References

  1. 1.Speech Recognition Accuracy: Production Metrics & Optimization (WER-vs-SNR curve; benchmark-to-production degradation)Deepgram
  2. 2.Whisper-RIR-Mega: A Paired Clean-Reverberant Speech Benchmark for ASR Robustness to Room Acoustics (2026)arXiv 2603.02252
  3. 3.The fifth 'CHiME' Speech Separation and Recognition Challenge: Dataset, task and baselinesarXiv 1803.10609
  4. 4.OpenAI Whisper paper (Radford et al., 2022)arXiv 2212.04356 / PMLR 2023
  5. 5.Pollak & Behunek, Accuracy of MP3 Speech Recognition Under Real-Word Conditions (SPEECON, mic distance + MP3 bitrate)SciTePress, SIGMAP 2011
  6. 6.Li, Yu, Huang & Gong, Improving Wideband Speech Recognition Using Mixed-Bandwidth Training Data in CD-DNN-HMM (8 kHz vs 16 kHz, Table 4)Microsoft Research
  7. 7.Performance evaluation of automatic speech recognition systems on integrated noise-network distorted speech (2022)Frontiers in Signal Processing
  8. 8.Too Good to Be True: A Study on Modern ASR for the Evaluation of Speech Enhancement (insertions/hallucinations at low SNR)arXiv 2605.12107

Keep reading

Don't just take our word for it.

Ask ChatGPT, Claude, or Perplexity what Pepys is and who it's for. One click, and your favorite AI does the homework.

Built for the four complaints above

Any length, pay once, real exports, no training on your audio. Start free with 60 minutes, no card.