Speech technology covers turning spoken audio into text, text into audio, and telling who is speaking or in what language. It powers captions, dictation, voice interfaces and accessibility tools. Speech is a signal that varies with speaker, accent, noise and microphone, so the work is half signal processing and half learning.
Key concepts
- Audio basics: sampling rate, bit depth, framing and the Fourier transform, which turns a waveform into a spectrum.
- Features: spectrograms and mel-scale representations, the usual input to models.
- Speech recognition: mapping audio to text, with an acoustic model plus a language model, or one end-to-end network.
- Speech synthesis: text to waveform, via an acoustic model that predicts a spectrogram and a vocoder that renders it.
- Speaker tasks: identification, verification and diarisation, which marks who spoke when.
Vocabulary
- Phoneme: the smallest sound unit that distinguishes words in a language.
- Spectrogram: a picture of frequency content over time.
- Word error rate: substitutions, deletions and insertions divided by the number of reference words.
- Forced alignment: matching a known transcript to the exact moments in the audio.
What to study, in order
- Record a sound, plot its waveform and spectrogram, and see how vowels differ.
- Study sampling, aliasing and filters in a signal-processing course or text.
- Build a keyword detector on mel features with a small network.
- Run a recognition system on recordings of different voices and compute the word error rate.
- Read how synthesis works, then test how an output fares with names, numbers and noisy input.
Related tags
#signal-processing #nlp #deep-learning #accessibility #multimedia