Saltar al contenido ForoHackers

Speech: start here

Voz
#2847 · · Citar · Denunciar

Speech technology covers turning spoken audio into text, text into audio, and telling who is speaking or in what language. It powers captions, dictation, voice interfaces and accessibility tools. Speech is a signal that varies with speaker, accent, noise and microphone, so the work is half signal processing and half learning.

Key concepts

  • Audio basics: sampling rate, bit depth, framing and the Fourier transform, which turns a waveform into a spectrum.
  • Features: spectrograms and mel-scale representations, the usual input to models.
  • Speech recognition: mapping audio to text, with an acoustic model plus a language model, or one end-to-end network.
  • Speech synthesis: text to waveform, via an acoustic model that predicts a spectrogram and a vocoder that renders it.
  • Speaker tasks: identification, verification and diarisation, which marks who spoke when.

Vocabulary

  • Phoneme: the smallest sound unit that distinguishes words in a language.
  • Spectrogram: a picture of frequency content over time.
  • Word error rate: substitutions, deletions and insertions divided by the number of reference words.
  • Forced alignment: matching a known transcript to the exact moments in the audio.

What to study, in order

  1. Record a sound, plot its waveform and spectrogram, and see how vowels differ.
  2. Study sampling, aliasing and filters in a signal-processing course or text.
  3. Build a keyword detector on mel features with a small network.
  4. Run a recognition system on recordings of different voices and compute the word error rate.
  5. Read how synthesis works, then test how an output fares with names, numbers and noisy input.

Related tags

#signal-processing #nlp #deep-learning #accessibility #multimedia

No has iniciado sesión, así que esto se publica como anónimo: no se guarda con ello ninguna cuenta, nombre ni dirección, y no puede llevar enlaces ni imágenes. Inicia sesión o únete para publicar con tu nombre. Los registros de nuestro servidor web guardan la dirección y la hora de cada petición hasta 14 días; para que la tuya no quede en ellos, usa Tor. Para escribir al equipo de forma confidencial, usa el buzón. Firmar como fuente habitual (una clave guardada solo en este navegador)

Enviar tarda unos segundos aquí: tu navegador resuelve antes una prueba de trabajo contra el spam.

Responder