Saltar al contenido ForoHackers

Multimedia systems: start here

Sistemas multimedia
#2991 · · Citar · Denunciar

Multimedia systems capture, compress, store, send and play sound, images and video. Raw media is enormous, so almost everything rests on codecs that throw away what people barely notice, and on pipelines that keep audio and video in step. Streaming adds the problem of delivering it smoothly over an unreliable network.

Key concepts

  • Sampling and quantisation: turning continuous sound and light into numbers; sample rate and bit depth set the quality.
  • Compression: lossless methods keep every bit; lossy codecs use transforms and perception to shrink data a great deal.
  • Containers and codecs: the codec encodes the stream; the container packs audio, video and subtitles together with timestamps.
  • Synchronisation: clocks and timestamps keep sound and picture aligned.
  • Streaming: buffering, adaptive bit rate and loss handling for live and on-demand playback.

Vocabulary

  • Bit rate: how many bits per second the stream uses.
  • Frame types: key frames stand alone; other frames store only the changes from their neighbours.
  • Latency and jitter: delay, and variation in delay, between sending and playing.
  • Transcoding: converting from one format or size to another.

What to study, in order

  1. Sampling theory: why twice the highest frequency, and what aliasing sounds like.
  2. Write a WAV file by hand from a generated tone, and play it.
  3. Implement a simple lossy image compressor with a DCT and quantisation, and view the artefacts.
  4. Use a standard command-line media tool to inspect streams, convert formats and change bit rates.
  5. Build a small streaming setup and watch what loss and jitter do to the playback.

Related tags

#signal-processing #information-theory #computer-graphics #speech

No has iniciado sesión, así que esto se publica como anónimo: no se guarda con ello ninguna cuenta, nombre ni dirección, y no puede llevar enlaces ni imágenes. Inicia sesión o únete para publicar con tu nombre. Los registros de nuestro servidor web guardan la dirección y la hora de cada petición hasta 14 días; para que la tuya no quede en ellos, usa Tor. Para escribir al equipo de forma confidencial, usa el buzón. Firmar como fuente habitual (una clave guardada solo en este navegador)

Enviar tarda unos segundos aquí: tu navegador resuelve antes una prueba de trabajo contra el spam.

Responder