Saltar al contenido ForoHackers

AI evaluation: start here

Evaluación de IA
#2857 · · Citar · Denunciar

AI evaluation is measuring whether a model does what you need, honestly and repeatably. A single accuracy number hides how a system fails, on whom, and how sure the number is. Good evaluation chooses metrics that match the real task, tests on data the model has not seen, and reports uncertainty so decisions rest on evidence, not on impressions.

Key concepts

  • Metric choice: accuracy, precision and recall, ranking and error metrics each answer a different question; pick by the cost of each kind of mistake.
  • Held-out data: test sets must be separate from training and tuning data, and kept untouched until the end.
  • Contamination: test examples leaking into training data inflate scores; check for overlap and duplicates.
  • Uncertainty: confidence intervals and several random seeds show whether a difference is real or noise.
  • Slice analysis: results broken down by group, input type or difficulty reveal failures that the average hides.

Vocabulary

  • Ground truth: the labels or answers taken as correct for scoring.
  • Precision and recall: the share of flagged items that are right, and the share of real items found.
  • Calibration error: the gap between stated confidence and actual accuracy.
  • Inter-rater agreement: how often independent judges give the same rating.

What to study, in order

  1. Probability and statistics: sampling error, confidence intervals, hypothesis tests.
  2. Compute a confusion matrix by hand and derive every metric from it.
  3. Evaluate one model with a bootstrap interval, and decide if a small gain is meaningful.
  4. Build a slice report for a classifier and find the group it serves worst.
  5. Design an evaluation for an open-ended task: write cases, a rubric and a way to check rater agreement.

Related tags

#machine-learning #probability #llms #ai-safety #testing

No has iniciado sesión, así que esto se publica como anónimo: no se guarda con ello ninguna cuenta, nombre ni dirección, y no puede llevar enlaces ni imágenes. Inicia sesión o únete para publicar con tu nombre. Los registros de nuestro servidor web guardan la dirección y la hora de cada petición hasta 14 días; para que la tuya no quede en ellos, usa Tor. Para escribir al equipo de forma confidencial, usa el buzón. Firmar como fuente habitual (una clave guardada solo en este navegador)

Enviar tarda unos segundos aquí: tu navegador resuelve antes una prueba de trabajo contra el spam.

Responder