Skip to the content ForoHackers
Log inJoin

Machine learning: start here

Machine learning
#2837 · · Quote · Report

Machine learning is building programs that get their behaviour from data instead of hand-written rules: you show examples, a method fits a model, and the model makes predictions on cases it has not seen. It matters wherever the rules are too many or too fuzzy to write down, such as spam, prices, faults or recommendations.

Key concepts

  • Supervised learning: learn a mapping from inputs to known labels, for classification or regression.
  • Unsupervised learning: find structure without labels, such as clusters, low-dimensional views or anomalies.
  • Generalisation: a model is good if it works on new data; overfitting is memorising the training set.
  • Train, validation and test splits: tune on one, report on a test set you touched once.
  • Features and leakage: what the model sees, and the trap of letting information from the future or the label slip in.

Vocabulary

  • Loss function: the number the training procedure tries to make small.
  • Hyperparameter: a setting chosen before training, such as tree depth or regularisation strength.
  • Regularisation: a penalty or constraint that keeps a model from fitting noise.
  • Cross-validation: repeating the train and validate split over several folds to estimate error.

What to study, in order

  1. Linear algebra, probability and a little calculus: vectors, distributions, gradients.
  2. Linear and logistic regression by hand, with gradient descent in plain NumPy.
  3. Decision trees and ensembles of trees with scikit-learn on a small tabular set; always run a baseline first.
  4. Evaluation done properly: confusion matrix, precision and recall, calibration, cross-validation.
  5. Build an end-to-end project: clean data, split it, model, error analysis, and a write-up of what failed.

Related tags

#probability #data-science #deep-learning #ai-evaluation #optimization

You are not logged in, so this goes up anonymously: no account, no name and no address is stored with it, and it may carry no link and no image. Log in or join to post under your name. Our web server's logs keep the address and time of every request for up to 14 days; to keep yours out of them, use Tor. To reach the staff in confidence, use the drop. Sign as a returning source (a key kept only in this browser)

Sending takes a few seconds here: your browser first works out a proof of work against spam.

Reply