Linear Algebra
Scalars, vectors, matrices, and the directions that matter
Scalars, Vectors & Matrices
Name a block of numbers as a scalar, vector, or matrix from its layout alone, state its shape without counting entries, and judge whether two shapes line up along a chosen axis before any arithmetic runs.
Matrix Operations
Predict from the shapes alone whether an addition, transpose, or multiply is even legal and what shape it returns, then build a single product cell by pairing one row against one column and summing.
Dot Product & Norms
Score how alike two vectors are by pairing their entries and summing, read direction straight off that number's sign, measure a vector two ways with the L1 and L2 norms, and strip length away to leave cosine similarity on a fixed minus-one-to-one scale.
Eigenvalues & Eigenvectors
Hunt the few directions a matrix leaves on their own line, read each eigenvalue as a signed stretch factor where positive stretches, negative flips, and zero collapses the line, and see why a data cloud's eigenvectors fall along its natural axes.
Calculus for ML
Derivatives, gradients, and the chain rule, how models find the bottom
Functions & Graphing
Read a graph as the rule that produced it, separate the inputs a function accepts from the outputs it produces, and tell a straight rule from a bending one by whether equal input steps lift the output equally, then read that same shape in a training loss curve.
Derivatives & Slope
Shrink a secant until it settles into the tangent to read a curve's slope at one point, differentiate polynomials term by term with the power rule, and step against the slope's sign to walk a loss curve downhill.
Partial Derivatives
Freeze every input but one so a multi-input surface collapses to an ordinary curve, read the partial derivative as that slice's slope, and give each model parameter its own partial of the error.
The Chain Rule
Multiply the local slopes of nested stages to get a composition's slope, evaluate each outer slope at the value its inner stage produced, and read the same product stacked deep as the backpropagation a network runs to reach every weight.
Gradients & Directional Derivatives
Stack a point's partial derivatives into the gradient arrow, read its direction as the steepest way uphill and its length as the climb rate, then flip its sign to step a loss surface downhill.
Integrals (Basics)
Sum a rate curve's thin strips until the running total settles on one exact area, then point the same summing at a probability density so the area between two marks becomes the chance of landing there.
Statistics & Distributions
Variance, bell curves, and the shapes data takes
Mean, Median, Mode
Pick mean, median, or mode by the shape of the data, predict which one an outlier drags and which one holds, and read the mean-median gap as a numerical measure of skew.
Variance & Standard Deviation
Square each value's gap from the mean into the variance, square-root it back to a standard deviation in the data's own units, then rescale any value to a mean-zero, standard-deviation-one z-score for feature preprocessing.
Normal Distribution
Pin a bell curve down with just two numbers, a center and a width, apply the 68-95-99.7 rule to turn any standard-deviation band into a percentage of the data, and read a value's percentile by standardizing it onto the single standard normal, then catch where skewed data breaks the rule.
Binomial Distribution
Tally the successes in `n` independent yes/no trials at a constant rate `p`, read the center `np` and spread `√(np(1-p))` straight from those two numbers, and swap in the normal approximation once `np` and `n(1-p)` both clear `10`.
Correlation vs Causation
Average two columns' standardized products into a single number in `[−1, +1]`, test it against Anscombe's quartet to see what one summary hides, then separate cause from reverse cause, a confounder, and coincidence by assigning the treatment at random.
Covariance & Correlation Matrices
Pair two columns' deviations into a covariance, stack every pair into one symmetric matrix built in one line as centered data times its own transpose over n − 1, then read the diagonal as each column's spread and the off-diagonal as the cloud's tilt, and divide out the units for the correlation matrix.
Probability
Bayes, conditional probability, and maximum likelihood, reasoning under uncertainty
Joint & Conditional Probability
Shrink a two-way table of emails to one row or column and read joint, marginal, and conditional probability off the same cells by swapping the denominator, factor any joint two ways with the product rule, test independence by checking whether the conditional equals the marginal, and see why `P(spam | free money)` and `P(free money | spam)` are two different numbers.
Bayes' Theorem
Rearrange the product rule into Bayes' theorem, `P(A|B) = P(B|A)·P(A)/P(B)`, read its four pieces (prior, likelihood, posterior, evidence) off a medical-test grid, build the evidence from the law of total probability, watch a rare base rate drag an 80%-accurate positive down to a 7.5% chance of disease, and feed each posterior back as the next prior.
Maximum Likelihood Estimation
Slide a single knob until the data you already collected becomes as probable as it can be, and read that peak as the estimate: a coin's bias is heads over flips, a bell's centre is the sample average. See why likelihood fixes the data and varies the parameter, why the log-likelihood shares the same peak while surviving huge datasets, and why the whole method is Bayes' theorem with the prior deleted.
Central Limit Theorem
Average random samples from any lopsided population and pile the averages into a bell centred on the true mean, set its width with `σ/√n` so four times the data only halves it, and separate the three distributions in play so only the sample averages turn normal, never the raw data.