The Observation Theory EncyclopediaFrom TSKAboutBy kindBy chapterBy Lean fileLedgerProvenance

The Observation Theory Encyclopedia

310 entries, companion to Data Mining as Observation. Built 2026-09-10 from commit f7b7c77.

ABCDEFGHIJKLMNOPQRSTUVWYZ

A

abstentionconcept

The verdict a group receives when it has too few rows or too few queries to score.

accuracyconcept

The fraction of all rows a classifier labels correctly, the score most easily fooled, since predicting the majority class for every row scores the majority's share.

aggregationconcept

Combining rows or groups into one number.

alignmentconcept

The normalized overlap between a consumer's average read operator and the covariance of the data on the read subspace, written kappa, between zero and one.

allocationinstrument

The assignment of a bit budget across directions.

anisotropicconcept

Of a covariance, having different variances in different directions.

anti arminstrument

In a flip comparison, a third code built to destroy the consumer's read subspace at the same bits.

anti-hubconcept

A row that is never or almost never retrieved as anyone's nearest neighbour.

anti-hub recallinstrument

Recall at k restricted to the rows that are rarely retrieved, the observer's outliers, reported as the minimum over strata so that a mean cannot hide the tail.

anti-monotonicityconcept

The property that support cannot increase when an itemset grows, which licenses Apriori to prune every superset of an infrequent itemset without loss.

Apriori principleresult

The statement that every subset of a frequent itemset is frequent, the contrapositive of anti-monotonicity.

attentionconcept

The operation inside a language model that lets each token look at earlier ones by comparing its query to their keys and averaging their values.

attribute typeconcept

The declaration of which transformations of a column keep its meaning, any injective relabelling for nominal, a strictly increasing map for ordinal, an affine map for interval, and a positive rescaling for ratio, nested in that order.

attributioninstrument

An assignment to each feature of a share of one prediction.

auditinstrument

A check of a number or system against its record by a reader who did not produce it, bound to a sealed file.

AUROCconcept

The area under the receiver operating characteristic curve, equal to the probability that a random positive scores above a random negative, ties counted as one half.

B

bagginginstrument

Fitting the same model on bootstrap resamples and averaging.

bag of wordsconcept

A representation of a document as a vector with one coordinate per vocabulary term holding that term's count.

balanced accuracyconcept

The mean of the per-class recalls, so that a large class cannot hide a small one.

barinstrument

A threshold a statistic must reach, written down before the measurement.

baselineinstrument

The simplest scorer a claim must beat under the same protocol, chance, a constant, an untrained encoder, or a single model.

base rateconcept

How common a cause or class is before any observation, the prior that Bayes' rule multiplies by.

basisconcept

A set of independent vectors whose span is the whole space, so that every vector is exactly one combination of them.

Bayes' ruleconcept

The probability of a cause given an observation, equal to the probability of the observation given the cause times the base rate, divided by the overall probability of the observation.

Bernoulli, binomialconcept

A Bernoulli variable is one with probability p and zero otherwise, with mean p and variance p(1 minus p).

bi-Lipschitzconcept

Of a map between two spaces, neither stretching nor shrinking any distance by more than a fixed factor.

bitconcept

The unit of a budget.

blind probeinstrument

An instrument that recovers a consumer's read operator from calls to the consumer alone, without access to its gradients or its code.

block error rateconcept

The fraction of transmitted radio blocks the receiver cannot decode, abbreviated BLER.

Bonferroni correctionconcept

Dividing the significance threshold by the number of tests, which holds the family-wise error rate at or below the original threshold whatever the dependence among the tests, at the price of being conservative.

boostinginstrument

Fitting a sequence of weak scorers, each on the rows the previous ones got wrong, and summing them.

bootstrapinstrument

An estimate of a confidence interval made by resampling the data with replacement many times and recomputing the statistic each time.

budgetconcept

The third element of an observer.

budget cliffresult

The finding that recovery of a read operator by a probe is a cliff at the full dimension of the space rather than a slope, and that the cliff does not move with the operator's rank.

C

cacheconcept

A store of recently used data kept so that it need not be fetched again.

calibrationconcept

The property of a score that a value of 0.8 means the row is positive eighty percent of the time.

capacityconcept

The number of distinctions a model class can draw, the model-side half of the budget.

central limit theoremconcept

The sampling distribution of a mean of n independent values is close to normal once n is a few dozen, whatever the shape of the values, with standard error sigma over the square root of n.

certificateconcept

A claim, made at a time, that something is safe to act on.

challenge setinstrument

A test collection built so that a shortcut which passes the benchmark fails on it.

chance levelconcept

The value a rank statistic reaches on average under a random ranking.

chunkconcept

A piece of a document, the unit a retrieval pipeline encodes and indexes.

classifierconcept

A consumer that produces a score per row and turns it into a decision with a threshold.

codebookconcept

The small set of allowed values a quantizer replaces each number with.

coherence timeconcept

The interval over which a changing quantity stays correlated with itself.

cold, warmconcept

A cold measurement is taken before the cache holds anything useful, a warm one after.

column spaceconcept

The span of a matrix's columns, which is the set of every output the matrix can produce, of dimension equal to the rank.

commit hashinstrument

The fingerprint git assigns to a snapshot of a repository and its history, which identifies the content exactly and does not by itself prove when it existed.

commute timeconcept

The expected number of steps a random walk on a graph needs to go from one node to another and back.

concentratedconcept

Of a spectrum, having a few eigenvalues that carry most of the total.

conditional probabilityconcept

The probability of A among the repetitions in which B occurred, the probability of both divided by the probability of B.

confidenceconcept

Of a rule, the support of the rule's itemset divided by the support of its antecedent.

confidence intervalconcept

A range that would contain the true value in a stated fraction of repeated samples, usually 95 percent.

confoundconcept

A variable that moves with both the treatment and the outcome so that a measured difference cannot be attributed.

confusion matrixconcept

The four counts a two-class classifier with a threshold produces on a test set, true and false positives and negatives, from which precision, recall, the false positive rate, and accuracy are read as conditional probabilities.

consumerconcept

The function that acts on a vector, the first element of an observer.

contractioninstrument

A formula that reduces several axes to one verdict.

contrastive objectiveconcept

A training rule that pulls pairs declared similar together and pushes other pairs apart.

controlinstrument

A comparison arm that should not show the effect, run beside the arm that should.

correctionconcept

An erratum or retraction, a change to a published number or claim that the record keeps beside the original, naming what was wrong and what replaced it.

correlationconcept

The cosine of two centred columns, between minus one and one, unchanged by shifting or rescaling either.

cosineconcept

The dot product divided by the product of the two lengths, between minus one and one, unchanged by rescaling either vector.

coupling nullconcept

The case, alignment near one, in which the read subspace and the high-variance subspace coincide and the reconstruction-optimal code is also the read-preserving one.

covarianceconcept

The expectation of the product of two variables' deviations from their means, positive when they move together, the off-diagonal entry of the covariance matrix and the numerator of the correlation.

covariance matrixconcept

The matrix of pairwise covariances of a set of rows, whose trace is the total variance.

coverageconcept

The fraction of decisions a certificate clears, reported beside its false-clear rate, since a certificate that clears nothing has a false-clear rate of zero and no use.

cross-corpus gateinstrument

The validation rule that an encoder votes only if its held-out AUROC on a corpus it was not trained on clears a preregistered margin over a bag-of-words null.

cross-entropyconcept

The expected bits per outcome when outcomes drawn from p are coded as if from a model q.

cross-support ratioconcept

The smallest item support in an itemset over the largest, with a threshold below which the itemset is discarded.

cross-validationinstrument

Splitting the data into folds and evaluating on each fold a model trained on the others.

curvatureconcept

The second derivative of a consumer, which the finite difference of equation 0.8 does not read and which sets the error of the linear model at a step.

D

DBSCANinstrument

A clustering that calls a point a core point when at least a minimum number of points lie within a radius, grows clusters by reachability from core points, and leaves the rest as noise.

decision boundaryconcept

The set of inputs whose score equals the threshold.

decision treeinstrument

A classifier that scores by a sequence of axis-aligned splits, flat within each leaf, so that its sensitivity is zero almost everywhere and its importances count splits.

declarationinstrument

A sealed statement of what a study will count, drop, or treat as a failure, written before the run.

degreeconcept

Of a node in a graph, the number of edges it has.

densityconcept

The local crowding of rows around a point, the coordinate the geodesic reader of a spectral embedding discards and DBSCAN and the density detector read.

deployment mismatchconcept

The failure in which the consumer that was evaluated is not the consumer that was deployed, or time moved between the two.

detectorinstrument

A scorer that calls a row an outlier, of four families reading distance from the mean, distance to neighbours, density relative to neighbours, or cluster membership.

determinantconcept

For a two by two matrix, ad minus bc, the number whose vanishing means the columns are dependent and no inverse exists.

direction-only quantizerinstrument

A quantizer that stores each vector's length exactly and rounds its direction.

discretizationinstrument

Collapsing an ordered quantity to a few labels by binning it, so that values in one cell become indistinguishable.

disparate impact ratioconcept

The rate of a favourable decision in one group divided by the rate in another.

distance concentrationconcept

The narrowing of the spread of pairwise distances as dimension grows, read in the book as the reader running out of resolution.

distortionconcept

The error a code costs a reader, the trace of the read operator against the error covariance.

dot productconcept

The sum of the coordinatewise products of two vectors.

driftconcept

A change over time in what a consumer reads or in the data it reads.

E

early stoppinginstrument

Halting a boosting run when a held-out score stops improving.

effective rankconcept

The number of directions a matrix really uses, the square of the sum of its eigenvalues over the sum of their squares, defined for a nonnegative spectrum that is not all zero, with no cutoff to choose.

eigenvalue, eigenvectorconcept

A direction a symmetric matrix only stretches, and the factor by which it stretches it.

embeddingconcept

A vector assigned to an object, a word, a sentence, a node, a document, so that nearness in the vector space stands for a relation between the objects.

encoderconcept

A model that maps an input to an embedding.

ensembleinstrument

A scorer that averages or votes several scorers.

entropyconcept

The expected surprise of a distribution, the bits needed per outcome under the best code, at most the log base two of the number of outcomes.

equalized oddsconcept

The requirement that the true-positive rate and the false-positive rate be the same across groups.

escalationconcept

The decision to hand an item to a person rather than decide it, the single-decision form of abstention.

estimator, unbiasedconcept

A rule that produces an estimate of an unknown quantity from a sample, unbiased when its expectation over samples is that quantity.

Euclidean distanceconcept

The straight-line distance between two vectors, which reads every coordinate at the scale it arrives in.

eventconcept

A set of outcomes of an experiment, the thing a probability is assigned to.

evictionconcept

Choosing what to drop when a cache is full.

expectationconcept

The average of a random variable's values weighted by their probabilities, its long-run average over repetitions, also called the mean.

expected calibration errorinstrument

The average over score bins of the absolute difference between the mean score and the fraction of positives in the bin.

explained varianceconcept

The fraction of total variance retained by a set of principal components, the identity reader's criterion for a reduction.

F

F1concept

Twice the product of precision and recall over their sum.

false-clear rateconcept

The fraction of the decisions a certificate cleared in which the witness said otherwise, conditional on clearing and reported beside the certificate's coverage.

false positive rateconcept

The fraction of negatives a classifier labels positive, which like recall does not depend on the base rate, so that classifiers are compared across datasets by those two and not by precision.

family-wise error rateconcept

The probability of at least one false alarm across a set of tests, at most the number of tests times the per-test threshold by the union bound.

fine-tuninginstrument

Continuing to train an encoder on a new objective or corpus, so that its quotient changes.

finite differenceinstrument

An estimate of a derivative from two evaluations of the function at points a small step apart.

the flipresult

At matched bits, the outcome in which the code with the worse reconstruction error scores better on the consumer's task, while a code built to destroy the read subspace scores worst.

floor, ceilingconcept

A floor is a lower bound a quantity cannot fall below and a ceiling an upper bound it cannot exceed, each proved or measured and named as such.

footprintconcept

The set of entries a reader reads.

formula searchinstrument

A score written as a short expression in the features, such as the smaller of two features plus a third, with a threshold.

freshnessconcept

Whether a stored value is still within its coherence time when it is read.

Frobenius normconcept

The square root of the sum of a matrix's squared entries, which also equals the square root of the sum of its squared singular values.

G

gateinstrument

A bar that a build or a claim must pass before it proceeds, with the bar and the null written down first.

Gaussianconcept

The normal distribution, in many dimensions the one whose density falls with the Mahalanobis distance.

geodesic distanceconcept

The length of the shortest path along edges between two nodes of a graph.

geometric decision costconcept

The cost of an alternative in a decision task is the Mahalanobis distance between the encoding of the alternative and the encoding of the task's reference point under the inverse covariance.

Geometric Evaluation Theoryconcept

An evaluator-relative theory of preference, value, and choice.

gradientconcept

The vector of a function's partial derivatives, the direction of fastest increase, whose dot product with a small step is the first-order change in the function.

Gram and Schmidtconcept

The procedure that turns independent vectors into an orthonormal basis for their span, dividing the first by its length and subtracting from each next vector its projections onto the basis made so far.

graphconcept

A set of nodes and a set of edges joining pairs of them.

H

harnessconcept

The code that evaluates a model.

hashinstrument

A short fixed-length fingerprint of a file, computed so that any change to the file changes the fingerprint.

headconcept

One attention operation.

Hessianconcept

The matrix of second derivatives of a score, whose off-diagonal entries are the interactions.

hierarchical clusteringinstrument

A clustering that merges the closest pair of clusters at each step, under a linkage that reads the nearest pair, the farthest, or the average, so that merge heights never decrease.

hubconcept

A row retrieved as a nearest neighbour far more often than chance allows.

hubnessresult

The excess of a few rows in the nearest-neighbour lists of many queries over what the Poisson ceiling allows, measured by the busiest count and the Robin Hood index, a property of the queries.

I

identity matrixconcept

The square matrix with ones on the diagonal and zeros elsewhere, which leaves every vector unchanged.

identity readerconcept

The consumer whose read operator is the identity, for which read distortion is mean squared error.

importanceinstrument

A per-feature score of how much a classifier reads it.

imputationinstrument

Writing a value into a missing cell that the consumer will read.

independenceconcept

Two events are independent when knowing one changes nothing about the other, so that the probability of both is the product.

intrinsic dimensionconcept

The number of directions a dataset varies along locally, whatever the number of its coordinates and whatever the number of its covariance directions.

inverseconcept

The matrix that undoes a square matrix, so that the inverse times A times x is x.

inverted fileinstrument

An index that partitions vectors into cells by k-means and answers a query by searching only the cells nearest to it.

isotropicconcept

Of a covariance, having the same variance in every direction.

itemsetconcept

A set of items that appear together in a transaction.

J

Jaccardconcept

The size of the intersection of two sets over the size of their union, between zero and one, zero exactly when the sets are disjoint, which discards joint absence.

Jacobianconcept

The matrix of partial derivatives of a vector-valued consumer, whose transpose times itself averages to the read operator.

K

Kendall correlationconcept

The fraction of item pairs two rankings order the same way, minus the fraction they order differently.

kernelconcept

The directions a matrix sends to zero.

KL divergenceconcept

A measure of how far one probability distribution is from another, zero when they are identical.

k-meansinstrument

A clustering that minimizes the sum of squared errors to the cluster centres.

KV cacheconcept

The stored keys and values of earlier tokens, kept so they need not be recomputed.

L

lagconcept

How far a replica trails the primary.

Landauer's principleresult

Erasing one bit costs at least Boltzmann's constant times the absolute temperature times the natural log of two.

language modelconcept

A model that reads a sequence of tokens and outputs a probability for the next one, scored by perplexity.

Laplacianconcept

A matrix built from a graph's edges whose eigenvectors, from the smallest eigenvalue up, are the smoothest functions on the graph.

latent semantic analysisinstrument

The truncated singular value decomposition of the term-document matrix, ordinarily uncentred, which coincides with principal components on documents only after centring.

law of large numbersconcept

The sample mean settles toward the expectation as the sample grows, its standard error falling with the square root of n, so that halving the error takes four times the data.

leakageconcept

Any information in the training data that could only be known after the decision, or any identifier that lets the model recognize a row it will be tested on.

least-squares lineconcept

The straight line predicting one column from another that minimizes the sum of squared vertical errors, with slope the covariance over the variance of the predictor, passing through the two means, and accounting for r squared of the variance.

ledger classconcept

One of six labels every headline claim carries, proved, demonstrated, replicated, predicted, exploratory, or refuted, defined in the evidence ledger of Volume 14.

length, normconcept

The square root of the sum of a vector's squared coordinates, Pythagoras in d dimensions, which is also the square root of the vector's dot product with itself.

licensed, not licensedconcept

A claim is licensed when it is a theorem checked in Lean in appendix C, or a measurement sealed with its commit hash before the run that survived its registered null and bar, and a chapter may rest on it.

liftconcept

Confidence divided by the consequent's support, so that lift one is the independence baseline.

likelihood, maximum likelihoodconcept

The likelihood of a model is the probability it assigns to the observed data, and maximum likelihood chooses the parameters that make it largest, which is minimizing the total surprise the model assigns, the cross-entropy with the sample standing in for the truth.

linear classifierinstrument

A classifier that scores by a weighted sum, logistic regression or a linear support vector machine.

linear combinationconcept

A sum of scalar multiples of vectors.

linear independenceconcept

Vectors none of which is a linear combination of the others, so that the only combination giving zero has every scalar zero.

logistic regressioninstrument

A linear classifier whose score is the sigmoid of a weighted sum, strictly between zero and one, above one half exactly on one side of the hyperplane.

low-rank approximationconcept

The best approximation of a matrix by one of rank k in total squared error keeps the first k terms of its singular value decomposition, and the error is the sum of the squared singular values dropped, the Eckart and Young theorem.

M

Mahalanobis distanceconcept

The Euclidean distance of a row from the mean after whitening, which needs a positive-definite covariance or a pseudoinverse on its support.

manifoldconcept

A curved surface of some dimension that looks flat when viewed closely.

marginconcept

How far a row's score sits from the threshold.

matched bitsinstrument

The rule that two codes are compared only at the same bit count.

matrixconcept

A table of numbers with n rows and d columns that sends a vector to the linear combination of its columns with the vector's coordinates as the scalars.

mean, medianconcept

The mean of a sample is its average and the median its middle value once sorted.

metricconcept

A rule for the distance between two rows or two outputs.

min-over-strataconcept

The rule that a verdict over several groups is the worst group's verdict, with abstention counted as a verdict, never the average.

Monotone Invariance Theoremresult

A strictly monotone transform of a score in either direction cannot change its optimal thresholded F1, because the sweep tries thresholds both ways.

Monte Carloconcept

Estimating a probability or an expectation as the fraction or average over many simulated runs, a sample proportion with standard error the square root of p(1 minus p) over N.

multiple comparisonsconcept

The inflation of false positives when many hypotheses are tested and the best is reported.

multipletconcept

A group of eigenvalues that are equal or nearly so, whose pattern names the shape a dataset lies on against a finite list of templates.

N

Nadeau and Bengio correctioncorrection

The inflation of the variance of a repeated cross-validation estimate by one plus the ratio of test to training size times the number of repeats, because the folds are not independent.

naive Bayesinstrument

A classifier that multiplies one-dimensional likelihoods and adds their logs, so that each feature's contribution is the same whatever the others are and it cannot read an interaction.

natconcept

The unit of information measured with the natural logarithm, between 1.4426 and 1.4427 bits.

nearest neighbourconcept

A row at minimal distance from a query.

neighbourhood graphconcept

A graph on a dataset that joins each row to its k nearest rows, or to every row within a radius.

normal distributionconcept

The bell-shaped distribution with mean mu and standard deviation sigma, with about 68 percent of its mass within one standard deviation, 95 within two, and 99.7 within three, and 1.96 the multiplier for exactly 95.

nuisanceconcept

The directions of the data a consumer cannot distinguish, the kernel of its read operator.

null hypothesisconcept

The statement that the effect under study is absent, under which a test statistic's p-value is computed.

null modelinstrument

A version of the data with the structure under test removed and everything else kept, the right comparison for any measured statistic.

null spaceconcept

The set of vectors a matrix sends to zero, also called the kernel, the directions the matrix cannot see.

O

observerconcept

A consumer, its output metric, and its budget, written as the triple in equation 1.1.

operating pointconcept

The row at which a consumer is read, or the threshold at which a classifier is scored.

orthogonalconcept

Of two vectors, having dot product zero.

orthogonal matrixconcept

A square matrix with orthonormal columns, whose transpose is its inverse and which preserves every length, dot product, and angle.

orthonormal basisconcept

A basis of unit vectors orthogonal to each other.

outer productconcept

The matrix whose entry in row i and column j is the product of a vector's i-th and j-th coordinates, of rank at most one and positive semidefinite for a vector with itself.

outlierconcept

A row the reader cannot place.

output metricconcept

The rule by which a consumer's mistakes are scored, the second element of an observer.

P

pairedinstrument

Of a comparison, made on the same rows or seeds for both arms.

paraphrase classconcept

A set of rewordings of one input that preserve its meaning.

partial derivativeconcept

The rate of change of a function of a vector when one coordinate moves and the others stay fixed.

percentileconcept

The value below which a given fraction of the rows fall.

percentile intervalconcept

The bootstrap interval that takes the 2.5th and 97.5th percentiles of a statistic recomputed on a few thousand resamples.

per-channel quantizerinstrument

A quantizer that chooses a scale per coordinate.

permutation testconcept

A test that computes the p-value by reassigning the labels under the null, every way or a few thousand random ways, and counting the fraction of statistics at least as extreme as the observed.

perplexityconcept

Two to the power of the average number of bits a language model needs per token of a test text.

plantedinstrument

Of a case, built so that the answer is known before the instrument reads it, such as an affine consumer whose read operator is its weight vector's outer product.

Poisson ceilinginstrument

The largest neighbour count that at least one point in a dataset would reach by chance under a Poisson null, above which a count is evidence of a hub.

Poisson distributionconcept

The distribution of a count of rare events, the limit of the binomial when n is large and p small with np held at mu, with mean and variance both mu.

posited versus measuredconcept

The division of every claim in a report into those asserted by design and those backed by an artifact.

positive definiteconcept

A symmetric matrix whose quadratic form is positive for every nonzero vector, which is the same as every eigenvalue being positive.

positive semidefiniteconcept

Of a symmetric matrix, having every quadratic form nonnegative, as the read operator and the covariance are.

power iterationconcept

Multiplying a starting vector by a symmetric matrix and rescaling, repeatedly, so that the component along the top eigenvector grows fastest and the vector turns toward it.

precision, recallconcept

The fraction of predicted positives that are truly positive, and the fraction of true positives that were predicted.

preregistrationinstrument

Committing the hypothesis, the bar, and the analysis before the measurement is run, so that the record shows what was predicted.

principal component analysisinstrument

Projection of the centred data onto the eigenvectors of its covariance with the largest eigenvalues, the linear orthogonal projection of rank k that minimizes reconstruction error for the identity reader.

probabilityconcept

The fraction of repetitions in which an event would occur if the experiment were repeated without end, a number between zero and one, obeying the complement rule and the addition rule.

product quantizationinstrument

Splitting a vector into pieces and quantizing each piece with its own codebook.

projectionconcept

The component of a vector along a unit direction.

pseudo-random generatorconcept

A deterministic rule that produces a sequence indistinguishable from chance from a starting value, the seed, so that a simulation which records its seed reruns to the last digit and one that does not cannot.

p-valueconcept

The probability of seeing a difference at least as large as the one observed if the true difference were zero.

Q

quadratic formconcept

The number x transposed A x that a symmetric matrix assigns to a vector, a sum of the entries times pairs of coordinates.

quantizationconcept

Replacing each number with one of a small set of allowed values so that it can be stored in a few bits.

query, key, valueconcept

The three vectors each token produces inside attention.

query setconcept

The rows a retrieval benchmark asks about.

quotientconcept

The space of data with a set of transformations declared not to matter, so that two rows differing only by such a transformation are the same point.

R

random forestinstrument

An ensemble of decision trees, each fit on a bootstrap sample with a random subset of features at each split.

random variableconcept

A number attached to each outcome of an experiment, described by its distribution, the values it can take with the probability of each.

rankconcept

The dimension of a matrix's column space, at most the number of rows and of columns.

rank certificateinstrument

A bound, computed from a compressed representation, that certifies which neighbour rankings the compression preserved for a consumer and which it did not.

rank-faithfulconcept

Of a map, preserving the ordering of distances without any bound on the stretch.

read directionconcept

An eigenvector of the read operator with a nonzero eigenvalue, a direction the consumer is sensitive to.

read distortionconcept

The error as a consumer experiences it, the trace of the read operator times the error's second-moment matrix, which is its covariance when the error is centered.

read operatorconcept

The average outer product of a consumer's sensitivity over a dataset, an average of local linearizations whose kernel is the set of directions unread at almost every row of the workload.

read subspaceconcept

The directions of the data a consumer can distinguish, spanned by the eigenvectors of its read operator with nonzero eigenvalue.

recall at kconcept

The fraction of a query's true k nearest neighbours that an index returned.

recognizerinstrument

The instrument that decides whether a clustering certificate is right, wrong, or vacuous, by naming the manifold from the eigenvalue multiplets or certifying that none is present.

reconstruction errorconcept

The squared length of the difference between a row and its approximation, the identity reader's distortion.

refresh floorcorrection

A claimed lower bound on how often a certificate must be renewed.

refresh intervalinstrument

The longest renewal period that keeps a certificate within its promised error, a measured property of the system and not a convention.

refusalconcept

An instrument's declining to report a number it cannot support.

registeredconcept

Of a claim, bar, null, or budget, written into a sealed file before the measurement.

reliability weightconcept

Zero or twice a validated encoder's held-out AUROC minus one, whichever is larger, used as that encoder's authority.

replicaconcept

A copy of a database kept on another machine.

rerankinstrument

Reordering a candidate list with a second scorer.

residualconcept

What is left of a vector after its projection is subtracted, orthogonal to the direction projected onto.

residualizationinstrument

Removing from a column the least-squares multiple of another.

retrieval-augmented pipelineconcept

A system that answers a question by chunking documents, embedding the chunks, indexing them, retrieving the nearest to the embedded question, and handing them to a generator.

Robin Hood indexinstrument

The fraction of a total count that would have to move from points above the mean to points below it to make every count equal.

ROC curveinstrument

The path of true positive rate against false positive rate as the threshold sweeps, whose area is the AUROC.

rotary position embeddingconcept

A rotation applied to queries and keys that encodes where each token sits in the sequence.

ROUGEconcept

A family of scores for generated text against a reference.

S

safe pruningconcept

A rule for discarding candidates during a search that is guaranteed to discard no solution.

sample varianceconcept

The average squared deviation from the sample mean with n minus 1 in the denominator, because the sample mean sits closer to its own sample than the true mean does and the deviations come out a little small.

samplinginstrument

Choosing which rows to read.

sampling distributionconcept

The distribution of a statistic across repeated samples of the same size, whose standard deviation is the statistic's standard error.

scoreconcept

The number a classifier produces per row before a threshold turns it into a decision.

sealedinstrument

Of a prediction, committed with its hash recorded before the measurement was run, so that anyone with the repository can verify it has not changed, and with a public push, a signed tag, or an archival deposit to fix when.

seedconcept

The number that fixes a run's pseudo-randomness.

sensitivityconcept

The vector of partial derivatives of a consumer with respect to each coordinate of its input, at one point.

session deckreference

The lecture deck of ECE 514, cited by line range from the instructor's session outlines, which are not public.

shardinstrument

One partition of an index that is searched separately, with the results merged.

silhouetteconcept

For a row, the difference between its mean distance to the nearest other cluster and its mean distance to its own cluster, divided by the larger of the two.

Simpson's paradoxconcept

A reversal of a comparison when groups are combined, which the book reads as an aggregation quotient.

singular valueconcept

The size of one rank-one term of the singular value decomposition, the square root of an eigenvalue of A transposed A.

singular value decompositionconcept

Any matrix written as a sum of rank-one outer products ordered by size, with orthonormal vectors on both sides, the eigenvector idea for a matrix that is not square.

skewnessconcept

The mean cubed deviation of a column from its mean over the cube of its spread, zero for a symmetric column.

softmaxconcept

The function that exponentiates a list of numbers and divides by their sum, so that they are positive and add to one.

sources tableinstrument

The table at the end of every chapter naming, for each number, the repository, file, and line range it came from.

spanconcept

The set of all linear combinations of a set of vectors.

Spearman correlationconcept

The ordinary correlation between two lists of ranks.

spectral clusteringinstrument

Clustering the rows of the row-normalized spectral embedding, which reads the angle and discards the density.

spectral decompositionconcept

A symmetric matrix written as the sum of its eigenvalues times the outer products of its orthonormal eigenvectors.

spectral embeddinginstrument

The coordinates a node receives from its values in the first few nontrivial eigenvectors of the graph Laplacian.

spectrumconcept

The list of a matrix's eigenvalues.

splitinstrument

A partition of the rows into a part the model is fit on and a part it is scored on.

standard deviationconcept

The square root of the variance, the spread of a variable in its own units.

standard errorconcept

The spread of an estimate across repeated samples.

standardizationinstrument

Subtracting a column's mean and dividing by its spread, so that it has mean zero and variance one.

stratificationinstrument

Splitting rows into strata, by difficulty or by group, and scoring each separately, so that the report can take the minimum over strata.

sum of squared errorsconcept

The sum over rows of the squared distance to the row's cluster centre, the validity index k-means minimizes.

supportconcept

Of an itemset, the fraction of transactions that contain it.

surpriseconcept

Minus the log base two of an outcome's probability, its information in bits.

surrogateinstrument

A quadratic stand-in for the consumer's output metric, the read distortion, used to allocate bits when the output itself cannot be.

sweepinstrument

Running a measurement across a range of one parameter and reading the curve.

symmetric matrixconcept

A square matrix equal to its own transpose.

T

teacher forcingconcept

Feeding a language model the correct text as context rather than its own earlier outputs.

template matchinstrument

Comparing a measured list of numbers, such as eigenvalue ratios, to a stored list for each candidate shape and picking the smallest distance between the logarithms.

test statisticconcept

A number computed from the sample that sits near a reference value under the null and far from it otherwise, whose observed value the p-value compares with its distribution under the null.

TF-IDFconcept

A weighting of term counts by how rare the term is across the collection, so that a term in every document carries no weight.

thresholdconcept

The value at which a score becomes a positive decision.

tokenconcept

A piece of text, roughly a word, the unit a language model reads and writes.

traceconcept

The sum of a matrix's diagonal, which for a covariance is the total variance.

transactionconcept

One row of a market-basket table, the set of items bought together.

transmission time intervalconcept

The one-millisecond slot in which a 5G tower schedules a transmission, abbreviated TTI.

transposeconcept

The matrix with rows and columns swapped, written with a superscript T.

truncationinstrument

Keeping the first k components of a spectrum and dropping the rest, a bet that the consumer reads the top of the spectrum.

type I and type II error, powerconcept

A type I error rejects a true null, at the rate the threshold fixes.

U

uniform distributionconcept

Equally likely to fall anywhere in an interval, with mean one half and variance one twelfth on the unit interval.

unit vectorconcept

A vector of length one, a pure direction.

V

vacuity thresholdresult

The value of a certificate's statistic below which the certificate is uninformative, derived from the problem rather than tuned to the data.

validity indexconcept

A score for a clustering computed without labels.

varianceconcept

The mean squared deviation of a column from its mean, the identity reader's measure of spread.

vectorconcept

A list of d numbers, and the arrow from the origin to the point with those coordinates.

verdictconcept

The outcome of a registered test, pass, fail, or abstain, taken as the worst group with the groups too thin to score counted.

W

water-fillingconcept

The allocation of a bit budget across directions that gives each direction half the log of its sensitivity-weighted variance over a common water level, and nothing to directions under the water.

Weyl's lawconcept

The asymptotic rule for how the number of eigenvalues of a continuum Laplacian below a value grows with that value, whose exponent reveals the dimension of the space.

whiteningconcept

Rescaling centred data by the inverse square root of a positive-definite covariance, or a pseudoinverse on its support, so that the covariance becomes the identity.

with replacement, without replacementconcept

Drawing rows with replacement lets a row appear more than once, as the bootstrap does, and drawing without replacement lets each appear at most once.

witnessconcept

An independent measurement of whether a certificate's claim was true.

Y

Youden F1 boundcorrection

The bound on the best F1 a score can reach at any threshold, from the Youden index, true positive rate minus false positive rate, maximized over thresholds.

Youden indexinstrument

True positive rate minus false positive rate at a threshold, whose maximum over thresholds is the pointwise ceiling that prunes the formula search.

Z

z-scoreconcept

A value with the mean subtracted and the result divided by the standard deviation, the number of standard deviations it sits from the mean.