2025-06-25T12:42:22Z
hyperparameter
In machine learning, a hyperparameter is a value that determines the quantity, size (including the size in bytes of the individual elements), and shape of the model's constituent matrices, as well as various tuning functions. The essence of a hyperparameter is that there are far fewer of them than first-order parameters, and they determine the structure and coarse-grained behaviour of the model, as well as impact the cost of both training and execution. Winnowing down configurations of hyperparameters, albeit heavily moderated by the cost of training and subsequent testing, is one way AI can be used to improve itself.