AI Definitions: Test-time training (TTT)
/Test-time training (TTT) – Instead of being given truthful data to get an LLM model started in the right direction, TTTs learn by performing a task with the data. An alternative to transformers (which have high energy demands), TTTs only process more data faster, they can do so without consuming nearly as much computing power. Instead of growing as it processes data, like a transformer, it encodes the data into representations called weights. No matter how much data it processes, a TTT model won’t grow and become unwieldy.