AI Definitions: Test-time Training (TTT)

Test-time Training (TTT) – Instead of being given truthful data to get an LLM model started in the right direction, TTTs learn by performing tasks using the data. TTTs are an alternative to transformers—not only processing the data faster, but doing so without consuming nearly as much computing power and high energy demands. Instead of growing more powerful as it processes data like a transformer, TTTs encode the data into representations called weights. No matter how much data it processes, a TTT model won’t grow to become unwieldy.

More AI Definitions