Tag

Inference

3 entries tagged Inference · 3 terms.

Dictionary

Adaptive Thinking

An inference behavior where a frontier model self-scales its reasoning depth and tool-use budget to match the complexity of the prompt, without the operator flipping a manual extended-thinking or test-time-compute switch.

In-Memory Compute

A processor architecture that performs calculations directly inside the memory cells holding the data, eliminating the round trip to a separate compute unit.

Wafer-Scale Engine

A processor built from an entire silicon wafer rather than smaller chips diced from one, integrating dramatically more on-chip memory and compute cores to eliminate the chip-to-chip communication bottleneck that limits conventional GPU clusters at inference time.