InferTehk

Browser-native local GGUF inference.

Runtime Settings

These options can be changed without reloading the model.

Session defaults
RuntimeNot initialized
ModelNot loaded
IsolationChecking
Context 0 / 2048 estimated tokens

Model Setup

Generation