hashbrown

WebLlmRequest

Streaming request accepted by an injected WebLLM engine; user content defaults to text.

WebLlmRequest
@typeTUserContent
messages
({
        role: 'system' | 'assistant';
        content: string;
    } | {
        role: 'user';
        content: TUserContent;
    })[]
model
string
response_format
{
        type: 'json_object';
        schema: string;
    }
stream
true