Interface: LLM

Unified language model interface

Hierarchy

• LLMChat

  ↳ LLM

Implemented by

• Ollama

Properties

metadata

• metadata: LLMMetadata

Defined in

packages/core/src/llm/types.ts:43

Methods

chat

▸ chat(params): Promise<AsyncIterable<ChatResponseChunk>>

Get a chat response from the LLM

Parameters

Name	Type
params	LLMChatParamsStreaming

Returns

Promise<AsyncIterable<ChatResponseChunk>>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:47

▸ chat(params): Promise<ChatResponse>

Parameters

Name	Type
params	LLMChatParamsNonStreaming

Returns

Promise<ChatResponse>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:50

---

complete

▸ complete(params): Promise<AsyncIterable<CompletionResponse>>

Get a prompt completion from the LLM

Parameters

Name	Type
params	LLMCompletionParamsStreaming

Returns

Promise<AsyncIterable<CompletionResponse>>

Defined in

packages/core/src/llm/types.ts:55

▸ complete(params): Promise<CompletionResponse>

Parameters

Name	Type
params	LLMCompletionParamsNonStreaming

Returns

Promise<CompletionResponse>

Defined in

packages/core/src/llm/types.ts:58