Interface: UnifiedMessageInput

Defined in: core/dist/types/types/media.d.ts:54

Unified multimodal message input Can contain text, images, video frames, and/or audio

Properties

audio?

optional audio?: MediaAudio

Defined in: core/dist/types/types/media.d.ts:62

Audio recording - supports live MediaStream

---

file?

optional file?: MediaFile

Defined in: core/dist/types/types/media.d.ts:66

Generic file input (PDF, CSV, etc.)

---

frames?

optional frames?: MediaStream | MediaFrame[] | Iterable<MediaFrame, any, any> | AsyncIterable<MediaFrame, any, any>

Defined in: core/dist/types/types/media.d.ts:60

Video frames with timestamps - supports live MediaStream

---

images?

optional images?: MediaImage[]

Defined in: core/dist/types/types/media.d.ts:58

One or more images (without timestamps)

---

mode?

optional mode?: "transcribe" | "analyze"

Defined in: core/dist/types/types/media.d.ts:64

Audio processing mode

---

responseSchema?

optional responseSchema?: unknown

Defined in: core/dist/types/types/media.d.ts:68

Optional response schema for structured outputs

---

text?

optional text?: string

Defined in: core/dist/types/types/media.d.ts:56

Text prompt or instruction