Model Database's logo
Join the Model Database community

and get access to the augmented documentation experience

to get started

Interface: TextGenerationStreamOutput

Properties

details

details: null | TextGenerationStreamDetails

Generation details Only available when the generation is finished

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:81


generated\_text

generated_text: null | string

Complete generated text Only available when the generation is finished

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:76


token

token: TextGenerationStreamToken

Generated token, one at a time

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:71