Model Database's logo
Join the Model Database community

and get access to the augmented documentation experience

to get started

Interface: TextGenerationStreamToken

Properties

id

id: number

Token ID from the model tokenizer

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:7


logprob

logprob: number

Logprob

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:11


special

special: boolean

Is the token a special token Can be used to ignore tokens when concatenating

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:16


text

text: string

Token text

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:9