Inference API documentation

Parallelism and batch jobs

Join the Model Database community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Parallelism and batch jobs

Advanced Parallelism and batch jobs are deprecated.

The API is now a fully free, for demo purposes, and advanced (production) usage will require either: