HomeTagsonnxruntime-genai

onnxruntime-genai

onnxruntime-genai, the ONNX Runtime extension that runs language models.

Built with onnxruntime-genai

amberlin-broker

Service

The service at the centre of Amberlin: it holds the speech and language models once, for every application that wants an assistant, and decides who answers.