mlc-ai/web-llm

A high-performance in-browser LLM inference engine accelerated by WebGPU and compatible with the OpenAI API.

APISDKLLM

Visit mlc-ai/web-llm website →

Category
AI インフラ
Official URL
https://github.com/mlc-ai/web-llm
Last updated
Wed Apr 08
Tags
API · SDK · LLM