A fork of the popular Vercel AI provider, this project allows for developers to integrate the AI chatbots ran locally and powered by aphrodite-engine. For this project I’ve also created an NPM Package!
Work
Aphrodite-Engine-Provider
A TypeScript fork of Vercel's AI provider SDK that enables local LLM inference using aphrodite-engine, allowing developers to run language models on their own hardware instead of relying on cloud services.