agents-js

agents-js is an open-source Node.js framework for building realtime, multimodal AI agents that can process and generate text, audio, video, and tool calls simultaneously. It is designed for developers building interactive, low-latency applications like voice assistants or live copilots, offering a unified API to orchestrate streaming LLMs, speech-to-text, and text-to-speech. Its key innovation is enabling seamless, human-like conversational experiences by handling multiple input/output modalities in real time, making it a compelling alternative to fragmented, single-modality pipelines.