Abso

Abso is an open-source LLM proxy that automatically routes requests between fast and slow models based on prompt complexity. It uses various heuristics to chose the proper model. It’s very fast and has low latency.

Installation and setup

pip install langchain-abso

Chat Model

See usage details here

---

Edit the source of this page on GitHub