GitHub - stanford-mast/blast: Browser-LLM Auto-Scaling Technology
A high-performance serving engine for web browsing AI.
❓ Use Cases
I want to add web browsing AI to my app... BLAST serves web browsing AI with an OpenAI-compatible API and concurrency and streaming baked in.
I need to automate workflows... BLAST will automatically cache and parallelize to keep costs down and enable interactive-level latencies.
Just want to use this locally... BLAST makes sure you stay under budget and not hog your computer's memory.
🚀 Quick Start
pip install blastai && blastai...
Read more at github.com