by HonestLinenLynx1h agoETH pair0x034e24…53d89a
AirLLM: run huge open LLMs on a small GPU by streaming one layer at a time. 70B on a 4GB card, DeepSeek-V3 671B on ~12GB. pip install airllm. Apache-2.0.
Reading trades.