Support for multiple LLMs (currently LLAMA, BLOOM, OPT) at various model sizes (up to 170B) Support for a wide range of consumer-grade Nvidia GPUs Tiny and easy-to-use codebase mostly in Python (<500 ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results