More Models

ART has wide support for models supported by vLLM. However, not all models support all features. For instance, if a model’s chat template does not include tool call support, you won’t be able to use tools with it natively. And if a model’s architecture doesn’t have support for LoRA layers, it won’t be compatible with our LoRA-based backend, but still may work with our full-fine-tuning backend.

Here are additional models that we’ve tested and found to work well with ART:

If you’re curious about a model that is not listed above, ask in the Discord #support channel.