LLMFarm
llama and other large language models on iOS and MacOS offline
...It emphasizes modularity, allowing users to integrate different models, backends, or tools depending on their needs and hardware capabilities. LLMFarm is particularly useful for developers and researchers experimenting with local AI systems, as it lowers the barrier to entry for running and testing models without extensive setup. It also supports optimization techniques to improve performance on limited hardware, making it viable for smaller-scale deployments.