LLM.swift

LLM.swift is a Swift package that enables developers to run Large Language Models (LLMs) directly on Apple devices, including iOS, macOS, and watchOS. By leveraging Apple's hardware and software optimizations, LLM.swift facilitates on-device natural language processing tasks, ensuring user privacy and reducing latency associated with cloud-based solutions.

Features

On-device execution of LLMs
Compatibility with iOS, macOS, and watchOS
Utilizes Apple's hardware accelerations
Ensures user data privacy
Reduces dependency on cloud services
Supports integration with Swift-based applications
Provides APIs for natural language processing tasks
Optimized for performance on Apple devices
Open-source and community-driven development

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow LLM.swift

LLM.swift Web Site

Other Useful Business Software

Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.

Try Free

Rate This Project

User Reviews

Be the first to post a review of LLM.swift!

Additional Project Details

Programming Language

Swift

Related Categories

Swift LLM Inference Tool

Registered

2025-03-18

Similar Business Software

LM-Kit.NET

LM-Kit.NET is a cutting-edge, high-level inference SDK designed specifically to bring the advanced capabilities of Large Language Models (LLM) into the C# ecosystem. Tailored for developers working within .NET, LM-Kit.NET provides a comprehensive suite of powerful Generative AI tools, making...

See Software
Gemini Enterprise Agent Platform

Gemini Enterprise Agent Platform is a comprehensive solution from Google Cloud designed to help organizations build, scale, govern, and optimize AI agents. It represents the evolution of Vertex AI, combining advanced model development with new capabilities for agent orchestration and...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models, including Gemini 3. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use...

See Software
RunPod

RunPod offers a cloud-based platform designed for running AI workloads, focusing on providing scalable, on-demand GPU resources to accelerate machine learning (ML) model training and inference. With its diverse selection of powerful GPUs like the NVIDIA A100, RTX 3090, and H100, RunPod supports...

See Software
OpenVINO

The Intel® Distribution of OpenVINO™ toolkit is an open-source AI development toolkit that accelerates inference across Intel hardware platforms. Designed to streamline AI workflows, it allows developers to deploy optimized deep learning models for computer vision, generative AI, and large...

See Software
Mirai

Mirai is a developer-focused on-device AI infrastructure platform designed to convert, optimize, and run machine learning models directly on Apple devices with high performance and privacy. It provides a unified pipeline that enables teams to convert and quantize models, benchmark them,...

See Software

Report inappropriate content

LLM.swift

LLM.swift is a simple and readable library

Get an email when there's a new version of LLM.swift

Features

Project Samples

Project Activity

Categories

License

Follow LLM.swift

User Reviews

Additional Project Details

Programming Language

Related Categories

Registered