Search Results for "device"

LLM.swift is a Swift package that enables developers to run Large Language Models (LLMs) directly on Apple devices, including iOS, macOS, and watchOS. By leveraging Apple's hardware and software optimizations, LLM.swift facilitates on-device natural language processing tasks, ensuring user privacy and reducing latency associated with cloud-based solutions.​

...Users can personalize the app by adjusting themes, fonts, and system prompts, and it integrates with Apple's Shortcuts for enhanced functionality. Fullmoon supports models like Llama-3.2-1B-Instruct-4bit and Llama-3.2-3B-Instruct-4bit, facilitating efficient on-device AI interactions without the need for an internet connection.

...Built with SwiftUI, the iOS app wraps a secure web-powered interface and communicates with the Lumo service in a way that ensures zero-access encryption, meaning even Proton cannot read or log user chats—only the device holder can decrypt them. It includes native features like on-device voice recording and speech recognition, flexible navigation, and payment integration for subscription plans if users choose expanded capabilities. The app’s architecture uses a combination of WebView and JavaScript bridges to power responsive chat UI while retaining strong data protection principles.

Core AI Models is Apple’s repository for building and running on-device AI models with Core AI. It provides export recipes that convert supported open-source models into Core AI model files. It also includes Python primitives for authoring custom PyTorch models that are better suited for Apple platform deployment. The Swift package adds runtime utilities that help developers integrate exported models into macOS and iOS apps.

WhisperKit is a Swift package that integrates OpenAI's popular Whisper speech recognition model with Apple's CoreML framework for efficient, local inference on Apple devices. Whisper has pulled the future forward when fast, free and virtually error-free translation and transcription will be ubiquitous. It inspired numerous developers to improve and deploy it with minimal friction and maximum performance. We founded Argmax in November 2023 to empower developers and enterprises everywhere to...

...Works with images, PDFs, and subtitles using OCR (Apple Vision). Text Selection Translation: Select text in any app and press Cmd+Option+Z to translate directly. No OCR needed. - Free and open-source (GPL-3.0) - On-device translation using Apple Translation - Works offline with downloaded language packs - 20 languages with auto-detect - Optional cloud engines (DeepL, Google, Azure) with your own API key - Auto-copy to clipboard - Translation history with search - Lightweight menu bar app - Apple Silicon and Intel Mac supported - macOS 15 (Sequoia) or later required