Search Results for "macbook"

Coucou is an open-source desktop and iPhone companion for monitoring AI coding agents without constantly switching back to a terminal. On macOS it lives around the MacBook notch, while Windows and Linux versions place the interface at the top of the screen. It tracks sessions from Claude Code, Codex, Cursor, Gemini CLI, OpenCode, Copilot CLI, and other agents. Permission requests and questions can be approved or answered directly from the companion interface. Users can inspect live file edits, jump to the correct terminal, drop files for context, and chat with cloud or local models. ...

TurboFieldfare is a custom Swift and Metal runtime for running the instruction-tuned Gemma 4 26B-A4B model on Apple Silicon Macs with limited memory. Instead of loading the entire model, it keeps the shared core and KV cache in RAM while streaming only the routed experts required for each token from SSD. This approach reduces active memory use to roughly 2 GB while the installed model occupies about 14.3 GB of storage. The project includes a native Mac application, command-line tools, a...

Running Llama 2 with gradio web UI on GPU or CPU from anywhere (Linux/Windows/Mac).

...It is specifically optimized for local and resource-constrained deployment and has been validated on NVIDIA DGX Spark, Apple Silicon MacBooks, and Mac mini systems. FP8 testing reached around 100–105 tokens/s on DGX Spark and 86–90 tokens/s on an M4 Pro MacBook. BF16, FP8, and INT4 weights are available, while deployment options include SGLang, vLLM, and experimental Ollama support on Apple Silicon.