Search Results for "shared memory allocator"

x
Sort By:

Showing 1 open source project for "shared memory allocator"

View related business solutions
AI Models Swift Clear Filters & Widen Search
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Try It Free
  • Go from Code to Production URL in Seconds Icon
    Go from Code to Production URL in Seconds

    Cloud Run deploys apps in any language instantly. Scales to zero. Pay only when code runs.

    Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
    Try it free
  • 1
    TurboFieldfare

    TurboFieldfare

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    TurboFieldfare is a custom Swift and Metal runtime for running the instruction-tuned Gemma 4 26B-A4B model on Apple Silicon Macs with limited memory. Instead of loading the entire model, it keeps the shared core and KV cache in RAM while streaming only the routed experts required for each token from SSD. This approach reduces active memory use to roughly 2 GB while the installed model occupies about 14.3 GB of storage. The project includes a native Mac application, command-line tools, a streaming installer, a Swift library, and an experimental OpenAI-compatible local server. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • Next

Related Categories