Search Results for "loading"

...The project bundles runnable samples that show how to run TensorFlow Lite/Edge TPU models (and similar lightweight runtimes) on mobile and embedded platforms, demonstrating common tasks like image classification, object detection, audio recognition, and pose estimation. Each sample is intended to be both a learning aid and a practical starting point: code is organized to show model loading, pre/post-processing, performance measurement, and common optimization knobs (quantization, NNAPI/Delegate usage, and hardware accelerators). The repo also collects small, well-documented models and conversion scripts so developers can reproduce a pipeline from a full-size model down to a device-friendly artifact.

qvac-fabric-llm.cpp is a cross-platform large language model inference and fine-tuning engine built as an advanced fork of llama.cpp, designed to run efficiently across desktops, mobile devices, and heterogeneous GPU environments. The project focuses on removing hardware limitations traditionally associated with LLM deployment by enabling support for a wide range of backends, including Vulkan, Metal, CUDA, and CPU, making it accessible on devices ranging from smartphones to enterprise...

...It enables users to run LLMs on personal hardware or private infrastructure, reducing dependency on external APIs and improving data privacy. The system typically provides a user-friendly interface for loading models, configuring inference parameters, and interacting with them through chat or task-based workflows. It emphasizes modularity, allowing users to integrate different models, backends, or tools depending on their needs and hardware capabilities. LLMFarm is particularly useful for developers and researchers experimenting with local AI systems, as it lowers the barrier to entry for running and testing models without extensive setup. ...

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. It's a single self-contained distributable that builds off llama.cpp and adds many additional powerful features.

BoostMultiDex is a specialized Android-library created by ByteDance to address a long-standing performance and user-experience problem on older Android devices (specifically Android 4.x and below, i.e. SDK < 21), where loading multiple dex files after installation or upgrade can lead to extremely long “black-screen” freeze times during first startup. Instead of relying on the standard Android MultiDex mechanism, BoostMultiDex reworks the loading strategy by tapping into hidden Dalvik VM internals so that original DEX bytecode can be loaded directly, bypassing costly ODEX generation. ...