Search Results for "llama-cpp-static"
Sort By:
Showing 133 open source projects for "llama-cpp-static"
View related business solutions-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama
node-llama-cpp is a JavaScript and Node.js binding that allows developers to run large language models locally using the high-performance inference engine provided by llama.cpp. The library enables applications built with Node.js to interact directly with local LLM models without requiring a remote API or external service. By using native bindings and optimized model execution, the framework allows developers to integrate advanced language model capabilities into desktop applications, server software, and command-line tools. ... -
2
Llama Coder
Open source Claude Artifacts – built with Llama 3.1 405B
Llama Coder is an open-source tool that lets you generate small applications (often React or web apps) from a single natural-language prompt using the Llama 3 family of models. It’s framed as an open-source “Claude Artifacts”-style experience: you describe the app you want, the tool calls an LLM hosted on Together.ai, and you get back a runnable code artifact. -
3
llama.vscode
VS Code extension for LLM-assisted code/text completion
llama.vscode is a Visual Studio Code extension that provides AI-assisted coding features powered primarily by locally running language models. The extension is designed to be lightweight and efficient, enabling developers to use AI tools even on consumer-grade hardware. It integrates with the llama.cpp runtime to run language models locally, eliminating the need to rely entirely on external APIs or cloud providers. The extension supports common AI development features such as code... -
4
Eliza
Autonomous agents for everyone
...Full support for voice, text, and media interactions. Built-in RAG memory system, document processing, media analysis, and autonomous trading capabilities. Supports multiple AI models including Llama, GPT-4, and Claude. Create custom actions, add new platform integrations, and extend functionality through a modular plugin system. Full TypeScript support. -
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
5
Jan.ai
Open source alternative to ChatGPT that runs 100% offline
...It allows you to download and run LLMs (local language models) offline while also offering optional integration with cloud-based model providers—giving you full control over your data and AI interactions. Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace. Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, and others. Create specialized AI assistants for your tasks. MCP integration for agentic capabilities. -
6
Secret Llama
Fully private LLM chatbot that runs entirely with a browser
Secret Llama is a privacy-first large-language-model chatbot that runs entirely inside your web browser, meaning no server is required and your conversation data never leaves your device. It focuses on open-source model support, letting you load families like Llama and Mistral directly in the client for fully local inference. Because everything happens in-browser, it can work offline once models are cached, which is helpful for air-gapped environments or travel. -
7
Zod
TypeScript-first schema validation with static type inference
TypeScript-first schema validation with static type inference. Zod is a TypeScript-first schema declaration and validation library. I'm using the term "schema" to broadly refer to any data type, from a simple string to a complex nested object. Zod is designed to be as developer-friendly as possible. The goal is to eliminate duplicative type declarations. With Zod, you declare a validator once and Zod will automatically infer the static TypeScript type. -
8
ngx-markdown
Angular markdown component/directive/pipe/service to parse static
...Using markdown component and/or directive, you will be able to use the lineNumbers property to activate the plugin. The property can be used in combination with either data for variable binding, src for remote content or using transclusion for static markdown. -
9
io-ts
Runtime type system for IO decoding/encoding
io-ts is a TypeScript runtime type system for decoding, validating, and encoding data at application boundaries. It solves a common TypeScript limitation: static types disappear at runtime, but external inputs still need to be checked safely. The library lets developers define codecs that represent both runtime validation logic and static TypeScript types. This approach is especially useful for APIs, configuration files, JSON payloads, database results, and any data that enters a program from an unknown source. io-ts integrates closely with functional programming patterns and the fp-ts ecosystem. ... -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
10
VitePress
Vite & Vue powered static site generator
...Instant server start, lightning fast hot updates, and leverage Vite ecosystem plugins. Use Vue syntax and components directly in markdown, or build custom themes with Vue components. Fast initial load with static HTML, fast post-load navigation with client-side routing. VitePress is a Static Site Generator (SSG) designed for building fast, content-centric websites. In a nutshell, VitePress takes your source content written in Markdown, applies a theme to it, and generates static HTML pages that can be easily deployed anywhere. VitePress ships with a default theme designed for technical documentation, especially those that need to embed interactive demos. ... -
11
Next.js Landing Page Starter Template
Free NextJS Landing Page Template written in Tailwind CSS 3
...SEO support includes metadata, Open Graph information, and JSON-LD structured data. Developer tooling combines ESLint, Prettier, Husky, lint-staged, PostCSS, and prepared Visual Studio Code settings. Static generation, minification, live reload, cache busting, and unused CSS removal help produce efficient deployments. The project can be hosted through Netlify or exported for another static hosting service. -
12
Java Design Patterns Website
Next generation website for Java Design Patterns
...Because it’s built on VuePress, it benefits from a static-site workflow, theming, and easy deployment to GitHub Pages or similar hosting. It’s a good example of taking a large technical repo and giving it a documentation-first UI so newcomers can learn patterns without getting lost. -
13
Bee Agent Framework
The framework for building scalable agentic applications
...The Bee Agent Framework makes it easy to build scalable agent-based workflows with your model of choice. The framework is been designed to perform robustly with IBM Granite and Llama 3.x models, and we’re actively working on optimizing its performance with other popular LLMs. Our goal is to empower developers to adopt the latest open-source and proprietary models with minimal changes to their current agent implementation. -
14
Diffuse
A music player that connects to your cloud/distributed storage
A music player that connects to your cloud/distributed storage, in the form of a static, serverless, web application. Diffuse is a static web application, which means it's just HTML, CSS, and Javascript. No REST API, database, or anything backend-related is involved. The app uses a hash (aka. fragment-based) routing system, so you don't need any special server rules for routing. You can download a pre-build web-only version of Diffuse on the releases page. -
15
Clippy
Clippy, now with some AI
...Users interact with the system through a simple animated assistant interface that can answer questions, generate text, and perform conversational tasks. The application includes one-click installation support for several popular models such as Meta’s Llama, Google’s Gemma, and other open models. -
16
scriptc
TypeScript-to-Native Compiler
...A coverage command explains which statements compile statically and identifies unsupported constructs with precise diagnostics. Optional dynamic mode embeds QuickJS for npm dependencies and loosely typed code while validating values that cross into static code. The supported surface includes major language features, standard collections, many Node APIs, networking, TLS, fetch, streams, and asynchronous programming. Differential tests compare native output with Node.js, while sanitizer testing checks memory safety and documented divergences. -
17
JupyterLite
Wasm powered Jupyter running in the browser
...JupyterLite supports many core Jupyter features, including notebooks, code consoles, and interactive visualizations, while storing files locally using browser storage mechanisms such as IndexedDB. It is designed to be easily deployable as a static website, enabling developers to host fully functional notebook environments on platforms like GitHub Pages. -
18
tRPC
End-to-end typesafe APIs made easy
tRPC allows you to easily build & consume fully typesafe APIs, without schemas or code generation. As TypeScript and static typing increasingly become a best practice in web programming, the API presents a major pain point. We need better ways to statically type our API endpoints and share those types between our client and server (or server-to-server). We set out to build a simple library for building typesafe APIs that leverage the full power of modern TypeScript. -
19
Log4brains
Log and publish your architecture decisions (ADR)
Log4brains is a docs-as-code knowledge base for your development and infrastructure projects. It enables you to log Architecture Decision Records (ADR) right from your IDE and to publish them automatically as a static website. -
20
notfoundbot
fix & archive outgoing links on your website
notfoundbot is a GitHub Action that helps you automatically maintain the correctness of your website's outgoing links. It finds links that need fixing and opens pull requests that fix them. This action is intended for websites and blogs powered by static site generators. By using post dates derived from filenames, notfoundbot searches for Wayback Machine archives of linked resources that are contemporary to the post itself: broken links in a 2011 blog post will be linked to archives from around that era. -
21
Decimen Optical Transfer
Fountain-coded QR file transfer
...Fountain coding makes the stream tolerant of missed, blurred, duplicated, and out-of-order frames without requesting retransmission. Each QR frame includes session and file metadata, allowing a receiver to join an active stream or reset when a new session begins. QR decoding runs through zxing-cpp compiled to WebAssembly and uses workers to process camera frames efficiently. Configurable settings control payload size, transmission speed, QR density, capture resolution, and worker count, while a final hash verifies the recovered file. -
22
Node Modules Inspector
Interactive UI for local node modules inspection
...The idea is to help developers visualise the dependency graph, see which dependencies are installed, their sizes, types (ESM vs CJS), origins (catalog vs registry), and filter or build a static report of a project’s dependency tree. The project includes a web UI version that you can try at node-modules.dev, and a build command to generate a static output (folder .node-modules-inspector) for hosting. It supports configuration via node-modules-inspector.config.ts for customizing filters and display settings. Internally it uses a web version with WebContainer to run in-browser installations for live project visualisations. ... -
23
BrowserAI
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
BrowserAI is a cutting-edge platform that allows users to run large language models (LLMs) directly in their web browser without the need for a server. It leverages WebGPU for accelerated performance and supports offline functionality, making it a highly efficient and privacy-conscious solution. The platform provides a developer-friendly SDK with pre-configured popular models, and it allows for seamless switching between MLC and Transformer engines. Additionally, it supports features such as... -
24
promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
...Use built-in metrics, LLM-graded evals, or define your own custom metrics. Compare prompts and model outputs side-by-side, or integrate the library into your existing test/CI workflow. Use OpenAI, Anthropic, and open-source models like Llama and Vicuna, or integrate custom API providers for any LLM API. -
25
AssemblyScript
A TypeScript-like language for WebAssembly
AssemblyScript is a TypeScript-like programming language specifically designed to compile into WebAssembly, enabling developers to write high-performance code using familiar JavaScript syntax. It introduces static typing and low-level control while maintaining compatibility with existing JavaScript tooling and workflows. The language is optimized for generating efficient and compact WebAssembly modules, making it suitable for performance-critical applications in both browser and server environments. Its design bridges the gap between high-level scripting and low-level execution, allowing developers to achieve near-native performance without switching to languages like C or Rust. ...