Search Results for "local llm"

BricksLLM is an open-source framework for building and managing production-ready LLM (Large Language Model) applications. It provides tooling for prompt engineering, memory management, observability, and chaining, all in one unified developer experience. BricksLLM is designed to reduce boilerplate and increase the maintainability of LLM-based workflows.

Unsloth-MLX offers developers the power of Unsloth’s efficient large language model fine-tuning experience on Apple Silicon Macs by wrapping Apple’s native MLX framework with an API fully compatible with Unsloth workflows. This project removes traditional barriers that prevent Mac users from prototyping and experimenting with LLM training locally by allowing the same code used in cloud GPU environments to run on M-series hardware, improving workflow continuity and reducing iteration costs....

TradingAgents-CN is a Chinese-enhanced, multi-agent LLM framework aimed at building financial analysis and trading-oriented workflows, with an emphasis on collaboration between specialized agents rather than a single monolithic prompt. It organizes market-related tasks into roles and stages so different agents can contribute research, reasoning, aggregation, and decision support in a structured pipeline. The project is oriented toward practical usage, including a stack that can be run in a...

Fabric is a command-line framework that turns a curated library of prompt “patterns” into reusable, automatable workflows for large language models. Instead of repeatedly crafting ad-hoc prompts, you pick a pattern (for research, summarization, brainstorming, code review, and more) and feed it inputs or files. The tool standardizes execution with configuration files and environment variables, enabling reproducible runs across different models and providers. Patterns can be customized with...

...The repo includes examples showing how to build agents that call local functions, chain between agents, validate input/output, stream responses, and interact in real time (e.g. voice agents via WebRTC). It also has tracing and debugging support so you can introspect how agents executed their workflows. Because it aligns closely with the Python Agents SDK, it aims for cross-language parity so that JS/TS devs can adopt similar agent architectures.

...LangChain is another open-source framework for building applications powered by LLMs. long-chain-serve helps you deploy your LangChain apps on Jina AI Cloud in a matter of seconds. You can benefit from the scalability and serverless architecture of the cloud without sacrificing the ease and convenience of local development. And if you prefer, you can also deploy your LangChain apps on your own infrastructure to ensure data privacy. With long chain-serve, you can craft REST/WebSocket APIs, spin up LLM-powered conversational Slack bots, or wrap your LangChain apps into FastAPI packages on the cloud or on-premises.