Search Results for "llm"
Sort By:
Showing 12 open source projects for "llm"
View related business solutions-
Go from Code to Production URL in SecondsSkip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
-
Ship Agents FasterGemini Enterprise Agent Platform lets you rapidly build, scale, govern and optimize production-ready agents grounded in your organization's data. The platform enables developers to build custom or pre-built agents for virtually any use case. New customers get $300 in free credits.
-
1
Opik
Debug, evaluate, and monitor your LLMapps, RAG systems, and agentic AI
Confidently evaluate, test, and monitor LLM applications. Opik is an open-source platform for evaluating, testing, and monitoring LLM applications. Built by Comet. Record, sort, search, and understand each step your LLM app takes to generate a response. Manually annotate, view, and compare LLM responses in a user-friendly table. Log traces during development and in production. -
2
DevoxxGenie
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's
Devoxx Genie is a fully Java-based LLM Code Assistant plugin for IntelliJ IDEA, designed to integrate with local LLM providers such as Ollama, LMStudio, GPT4All, Llama.cpp, and Exo but also cloud-based LLMs such as OpenAI, Anthropic, Mistral, Groq, Gemini, DeepInfra, DeepSeek, OpenRouter and Azure OpenAI. -
3
Jlama
Jlama is a modern LLM inference engine for Java
...The engine supports a wide range of open-source model architectures and formats, including variants of Llama, Mistral, and other transformer-based models. It provides tools for running chat interactions, completing prompts, or exposing an OpenAI-compatible REST API for applications that expect standard LLM endpoints. The project focuses on performance and portability by using native Java optimizations and the Java Vector API to accelerate inference workloads. -
4
TorchServe
Serve, optimize and scale PyTorch models in production
TorchServe is a performant, flexible and easy-to-use tool for serving PyTorch eager mode and torschripted models. Multi-model management with the optimized worker to model allocation. REST and gRPC support for batched inference. Export your model for optimized inference. Torchscript out of the box, ORT, IPEX, TensorRT, FasterTransformer. Performance Guide: built-in support to optimize, benchmark and profile PyTorch and TorchServe performance. Expressive handlers: An expressive handler... -
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
5
JADX-AI-MCP
Plugin for JADX to integrate MCP server
JADX-AI-MCP is an open-source plugin that integrates large language models into the JADX Android decompiler to assist with reverse engineering and code analysis tasks. The project connects JADX with AI assistants through the Model Context Protocol, enabling language models to interact directly with decompiled Android application code. Through this integration, AI systems can inspect classes, analyze methods, retrieve application manifests, and examine other elements of Android packages in... -
6
AgentScope Java
Agent-Oriented Programming for Building LLM Applications
AgentScope Java is an agent-oriented programming framework that enables Java developers to build intelligent, LLM-powered applications using a dynamic reasoning-acting (ReAct) paradigm. It provides a comprehensive toolkit for creating autonomous agents that can plan, execute, and adjust complex workflows, making decisions about which tools to invoke and how to solve multi-step problems. The framework includes runtime controls such as safe interruption and graceful cancellation to manage agent execution robustly in production environments. ... -
7
Agent Development Kit (ADK) for Java
An open-source, code-first Java toolkit
Google’s Agent Development Kit for Java is an open-source toolkit that helps developers design, evaluate, and deploy advanced AI agents using the Java programming language. The framework follows a code-first approach that treats agent development as a structured software engineering task rather than a collection of prompt scripts. It provides abstractions and tools that allow developers to create agents capable of executing complex workflows, calling tools, and interacting with external... -
8
LangChain for Java
LangChain4j is an open-source Java library
LangChain for Java is an open-source Java framework designed to simplify the development of applications powered by large language models. The library provides a unified API that allows developers to connect Java applications to multiple AI providers and embedding databases without having to implement separate integrations for each service. Its architecture includes abstractions for prompts, chat interactions, document processing, embeddings, and vector storage, enabling developers to build... -
9
Agents-Flex
Agents-Flex is an elegant LLM Application Framework like LangChain
Agents-Flex includes a variety of network protocols for connecting LLMs, such as HTTP, SSE and WS. Its simple and flexible design allows developers to easily connect to various LLMs, including OpenAI, LLama, and other AI. Agents-Flex provides a rich set of development templates and Prompt Frameworks, including FEW-SHOT, CRISPE, BROKE, and ICIO. Developers can also customize their own unique prompt templates. Agents-Flex has a very flexible Function Calling component. It supports local method... -
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
10
Mindolph
Mindolph is an open source desktop PKM software with Gen-AI support.
Mindolph is an open source personal knowledge management software with Gen-AI support for all desktop platforms. -
11
Openfire LLM Chatbot Plugin
LLM Chatbot Assistant for Openfire server
This plugin is a wrapper to hosted AI Inference server for LLM chat models. It uses the Botz API to create a chatbot in Openfire which will engage in XMPP chat and groupchat conversations. -
12
Aliza Gaming API
An extensible development framework for roleplay games.
...Key Features: Modular Architecture, Rich Graphics and UI Components, Comprehensive Game Logic and Character Management, Environment and World-Building Tools, Statistical and Mathematical Utilities, Enhanced Debugging and Logging, Data Management and Integration, Integrated LLM for NPC Dialog, Cross-Platform Compatibility Dive into the world of game development with AlizaGameAPI. Download the latest version, explore the detailed documentation, and join the community of developers pushing the boundaries of gaming technology.
- Previous
- You're on page 1
- Next