Top 48 AI Evaluation

Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. * * Related Tools: * * llama.cpp, pydantic **Related Tools:** <a href="/tools/llama-cpp">llama.c...

The original local LLM interface. Text, vision, tool-calling, training, and more. text-generation-webui is a leading dev-tools AI tool. developed by oobabooga. with an overall rating of 8.3/10. Key strengths include Free to use, active community, Active community, continually updated iterations.

The Frontend Stack for Agents & Generative UI. React + Angular. Makers of the AG-UI Protocol

openai-python by openai is a AI-powered developer tool and platform. featuring code analysis and deployment automation.

pydantic is a AI-powered developer tool and platform. featuring code analysis and deployment automation.

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

The official Python SDK for Model Context Protocol servers and clients

servers by modelcontextprotocol is a AI-powered developer tool and platform. featuring code analysis and deployment automation.

Python tool for converting files and office documents to Markdown.

Toolkit for linearizing PDFs for LLM datasets/training

The official TypeScript SDK for Model Context Protocol servers and clients

llama-cpp-python provides Python bindings for llama.cpp, enabling high-performance LLM inference in Python with support for OpenAI-compatible API server, LangChain integration, and multiple hardware acceleration backends.

🤗 smolagents: a barebones library for agents that think in code.

A Go implementation of the Model Context Protocol (MCP), enabling seamless integration between LLM applications and external data sources and tools.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Universal LLM Deployment Engine with ML Compilation

🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.

Specification and documentation for the Model Context Protocol

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

ToolHive is an enterprise-grade platform for running and managing Model Context Protocol (MCP) servers.

mistral-inference by mistralai is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a good rating of 7.3/10 based on our 6-dimension evaluation.

TypeChat is a library that makes it easy to build natural language interfaces using types.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

the first library to let you embed a developer agent in your own app!

OpenChatKit is an open-source toolkit for building specialized and general-purpose chatbots, providing a 20 billion parameter model, customization recipes, and evaluation tools for creating production-ready conversational AI.

A Javascript AI getting started stack for weekend projects, including image/text models, vector stores, auth, and deployment configs

Python package for easily interfacing with chat apps, with robust features and minimal code complexity.

Mistral Finetune is an open-source library for fine-tuning Mistral AI models, providing efficient training pipelines with LoRA, QLoRA, and full fine-tuning support, along with data preparation and evaluation tools.

Toolkit for creating, sharing and using natural language prompts.

MiniAGI is a simple general-purpose AI agent based on the OpenAI API.

llm-guard by protectai is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a above average rating of 7.0/10 based on our 6-dimension evaluation.

openai-openapi by openai is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a good rating of 7.2/10 based on our 6-dimension evaluation.

llmsherpa by nlmatics is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a good rating of 7.3/10 based on our 6-dimension evaluation.

emcee by mattt is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a good rating of 7.0/10 based on our 6-dimension evaluation.

A tiny library for coding with large language models.

Agents Capable of Self-Editing Their Prompts / Python Code

embedbase by different-ai is a AI-powered developer tool and platform. featuring code analysis and deployment automation. designed for software engineering and DevOps. with a good rating of 7.1/10 based on our 6-dimension evaluation.

🕵️‍♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.

MindSQL: A Python Text-to-SQL RAG Library simplifying database interactions. Seamlessly integrates with PostgreSQL, MySQL, SQLite, Snowflake, and BigQuery. Powered by GPT-4 and Llama 2, it enables nat

Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types

MCP server for Todoist integration enabling natural language task management with Claude

The easiest, and fastest way to run AI-generated Python code safely

Production-Ready LLM Agent SDK for Every Developer

Minimize LLM token complexity to save API costs and model computations.

Prompt2UI is an experimental tool that generates UI components from natural language prompts, enabling rapid prototyping of user interfaces by describing desired functionality and layout in conversational text.

Drop in replacement for the OpenAI Assistants API