LangChain is a framework for developing applications powered by large language models (LLMs).
LangGraph is a library for building stateful, multi-actor applications with LLMs, used to create agent and multi-agent workflows.
LangSmith is a platform for building production-grade LLM applications. It allows you to closely monitor and evaluate your application, so you can ship quickly and with confidence.
Langfuse is tool for LLM observability,UI , prompt management & playground for parameter tuning.
Agno is a lightweight framework for building multi-modal Agents.
CrewAI Production-grade framework for orchestrating sophisticated AI agent systems.
AutoGen is a framework for creating multi-agent AI applications that can act autonomously or work alongside humans.
Langflow is a low-code app builder for RAG and multi-agent AI applications. It’s Python-based and agnostic to any model, API, or database.
LangServe helps developers deploy LangChain runnables and chains as a REST API.
LlamaIndex (previously GPT Index) is a framework for:
Indexing & retrieving private data for Large Language Models (LLMs).
Helps LLMs access external knowledge sources (PDFs, databases, APIs).
Used for Retrieval-Augmented Generation (RAG) in AI apps.
Ollama is a tool for:
Running LLMs locally on your machine (without the cloud).
Supports models like Llama2, Mistral, Code Llama, Gemma.
Provides an API to interact with models.
Triton Inference Server :
Triton Inference Server is an open-source model serving solution by NVIDIA that enables efficient deployment and scaling of AI/ML models in production. It supports multiple frameworks, runs on GPUs & CPUs, and optimizes performance with batching, model ensembles, and multi-model inference.
LangWatch is a visual interface for DSPy and a complete LLM Ops platform for monitoring, experimenting, measuring and improving LLM pipelines, with a fair-code distribution model.
Agentic AI Design Patterns are type of workflows ( how llm calls tools, how nexts steps are identified in LLM apps)
SerpAPI
This Python package is meant to scrape and parse search results from Google, Bing, Baidu, Yandex, Yahoo, Home Depot, eBay and more, using SerpApi. ( used as a tool for agent)
Tavily's Search API is a search engine built specifically for AI agents (LLMs), delivering real-time, accurate, and factual results at speed.
Tools are utilities designed to be called by a model: their inputs are designed to be generated by models, and their outputs are designed to be passed back to models.
Comments