Generative AI & Large Language Models (LLMs)

A curated list of tools and frameworks for the modern AI Engineer (2024-2026).

Core Models & Platforms

• Hugging Face - The home of open-source models (Llama 3, Mistral, Gemma).
• OpenAI Platform - Documentation for GPT-4o and API usage.
• Anthropic - Clause 3.5 Sonnet and Opus models.
• Ollama - Run Llama 3, Phi 3, and other models locally on your machine.

Frameworks (Orchestration & RAG)

• LangChain - Framework for developing applications powered by LLMs.
• LlamaIndex - Data framework for connecting custom data sources to LLMs.
• Haystack - End-to-end framework for building RAG pipelines.
• DSPy - Programming—not prompting—framework for LMs.

Vector Databases

• Chroma - Open-source embedding database.
• Pinecone - Managed vector database for scaling AI applications.
• Weaviate - Cloud-native vector search engine.

Tools & Utilities

• LM Studio - Discover, download, and run local LLMs.
• Cursor - The AI Code Editor built for pair-programming.

Practical Guides & Debugging

• WFGY ProblemMap - Diagnosing and fixing RAG/LLM pipeline failures.