AIchitect
StacksGraphBuilderCompare
123 tools · 10 stacks
GitHub

AI tools are all over the place. This is the full landscape — 123 tools across 12 categories, mapped and connected. Ready to narrow it down? Build your stack →

Stack Layers
What are you building and how is it defined?
How do you write and ship code?
How does your AI think and act?
Which models and infrastructure power it?
How do you build, observe, and extend it?
React Flow mini map
Press enter or space to select a node.You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.
Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.
These tools integrates with
OpenAI API
vs
DeepEval

Choose OpenAI API when…

  • •You need the broadest ecosystem and most integrations
  • •GPT-4 or o-series reasoning models are required
  • •Assistants API, fine-tuning, or batch API are needed

Choose DeepEval when…

  • •You want a pytest-style framework for LLM testing
  • •Unit-test-like evals for LLM outputs fit your workflow
  • •You need RAG-specific metrics like faithfulness and relevancy
Field
OpenAI API
DeepEval
Category
LLM Infrastructure
Prompt & Eval
Type
SaaS
OSS
Free Tier
✗ No
✓ Yes
Plans
API: Per token
—
Stars
—
⭐ 5,500

OpenAI API

API access to GPT-4o, o1, and other OpenAI models including embeddings and image generation. The most widely used LLM API in production.

DeepEval

Open-source evaluation framework with 14+ metrics including faithfulness, relevancy, and hallucination detection. Integrates with CI/CD.

OpenAI API Website ↗
DeepEval Website ↗GitHub ↗

Shared Connections (2)

LangfusePromptFoo

Only OpenAI API (19)

CrewAIAutoGenLangChainLlamaIndexMastraPydanticAIsmolagentsAgno

Only DeepEval (2)

RAGASOpenAI API
See full comparison in Explore →