​

AI Toolbelt

​

Platforms & APIs

• OpenAI (GPT-4o, GPT-4o mini) – default for reasoning-heavy tasks.
• Anthropic Claude 3.5 – great for safety-critical briefs.
• Google Gemini / Vertex – when data residency or multimodal features needed.
• Cohere – rerankers + command models for enterprise contexts.

​

SDKs & Frameworks

• Vercel AI SDK for streaming + React server components.
• LangChain for agent orchestration.
• LlamaIndex for retrieval pipelines.
• Smithery / Instructor for structured outputs.

​

Ops & Testing

• LangSmith + Evals for regression testing.
• Promptfoo for quick comparisons.
• Truelens for trust metrics.
• Weights & Biases for fine-tune tracking.

​

Hosting & Runtime

• Vercel for edge functions.
• Cloudflare Workers AI for GPU-free inference.
• Modal / RunPod for custom models + batch jobs.

​

Utilities

• Whisper.cpp for on-device transcription.
• Haystack for enterprise search prototypes.
• PromptLib (my product) for curated prompts + guardrails.