Skip to content
anyai.fyi

AI tools for “observability”

95 results (tools & skills) · 434 ms · understood as by meaning

Skill instrument-llm-analytics PostHog/ai-plugin

Add PostHog AI Observability to trace AI model usage. Use after implementing LLM features or reviewing PRs to ensure all generations are captured with token counts, latency, and costs. Also handles initial PostHog SDK…

Data & Databases curated Worth a look
Match 1.6
Skill rag-blueprint NVIDIA/skills

…guardrails, query rewriting, models, search, ingestion, observability, summarization, reasoning, and…

DevOps & Cloud curated Worth a look
Match 1.6
New Relic logo
New Relic newrelic.com

New Relic is an AI-powered observability platform that correlates your telemetry across your entire stack, so you can isolate the root cause and reduce MTTR.

Freemium Coding API Online · checked 1d ago
Match 5.5
Skill ai-gateway vercel/vercel-plugin

…models, evaluation models, BYOK, budgets, spend reporting, observability, compatible APIs, and coding-agent configuration. Use when adding AI Gateway to an app, migrating provider calls, choosing models or providers,…

Development curated Worth a look
Match 1.6
Splunk logo
Splunk splunk.com

Unify security and observability at petabyte scale on the Splunk data platform for trusted AI. Stop threats and prevent downtime at machine speed.

Enterprise Agents API Online · checked 1d ago
Match 5.4
Skill marketplace vercel/vercel-plugin

…products), payments (checkout, subscriptions, billing), observability/monitoring, messaging/email, search, or CMS — or when discovering, installing, or managing…

DevOps & Cloud curated Worth a look
Match 1.6
Skill box-sdk-development box/skills

…correctness, file transfer, bulk work, rate limits, and observability; not one-off CLI or MCP content…

Development curated No risky patterns found
Match 1.6
Lunary logo
Lunary lunary.ai

Observability and prompt management platform for LLM-based apps. Take your LLMs to the next level. lunaryPlatformDocsPricingLog inGet TeamBuild AI agents with confidenceThe AI platform for enterprises. Lunary gives you…

Paid Data & Analytics API Online · checked 1d ago
Match 5.1
Skill newrelic-mcp newrelic/claude-code-plugin

…"investigate incident", or any request to pull observability or monitoring data. Also triggers when the user mentions APM, distributed tracing, golden signals, Errors Inbox, or synthetic monitors. Always…

Development curated No risky patterns found
Match 1.6
Skill planetscale-best-practices-matrix planetscale/claude-plugin

A concise feature matrix for deciding which PlanetScale safety, observability, and automation recommendations apply by engine.

DevOps & Cloud curated No risky patterns found
Match 1.6
Adaline logo
Adaline adaline.ai

Adaline is an observability and evals platform for self-improving AI agents. It turns production traces into behaviors, evals, synthetic data, and verified improvements your team can approve and ship.

Agents API Online · checked 1d ago
Match 4.6
Skill creating-online-evaluations PostHog/ai-plugin

…continuously-running online evaluations in PostHog AI observability, grounded in real failure modes you've identified. Use when the user wants evaluations that automatically score new generations or whole traces…

Development curated No risky patterns found
Match 1.6
Skill exploring-apm-traces PostHog/ai-plugin

…distributions, trace IDs, or span attributes — not AI observability traces or product logs. Uses posthog:apm-service-health, posthog:query-apm-spans, posthog:apm-trace-get, posthog:apm-spans-sparkline,…

Data & Databases curated No risky patterns found
Match 1.6
TensorZero logo
TensorZero tensorzero.com

TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.

Chatbots & Assistants Open source Online · checked 1d ago
Match 4.7
Skill exploring-llm-evaluations PostHog/ai-plugin

Investigate AI observability evaluations — `hog` (deterministic code-based), `llm_judge` (LLM-prompt-based), and `sentiment` (user-message sentiment). Find existing evaluations, inspect their configuration, run them…

Development curated No risky patterns found
Match 1.6