{"slug":"confident-ai","name":"Confident AI (DeepEval)","owner":null,"repo":null,"category":"observability-eval","lang":"","blurb":"Cloud AI-quality platform on top of the open-source DeepEval framework: test management, tracing and analytics.","use_cases":"[]","alternatives":[],"stars":0,"pushed_at":null,"synced_at":null,"kind":"api","one_liner":"Cloud AI-quality platform on top of the open-source DeepEval framework: test management, tracing and analytics.","website":"https://www.confident-ai.com/","docs_url":"https://www.confident-ai.com/docs","signup_url":"https://app.confident-ai.com","pricing_model":"freemium","pricing_note":"Free tier available; paid Starter around $19-$20/mo (approx $9.99/user/mo entry) for team dashboards & RBAC. DeepEval framework is Apache-2.0, free.","auth_type":"api-key","agent_signup":"self-serve-instant-key","agent_signup_note":"`pip install deepeval` then `deepeval login` (or sign up in-app) to get an API key; every feature — including project provisioning, datasets, traces — is exposed via API once authenticated.","mcp_server":"","sdks":["Python","TypeScript","REST"],"code_sample":"{\"lang\":\"python\",\"code\":\"# pip install deepeval ; deepeval login  (to sync to Confident AI cloud)\\nfrom deepeval import evaluate\\nfrom deepeval.test_case import LLMTestCase\\nfrom deepeval.metrics import AnswerRelevancyMetric\\n\\ntest_case = LLMTestCase(\\n    input=\\\"What's the capital of France?\\\",\\n    actual_output=\\\"Paris\\\",\\n)\\nevaluate(test_cases=[test_case], metrics=[AnswerRelevancyMetric()])\"}","tags":["evals","testing","deepeval","open-source","llm-as-judge","rag"],"useCases":[],"codeSample":{"lang":"python","code":"# pip install deepeval ; deepeval login  (to sync to Confident AI cloud)\nfrom deepeval import evaluate\nfrom deepeval.test_case import LLMTestCase\nfrom deepeval.metrics import AnswerRelevancyMetric\n\ntest_case = LLMTestCase(\n    input=\"What's the capital of France?\",\n    actual_output=\"Paris\",\n)\nevaluate(test_cases=[test_case], metrics=[AnswerRelevancyMetric()])"},"oneLiner":"Cloud AI-quality platform on top of the open-source DeepEval framework: test management, tracing and analytics.","docsUrl":"https://www.confident-ai.com/docs","signupUrl":"https://app.confident-ai.com","pricingModel":"freemium","pricingNote":"Free tier available; paid Starter around $19-$20/mo (approx $9.99/user/mo entry) for team dashboards & RBAC. DeepEval framework is Apache-2.0, free.","authType":"api-key","agentSignup":"self-serve-instant-key","agentSignupNote":"`pip install deepeval` then `deepeval login` (or sign up in-app) to get an API key; every feature — including project provisioning, datasets, traces — is exposed via API once authenticated.","mcpServer":""}