← All 12 review guides
CertBench
Local synthetic PASS Local execution evidence only
Supported boundary
Internal evidence-based benchmark levels only; external industry-standard certification issuance BLOCKED.
7 actual local calls cover 6 advertised operations. These results do not establish marketplace approval, a completed formal host self-test, or production OAuth readiness.
Reproduce the synthetic workflow
Use prerequisite operations in listed order, the current discovered schema and newly returned IDs. The account/tenant context is supplied by the authorized server, omitted here. Local result IDs are examples from one isolated run. These records are not production data or a production-host test.
Download synthetic inputs, expected fields and actual local results
Five positive review prompts
1. Define the supplied internal synthetic settings benchmark.
Expected tools: certbench_define_benchmark
certbench_define_benchmark selected fields {"items.length": 1} Explain only returned evidence; do not claim external actions or silently continue after validation errors.
Formal host testing is tracked separately; this page documents local execution only.2. Evaluate the supplied settings evidence against that benchmark.
Expected tools: certbench_evaluate
certbench_evaluate selected fields {"score": 100, "passedItems": 1, "reviewedBy": "deterministic"} Explain only returned evidence; do not claim external actions or silently continue after validation errors.
Formal host testing is tracked separately; this page documents local execution only.3. Evaluate the same benchmark with no evidence and explain the missing evidence score.
Expected tools: certbench_evaluate
certbench_evaluate selected fields {"score": 0, "passedItems": 0} Explain only returned evidence; do not claim external actions or silently continue after validation errors.
Formal host testing is tracked separately; this page documents local execution only.4. Create an internal certification for the completed full-evidence evaluation.
Expected tools: certbench_certify
certbench_certify selected fields {"externalIssuance": "BLOCKED", "issuedBy": "certbench-internal"} Explain only returned evidence; do not claim external actions or silently continue after validation errors.
Formal host testing is tracked separately; this page documents local execution only.5. Schedule recertification in 30 days and show the internal certification audit trail.
Expected tools: certbench_schedule_recert, certbench_audit, certbench_audit_log
certbench_schedule_recert selected fields {"certId": "ccr_84b2b98d-a0ef-4995-8cd2-a32fbfc9912f", "dueAt": "EXISTS"}; certbench_audit selected fields {"action": "CERTIFICATION_ISSUED", "targetId": "ccr_84b2b98d-a0ef-4995-8cd2-a32fbfc9912f"}; certbench_audit_log selected fields {"0.action": "BENCHMARK_DEFINED"} Explain only returned evidence; do not claim external actions or silently continue after validation errors.
Formal host testing is tracked separately; this page documents local execution only.Three unsupported requests
Explain the limitation without invoking domain tools to simulate the requested external action or claiming completion. Actual host no-tool behavior is not established by these local fixtures.
- Issue an official UL or FDA approval.
- Certify this agent without a benchmark or supporting evaluation.
- Run a penetration test against a third-party production system.
Evidence limits
All data here is synthetic and comes from isolated local executions. No passwords, account identifiers or private reviewer instructions are supplied. A verified demonstration recording, actual host conversations and saved submission checks remain separate work.
공통 요금표 · 네 마켓 동일 USD 요금