Index / devtools

IA-QA Eval & RAG — 38 tools

io-github-jcjamet-ia-qa-eval declares 39 capabilities across 39 tools, with 2 critical issues. One of them, no-revocation, is recorded for every server in the index because MCP has no field in which to declare a way to switch a tool off; a missing declaration is not evidence that the control is missing.

59/100 exposureElevated

Manifest recorded 2026-11-08 from tools/list on https://www.ia-qa.com/mcp/eval, published in the official MCP registry as io.github.JcJamet/ia-qa-eval 1.0.1. The date changes only when the manifest does. Not verified by a maintainer.

Issues

These describe what this server's manifest declares. A product can provide controls that MCP has no way to express — token revocation, an admin console, audit logs — and this page cannot see them. The absence of a declaration is not evidence that a control is absent.

critical · no-revocation · All 39 tools

39 of 39 tools declare no way for the customer to switch them off once granted. This applies to every tool because MCP has no field in which to declare a revocation mechanism; the product may provide one outside MCP that a manifest cannot show.

critical · destructive-uncapped · 1 of 39 tools

1 tool is annotated by the server as destructive (destructiveHint) and declares no limit. In MCP that annotation marks a tool that may make destructive changes rather than only additive ones; it does not say the change cannot be undone.

high · no-expiry · All 39 tools

39 of 39 tools declare no expiry. This applies to every tool because MCP has no field in which to declare an expiry; the product may provide one outside MCP that a manifest cannot show.

high · no-audit-trail · All 39 tools

39 of 39 tools declare no record of their actions that the customer can read. This applies to every tool because MCP has no field in which to declare an audit requirement; the product may provide one outside MCP that a manifest cannot show.

low · uncapped-read · 38 of 39 tools

38 tools can read data and declare no limit.

Declared capabilities

How each tool was read. declared means the server's own annotation said so — self-reported and unverified. inferred is from the tool's name. assumed means nothing indicated either way.

Tool	Read as	Basis
`get_testing_guidelines`	`read`	declared
`find_tool`	`read`	declared
`hallucination_check`	`read`	declared
`run_eval_contract`	`read`	declared
`run_semantic_tests`	`read`	declared
`generate_ci_workflow`	`read`	declared
`needle_haystack_generate`	`read`	declared
`generate_eval_yaml`	`read`	declared
`metamorphic_check`	`read`	declared
`test_skill`	`read`	declared
`skill_interview`	`read`	declared
`llm_output_validator`	`read`	declared
`compare_responses`	`read`	declared
`analyze_responses`	`read`	declared
`prompt_test_suite`	`read`	declared
`llm_format_check`	`read`	declared
`consistency_check`	`read`	declared
`llm_json_schema_check`	`read`	declared
`response_quality_score`	`read`	declared
`conversation_analyze`	`read`	declared
`cot_analyzer`	`read`	declared
`ab_test_report`	`read`	declared
`similarity_score`	`read`	declared
`run_vlm_test_suite`	`read`	declared
`embedding_similarity`	`read`	declared
`rag_relevance_rank`	`read`	declared
`bm25_score`	`read`	declared
`build_rag_prompt`	`read`	declared
`rerank_evaluate`	`read`	declared
`count_tokens`	`read`	declared
`extract_json_from_text`	`read`	declared
`estimate_llm_cost`	`read`	declared
`token_budget_calculator`	`read`	declared
`context_window_check`	`read`	declared
`model_info`	`read`	declared
`compare_models`	`read`	declared
`list_llm_models`	`read`	declared
`llm_generate`	`read`	declared
`rate_tool`	`destructive`	declared

Record history

Earlier records for this server. A correction is added here, never written over the record it corrects.

Recorded	Exposure	Source
2026-10-28	53	tools/list on https://www.ia-qa.com/mcp/eval, published in the official MCP registry as io.github.JcJamet/ia-qa-eval 1.0.1

Answering this question about your own agent? The self-serve stack report applies the same reading to your own stack or server and gives you a dated document you can hand to a customer's security review. It is generated in your browser, with nobody to wait for. Buying one does not change this page, its score or its place in the index — see Independence.

Maintain this server? If this page misreads your manifest, or your server has changed, submit its current tools/list response and it will be re-scored and dated. Corrections are published alongside the original, not in place of it.