agent research skill risk: low
Research Method Novelty Checker
Verify whether a proposed research method has already been done in the literature by extracting 3-5 core technical claims, performing multi-source searches on arXiv and recent conf…
- External action: medium
SKILL 1 file
SKILL.md
--- name: novelty-check description: "Verify research idea novelty against recent literature. Use when user says /\"/u67e5/u65b0/\", /\"novelty check/\", /\"/u6709/u6ca1/u6709/u4eba/u505a/u8fc7/\", /\"check novelty/\", or wants to verify a research idea is novel before implementing." --- # Novelty Check Skill Check whether a proposed method/idea has already been done in the literature: **$ARGUMENTS** ## Constants - REVIEWER_MODEL = `gpt-5.5` — Model used via a secondary Codex agent. Must be an OpenAI model (e.g., `gpt-5.5`, `o3`, `gpt-4o`) - **REVIEWER_BACKEND = `codex`** — Default: Codex xhigh reviewer. Use `--reviewer: oracle-pro` only when explicitly requested; if Oracle is unavailable, warn and fall back to Codex xhigh. ## Instructions Given a method description, systematically verify its novelty: ### Phase A: Extract Key Claims 1. Read the user's method description 2. Identify 3-5 core technical claims that would need to be novel: - What is the method? - What problem does it solve? - What is the mechanism? - What makes it different from obvious baselines? ### Phase B: Multi-Source Literature Search For EACH core claim, search using ALL available sources: 1. **Web Search** (via `WebSearch`): - Search arXiv, Google Scholar, Semantic Scholar - Use specific technical terms from the claim - Try at least 3 different query formulations per claim - Include year filters for 2024-2026 2. **Known paper databases**: Check against: - ICLR 2025/2026, NeurIPS 2025, ICML 2025/2026 - Recent arXiv preprints (2025-2026) 3. **Read abstracts**: For each potentially overlapping paper, WebFetch its abstract and related work section ### Phase C: Cross-Model Verification Call REVIEWER_MODEL via `spawn_agent` (`spawn_agent`) with xhigh reasoning: ``` reasoning_effort: xhigh ``` Prompt should include: - The proposed method description - All papers found in Phase B - Ask: "Is this method novel? What is the closest prior work? What is the delta?" ### Phase D: Novelty Report Output a structured report: ```markdown ## Novelty Check Report ### Proposed Method [1-2 sentence description] ### Core Claims 1. [Claim 1] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper] 2. [Claim 2] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper] ... ### Closest Prior Work | Paper | Year | Venue | Overlap | Key Difference | |-------|------|-------|---------|----------------| ### Overall Novelty Assessment - Score: X/10 - Recommendation: PROCEED / PROCEED WITH CAUTION / ABANDON - Key differentiator: [what makes this unique, if anything] - Risk: [what a reviewer would cite as prior work] ### Suggested Positioning [How to frame the contribution to maximize novelty perception] ``` ### Important Rules - Be BRUTALLY honest — false novelty claims waste months of research time - "Applying X to Y" is NOT novel unless the application reveals surprising insights - Check both the method AND the experimental setting for novelty - If the method is not novel but the FINDING would be, say so explicitly - Always check the most recent 6 months of arXiv — the field moves fast ## Review Tracing After each `spawn_agent` or optional `oracle-pro` reviewer call, save the trace following `../shared-references/review-tracing.md`. Write files directly to `.aris/traces/novelty-check/<date>_run<NN>/` and record searched claims, closest papers, reviewer route, raw response, and final novelty decision. Respect the `--- trace:` parameter when present (default: `full`).
INPUTS
- $ARGUMENTS REQUIRED
user-provided method/idea description to check
REQUIRED CONTEXT
- method description
TOOLS REQUIRED
- web_search
- web_fetch
- spawn_agent
ROLES & RULES
- Be BRUTALLY honest
- "Applying X to Y" is NOT novel unless the application reveals surprising insights
- Check both the method AND the experimental setting for novelty
- If the method is not novel but the FINDING would be, say so explicitly
- Always check the most recent 6 months of arXiv
EXPECTED OUTPUT
- Format
- markdown
- Schema
- markdown_sections · Proposed Method, Core Claims, Closest Prior Work, Overall Novelty Assessment, Suggested Positioning
- Constraints
- use the exact Novelty Check Report template with all specified sections
- assign HIGH/MEDIUM/LOW novelty per claim
- include table of closest prior work
- provide overall score, recommendation, and risk assessment
- be brutally honest
SUCCESS CRITERIA
- Systematically verify novelty via all phases
- Be brutally honest about prior work
- Produce the exact structured markdown report
CAVEATS
- Dependencies
- WebSearch tool
- WebFetch tool
- spawn_agent tool
- ../shared-references/review-tracing.md
- Missing context
- Definition or documentation link for `xhigh` reasoning_effort parameter.
- Location or format of `../shared-references/review-tracing.md` referenced in Review Tracing section.
- Ambiguities
- REVIEWER_MODEL example uses `gpt-5.5` which does not exist in current known models.
- The exact meaning and availability of `spawn_agent` and `WebSearch` tool calls are referenced but not defined in the prompt.
- `--reviewer: oracle-pro` option is mentioned without usage syntax or fallback details beyond a warning.
QUALITY
- OVERALL
- 0.85
- CLARITY
- 0.85
- SPECIFICITY
- 0.90
- REUSABILITY
- 0.80
- COMPLETENESS
- 0.85
IMPROVEMENT SUGGESTIONS
- Replace non-existent model example `gpt-5.5` with a real model such as `gpt-4o` or `o3`.
- Add a short 'Prerequisites' section listing required tools (`WebSearch`, `spawn_agent`) and their expected interfaces.
- Make the trigger phrases section use a single consistent format instead of mixing escaped Unicode and English strings.
USAGE
Copy the prompt above and paste it into your AI of choice — Claude, ChatGPT, Gemini, or anywhere else you're working. Replace any placeholder sections with your own context, then ask for the output.
MORE FOR AGENT
- Creative Thinking Frameworks for CS Researchagentresearch
- Academic Paper Figure Generatoragentresearch
- Deep Investigation Agent for Geopolitics Researchagentresearch
- Customer Research Analyst and Synthesizeragentresearch
- Gemini Research Paper Literature Searchagentresearch
- Research Formula Derivation Package Builderagentresearch
- Research Session Provenance Recorderagentresearch
- BIDS Neuroscience Data Organizeragentresearch
- Research Experiment Plan Roadmap Builderagentresearch
- ARA Research Artifact Compileragentresearch
- Research Proposal Experiment Roadmap Generatoragentresearch
- ML AI Theorem Proof Package Writeragentresearch
- Research Formula Derivation Package Builderagentresearch
- Scientific ML Catalog Assistantagentresearch
- OpenMM MDAnalysis Molecular Dynamics Workflowagentresearch
- Publication-Quality Paper Figure Generatoragentresearch
- ML Research Idea Generator and Rankeragentresearch
- ML Paper Figure and Table Generatoragentresearch
- Competitor Profiling Intelligence Analystagentresearch
- Research Refine and Experiment Planning Pipelineagentresearch
- ML Ablation Study Planneragentresearch
- Research Agent Validation Best Practicesagentresearch
- AlphaXiv arXiv Paper Lookup Workflowagentresearch
- AlphaXiv Single-Paper Lookup and Summarizeragentresearch
- End-to-End Autonomous Research Pipelineagentresearch