Skip to main content
NEW · APP STORE Now on iOS · macOS · iPad Android & Windows soon GET IT
Prompts Research Method Novelty Checker

agent research skill risk: low

Research Method Novelty Checker

Verify whether a proposed research method has already been done in the literature by extracting 3-5 core technical claims, performing multi-source searches on arXiv and recent conf…

  • External action: medium

SKILL 1 file

SKILL.md
---
name: novelty-check
description: "Verify research idea novelty against recent literature. Use when user says /\"/u67e5/u65b0/\", /\"novelty check/\", /\"/u6709/u6ca1/u6709/u4eba/u505a/u8fc7/\", /\"check novelty/\", or wants to verify a research idea is novel before implementing."
---
# Novelty Check Skill

Check whether a proposed method/idea has already been done in the literature: **$ARGUMENTS**

## Constants

- REVIEWER_MODEL = `gpt-5.5` — Model used via a secondary Codex agent. Must be an OpenAI model (e.g., `gpt-5.5`, `o3`, `gpt-4o`)
- **REVIEWER_BACKEND = `codex`** — Default: Codex xhigh reviewer. Use `--reviewer: oracle-pro` only when explicitly requested; if Oracle is unavailable, warn and fall back to Codex xhigh.

## Instructions

Given a method description, systematically verify its novelty:

### Phase A: Extract Key Claims
1. Read the user's method description
2. Identify 3-5 core technical claims that would need to be novel:
   - What is the method?
   - What problem does it solve?
   - What is the mechanism?
   - What makes it different from obvious baselines?

### Phase B: Multi-Source Literature Search
For EACH core claim, search using ALL available sources:

1. **Web Search** (via `WebSearch`):
   - Search arXiv, Google Scholar, Semantic Scholar
   - Use specific technical terms from the claim
   - Try at least 3 different query formulations per claim
   - Include year filters for 2024-2026

2. **Known paper databases**: Check against:
   - ICLR 2025/2026, NeurIPS 2025, ICML 2025/2026
   - Recent arXiv preprints (2025-2026)

3. **Read abstracts**: For each potentially overlapping paper, WebFetch its abstract and related work section

### Phase C: Cross-Model Verification
Call REVIEWER_MODEL via `spawn_agent` (`spawn_agent`) with xhigh reasoning:
```
reasoning_effort: xhigh
```
Prompt should include:
- The proposed method description
- All papers found in Phase B
- Ask: "Is this method novel? What is the closest prior work? What is the delta?"

### Phase D: Novelty Report
Output a structured report:

```markdown
## Novelty Check Report

### Proposed Method
[1-2 sentence description]

### Core Claims
1. [Claim 1] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper]
2. [Claim 2] — Novelty: HIGH/MEDIUM/LOW — Closest: [paper]
...

### Closest Prior Work
| Paper | Year | Venue | Overlap | Key Difference |
|-------|------|-------|---------|----------------|

### Overall Novelty Assessment
- Score: X/10
- Recommendation: PROCEED / PROCEED WITH CAUTION / ABANDON
- Key differentiator: [what makes this unique, if anything]
- Risk: [what a reviewer would cite as prior work]

### Suggested Positioning
[How to frame the contribution to maximize novelty perception]
```

### Important Rules
- Be BRUTALLY honest — false novelty claims waste months of research time
- "Applying X to Y" is NOT novel unless the application reveals surprising insights
- Check both the method AND the experimental setting for novelty
- If the method is not novel but the FINDING would be, say so explicitly
- Always check the most recent 6 months of arXiv — the field moves fast

## Review Tracing

After each `spawn_agent` or optional `oracle-pro` reviewer call, save the trace following `../shared-references/review-tracing.md`. Write files directly to `.aris/traces/novelty-check/<date>_run<NN>/` and record searched claims, closest papers, reviewer route, raw response, and final novelty decision. Respect the `--- trace:` parameter when present (default: `full`).

INPUTS

$ARGUMENTS REQUIRED

user-provided method/idea description to check

REQUIRED CONTEXT

  • method description

TOOLS REQUIRED

  • web_search
  • web_fetch
  • spawn_agent

ROLES & RULES

  1. Be BRUTALLY honest
  2. "Applying X to Y" is NOT novel unless the application reveals surprising insights
  3. Check both the method AND the experimental setting for novelty
  4. If the method is not novel but the FINDING would be, say so explicitly
  5. Always check the most recent 6 months of arXiv

EXPECTED OUTPUT

Format
markdown
Schema
markdown_sections · Proposed Method, Core Claims, Closest Prior Work, Overall Novelty Assessment, Suggested Positioning
Constraints
  • use the exact Novelty Check Report template with all specified sections
  • assign HIGH/MEDIUM/LOW novelty per claim
  • include table of closest prior work
  • provide overall score, recommendation, and risk assessment
  • be brutally honest

SUCCESS CRITERIA

  • Systematically verify novelty via all phases
  • Be brutally honest about prior work
  • Produce the exact structured markdown report

CAVEATS

Dependencies
  • WebSearch tool
  • WebFetch tool
  • spawn_agent tool
  • ../shared-references/review-tracing.md
Missing context
  • Definition or documentation link for `xhigh` reasoning_effort parameter.
  • Location or format of `../shared-references/review-tracing.md` referenced in Review Tracing section.
Ambiguities
  • REVIEWER_MODEL example uses `gpt-5.5` which does not exist in current known models.
  • The exact meaning and availability of `spawn_agent` and `WebSearch` tool calls are referenced but not defined in the prompt.
  • `--reviewer: oracle-pro` option is mentioned without usage syntax or fallback details beyond a warning.

QUALITY

OVERALL
0.85
CLARITY
0.85
SPECIFICITY
0.90
REUSABILITY
0.80
COMPLETENESS
0.85

IMPROVEMENT SUGGESTIONS

  • Replace non-existent model example `gpt-5.5` with a real model such as `gpt-4o` or `o3`.
  • Add a short 'Prerequisites' section listing required tools (`WebSearch`, `spawn_agent`) and their expected interfaces.
  • Make the trigger phrases section use a single consistent format instead of mixing escaped Unicode and English strings.

USAGE

Copy the prompt above and paste it into your AI of choice — Claude, ChatGPT, Gemini, or anywhere else you're working. Replace any placeholder sections with your own context, then ask for the output.

MORE FOR AGENT