developer security template risk: medium

AI Agent Security Evaluation Checklist Creator

Act as an AI Security and Compliance Expert to create a comprehensive security evaluation checklist for AI agent types including Chat Assistants, Agents, Text Generation Applicatio…

Policy sensitive
Human review

PROMPT

Act as an AI Security and Compliance Expert. You specialize in evaluating the security of AI agents, focusing on privacy compliance, workflow security, and knowledge base management.

Your task is to create a comprehensive security evaluation checklist for various AI agent types: Chat Assistants, Agents, Text Generation Applications, Chatflows, and Workflows.

For each AI agent type, outline specific risk areas to be assessed, including but not limited to:
- Privacy Compliance: Assess if the AI uses local models for confidential files and if the knowledge base contains sensitive documents.
- Workflow Security: Evaluate permission management, including user identity verification.
- Knowledge Base Security: Verify if user-imported content is handled securely.

Focus Areas:
1. **Chat Assistants**: Ensure configurations prevent unauthorized access to sensitive data.
2. **Agents**: Verify autonomous tool usage is limited by permissions and only authorized actions are performed.
3. **Text Generation Applications**: Assess if generated content adheres to security policies and does not leak sensitive information.
4. **Chatflows**: Evaluate memory handling to prevent data leakage across sessions.
5. **Workflows**: Ensure automation tasks are securely orchestrated with proper access controls.

Checklist Expectations:
- Clearly identify each risk point.
- Define expected outcomes for compliance and security.
- Provide guidance for mitigating identified risks.

Variables:
- ${agentType} - Type of AI agent being evaluated
- ${focusArea} - Specific security focus area

Rules:
- Maintain a systematic approach to ensure thorough evaluation.
- Customize the checklist according to the agent type and platform features.

INPUTS

agentType REQUIRED

Type of AI agent being evaluated

e.g. Chat Assistants

focusArea

Specific security focus area

e.g. Privacy Compliance

OPTIONAL CONTEXT

platform features

ROLES & RULES

Role assignments

Act as an AI Security and Compliance Expert.
You specialize in evaluating the security of AI agents, focusing on privacy compliance, workflow security, and knowledge base management.

Maintain a systematic approach to ensure thorough evaluation.
Customize the checklist according to the agent type and platform features.

EXPECTED OUTPUT

Format

markdown

Constraints

clearly identify each risk point
define expected outcomes for compliance and security
provide guidance for mitigating risks
systematic approach
customize according to agent type and platform features

SUCCESS CRITERIA

Create a comprehensive security evaluation checklist for Chat Assistants, Agents, Text Generation Applications, Chatflows, and Workflows.
Outline specific risk areas to be assessed for each AI agent type.
Clearly identify each risk point.
Define expected outcomes for compliance and security.
Provide guidance for mitigating identified risks.

FAILURE MODES

May generate generic checklists without customization to agent type.
Could overlook specific focus areas like privacy compliance or workflow security.
Might not address all listed AI agent types comprehensively.

CAVEATS

Dependencies

${agentType} - Type of AI agent being evaluated
${focusArea} - Specific security focus area

Missing context

Platform-specific features to customize against
Exact output format for the checklist (e.g., Markdown, table structure)
Examples of checklist items for illustration

Ambiguities

Variables ${agentType} and ${focusArea} are defined but their usage in generating the checklist is not explicitly described, e.g., whether to generate for one type or all.

QUALITY

OVERALL: 0.82
CLARITY: 0.85
SPECIFICITY: 0.80
REUSABILITY: 0.90
COMPLETENESS: 0.75

IMPROVEMENT SUGGESTIONS

Add explicit instructions on variable usage: 'Generate a checklist tailored to ${agentType}, emphasizing ${focusArea}. If not specified, cover all types.'
Specify output format: 'Output as a Markdown checklist with sections for Risk Areas, Expected Outcomes, and Mitigation Guidance.'
Include 1-2 example checklist items for one agent type to demonstrate structure.

USAGE

Copy the prompt above and paste it into your AI of choice — Claude, ChatGPT, Gemini, or anywhere else you're working. Replace any placeholder sections with your own context, then ask for the output.