LLM (Large Language Models)

# Prompting + Defensive Measures

LogoLearn Prompting: Your Guide to Communicating with AI

# Types of Prompt Injections

LogoUnderstanding Direct and Indirect AI Prompt Injections and Their ImplicationsEmbrace The Red

  1. Direct Prompt Injections

  2. Second Order Prompt Injections (aka Indirect Prompt Injections)

  3. Cross-Context AI Injections

# Copied Prompt Injection PoC

https://prompt-injection.onrender.com/prompt-injection.onrender.com

# Insecure Response Processing [Data Exfiltration]

LogoDo not blindly trust LLM responses. Threats to chatbots.Embrace The Red

# AI hallucinations

LogoCan you trust ChatGPT’s package recommendations?Vulcan Cyber

# Testing Frameworks [To-Do]

  1. Giskard

LogoGitHub - Giskard-AI/giskard: Quality Assurance for AIGitHub

  1. langflow

LogoGitHub - logspace-ai/langflow: ⛓️ Langflow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.GitHub

# Jailbreaking Chat/ Do Anything Now (DAN)

https://www.jailbreakchat.com/www.jailbreakchat.com

# Threat Modelling

Threat Modeling LLM ApplicationsAI Village
PreviousXSS (Static Nonce in CSP)NextC# - P/Invoke

Last updated

Was this helpful?