Beginner
What is LLM security?
LLM, or large language model, is a language model with a large number of parameters trained on broad text or multimodal data to understand and generate language.
What is prompt injection?
Prompt injection is an adversarial technique that manipulates a language model by placing malicious or unintended instructions in user input, documents, web pages, or other content the model processes.
What is a jailbreak in an LLM system?
Prompt injection or jailbreak refers to adversarial input intended to bypass a model's instructions, safety policies, or operational controls. Mitigations include input filtering, retrieval isolation, least-privilege tool access, policy enforcement, and layered guardrails.
How is RAG different from fine-tuning?
Use RAG when the model needs current, source-grounded information; use fine-tuning when the model needs specialized behavior, task performance, domain adaptation, or style learned from data.