24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

Course Handbook - Prompt

Engineering Bootcamp
(Working With LLMs): Zero to
Mastery
Welcome to the course!
I’m excited that you’re here, because we’re going to have a lot of fun and learn about
how to use what is undoubtedly a technology that will change the world: Large
Language Models.
This Course Handbook provides all the resources and links that are referenced in the
lessons. I’ll also be updating it with tidbits that don’t fit in the course itself.
If you have any questions, feel free to reach out to me on the ZTM Discord or email
me at scott@zerotomastery.io.

Section 1: Introduction to Prompt Engineering

Lesson: Why is Prompt Engineering Even a Thing?
• Article: Large language models can do jaw-dropping things. But nobody knows
exactly why
• Paper: Emergent Abilities of Large Language Models
Lesson: Applied Prompt Engineering with NASA
• NASA Glenn Research Center - PeTaL website
• GitHub repo for BIDARA: Bio-Inspired Design and Research Assistant

Section 2: Choose Your LLM

Lesson: What I’m Using - Part 1
• OpenAI website
• ChatGPT website
Lesson: What I’m Using - Part 2

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 1/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

• OpenAI Playground
Option A (Recommended Option):
ChatGPT Plus Setup
• Sign-up for ChatGPT Plus (go to dropdown near top-left where you select
models)
Claude Setup
• Sign-up for Claude
Option B (Open Source Option): Llama Setup
• Complete the Open Source Models section of this course to setup your open
source LLM (subject to your computer meeting the system requirements)

Section 3: Guided Project - Build Your First Game

(Snake Game)
Lesson: Setting Up Your Replit Account
• Replit
Lesson: Exercise: Make It Prettier!
• Replit with code for Snake Game

Section 4: How LLMs Work

Lesson: Large Language Models - Part 1
• Lesson from “Complete Python Developer: Zero to Mastery” that explains
programming languages and code interpreters
Lesson: The Transformer Model
• Paper: Attention Is All You Need
Exercise: Visualize the LLM Architecture
• https://www.bing.com/images/create
Lesson: Thinking Like LLMs - The Reversal Curse
• Paper: The Reversal Curse: LLMs trained on “A is B” fail to learn “B is A”
Lesson: Artificial General Intelligence?

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 2/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

• Paper: Sparks of Artificial General Intelligence: Early experiments with GPT-4

• Paper: Levels of AGI: Operationalizing Progress on the Path to AGI

Section 5: Challenge - Build Your Second Game (Tic Tac

Toe with AI Opponent)
N/A

Section 6: Our Prompting Framework

Lesson: Our Prompting Framework
• Our Prompting Framework
Exercise: Get Hyped to Learn!
• https://suno.com/

Section 7: Prompting Fundamentals - The Setup

Lesson: Context - Lost in the Middle
• Paper: Lost in the Middle: How Language Models Use Long Contexts

Section 8: Prompting Fundamentals - The Instructions

Lesson: Language Models are Few-Shot Learners
• Paper: Language Models are Few-Shot Learners
Lesson: How Many Examples?
• Paper: Rethinking the Role of Demonstrations: What Makes In-Context Learning
Work?
Lesson: Thinking Like LLMS - But Wait…
• Paper: Rethinking the Role of Demonstrations: What Makes In-Context Learning
Work?
Lesson: Chain-of-Thought Prompting
• Paper: Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 3/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

Lesson: Zero Shot CoT

• Paper: Large Language Models are Zero-Shot Reasoners

Section 9: Guided Project - Create Your Own Career

Coach
Lesson: Meet Your Career Coach!
• AI Career Coach Prompt

Section 10: Prompting Fundamentals - The Output

N/A

Section 11: The Dark Side of AI (Guardrails, Jailbreaks,

Injections, Hallucinations + more)
Lesson: Jailbreak! (The DAN Prompt)
• Paper: “Do Anything Now”: Characterizing and Evaluating In-The-Wild Jailbreak
Prompts on Large Language Models
Lesson: Many Shot Jailbreaking
• Paper: Many-shot Jailbreaking
Lesson: Prompt Injections
• Preamble’s Declassified Report: Declassifying the Responsible Disclosure of the
Prompt Injection Attack Vulnerability of GPT-3
• Paper: Evaluating T=the Susceptibility of Pre-Trained Language Models via
Handcrafted Adversarial Examples
• Blog Post: Prompt Injection and Jailbreaking are not the same thing
Lesson: Leaking - Part 1 (Prompt Leaking)
• Paper: Scalable Extraction of Training Data from (Production) Language Models
Lesson: Toxicity
• Gemini chat log
Lesson: Thinking Like LLMs - Big vs. Small

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 4/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

• Transluce website
• Transluce’s announcement and explanation of Monitor
• Transluce Model Investigator
Lesson: Challenge - Conduct Your Own Mechanistic Interpretability Research on
Hallucinations
• Transluce website
• Transluce’s announcement and explanation of Monitor
• Transluce Model Investigator
Lesson: The Model Card
• Paper: Model Cards for Model Reporting

Section 12: LLM Hyperparameters & The OpenAI

Playground
Lesson: How To Purchase Credits
• The OpenAI Playground

Section 13: Open Source Models

Lesson: Chatbot Arena Leaderboard
• Hugging Face - Chatbot Arena Leaderboard
Lesson: Exercise: Battle of Intelligence Tests!
• Chatbot Arena
• Test Prompt
Lesson: Introduction to LM Studio
• LM Studio

Section 14: Advanced Prompting Techniques

Lesson: Auto-Priming
• GitHub repo for ChatGPT AutoExpert by Dustin Miller

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 5/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

Lesson: Chain of Density Prompting

• Paper: From Sparse to Dense: GPT-4 Summarization with Chain of Density
Prompting
• Chain of Density Prompt
Lesson: Prompt Chaining
• Paper: PromptChainer: Chaining Large Language Model Prompts through Visual
Programming
• www.promptchainer.io
Lesson: Thinking Like LLMS - Dark Magic
• Prompt used: simul8-IRC(historical_figures); /summon; act_as_IRCclient;
realism+emoji

Lesson: Emotional Stimuli Prompting

• Paper: Large Language Models Understand and Can Be Enhanced by Emotional
Stimuli
• BIG-bench Eval
Lesson: Self-Consistency
• Paper: Self-Consistency Improves Chain of Thought Reasoning in Language
Models
Lesson: ReAct Prompting
• Paper: ReAct: Synergizing Reasoning and Acting in Language Models
Lesson: Applied Prompt Engineering with CRISPR
• Paper: CRISPR-GPT: An LLM Agent for Automated Design of Gene-Editing
Experiments
Lesson: Tree of Thoughts - Part 1
• Paper: Tree of Thoughts: Deliberate Problem Solving with Large Language Models
• Secondary Paper: Large Language Model Guided Tree-of-Thought
Lesson: Tree of Thoughts - Part 3
• Official Repo for Tree of Thoughts (from the researchers, contains the code to run
ToT)
Lesson: Tree of Thoughts - Part 5
• Repo from “dave1010” for Tree of Thoughts (from community member, for “Zero
Shot ToT”)

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 6/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

Section 15: Challenge - Build Your Third Game (Flappy

Bird)
N/A

Section 16: Introduction to Prompt Testing & Model

Evaluation
Lesson: Deep Dive: MMLU Benchmark
• GitHub Repo: MMLU Benchmark
• Paper: Measuring Massive Multitask Language Understanding
Lesson: The Latest: MMLU-Pro
• Paper: MMLU-Pro: A More Robust and Challenging Multi-Task Language
Understanding Benchmark
Lesson: Deep Dive: LLMs as a Judge
• Paper: Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Section 17: Applied Prompt Engineering: Developing

Prompt Tests & Evaluations with PromptFoo
Lesson: Introduction to PromptFoo
• PromptFoo Documentation: https://www.promptfoo.dev/docs/intro/
Lesson: Our 1st Prompt Test
• All code available here: https://replit.com/@skerr33/Our-First-Prompt-Test-Live?
v=1
• Note: the Repl will appear blank at first. This is because it has the empty main.py
file selected by default. Click on the YAML file (or whatever file you want to view)
on the left-hand side to see the relevant code.
Lesson: Our 2nd Prompt Test
• All code available here: https://replit.com/@skerr33/Our-Second-Prompt-Test-
Live?v=1
Lesson: Our 3rd Prompt Test

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 7/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

• All code available here: https://replit.com/@skerr33/Our-Third-Prompt-Test-

Live?v=1
• MMLU Astronomy Questions (organized for evaluation via PromptFoo):
https://docs.google.com/spreadsheets/d/1sakFpeStGwuS0smwUGleA6gavlO128
5kBPLmoiUq1aQ/edit?usp=sharing
◦ Note: if you’d prefer to use this rather than create your own, you can simply
copy and paste that exact URL into the “tests:” field in your YAML file as I do in
the lesson
Lesson: Our 4th Prompt Test
• All code available here: https://replit.com/@skerr33/Our-Fourth-Prompt-Test-
Live?v=1
Lesson: Our 5th Prompt Test
• All code available here: https://replit.com/@skerr33/Our-Fifth-Prompt-Test-Live?
v=1

LAUNCHING SOON: Section 18: Challenge - Become an

AI Researcher (Create Your Own Prompting Technique)

Section 19: AI Research and the Quest for Artificial

General Intelligence
Lesson: Introduction
• Paper: People cannot distinguish GPT-4 from a human in a Turing test
• Extra reading for those interested: A Turing Test: Are AI Chatbots Behaviorally
Similar to Humans?
• Paper: Sparks of Artificial General Intelligence: Early experiments with GPT-4
Lesson: Mechanistic Interpretability Parts 1 and 2
• Anthropic Article on Features: Scaling Monosemanticity: Extracting Interpretable
Features from Claude 3 Sonnet
• List of Features: Feature Browser
• Latest articles by the Anthropic Mechanistic Interpretability Team (generally
updated monthly): Transformer Circuits Thread

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 8/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

Lesson: Scaling Laws

• Paper: Scaling Laws for Neural Language Models
• Extra reading for those interested (Chinchilla Scaling Laws paper): Training
Compute-Optimal Large Language Models
• Epoch AI: source for all the graphs showing trends
• OpenAI article on Diffusion Models

Optional Appendix: Guided Project - Prompting with

Autonomous Agents (AutoGPT)
Lesson: Project Introduction
• AutoGPT Documentation
• OpenAI Documentation
Lesson: Setup Instructions
• AutoGPT Documentation
Lesson: Downloading AutoGPT
• GitHub repo for AutoGPT
Lesson: Setting Up Your AutoGPT - Part 1
• View Hidden Files or Folders on Windows
Lesson: Setting Up Your AutoGPT - Part 2
• GitHub Repo with the docker.yml file

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e0299… 9/10
24/04/2025, 15:12 Course Handbook - Prompt Engineering Bootcamp (Working With LLMs): Zero to Mastery

https://half-money-bd8.notion.site/Course-Handbook-Prompt-Engineering-Bootcamp-Working-With-LLMs-Zero-to-Mastery-6234be19ffcd4e029… 10/10