Lecture 1 - Intro - GenAI Tools v1.2
Lecture 1 - Intro - GenAI Tools v1.2
0”
Jim Kyung-Soo Liew, Ph.D.
Associate Professor in Finance
President of SoKat
Spring II 2025
Lecture 1 – Intro and Tool-Up!
Q: Who’s going to create the first one-person Unicorn?
• Google’s NotebookLM
• ChatGPT
• Anthropic’s Claude
• Google CoLab (i.e. Python)
• Codeium’s Windsurf
• Hugging Face
• Others (i.e. Groq, DeepSeek)
https://scale.com/leaderboard https://huggingface.co/spaces/ArtificialAnalysis/LLM-Performance-Leaderboard
3/25/2025 @Prof Jim Liew 8
Table of Contents
Introduction to Course Brief History of AI
• Managing Expectations • NEO Momentum Mar-2025
Instructor Bio Scaling Laws
• Practitioner Perceptrons & Neural Networks
Grades Tips
• WOW! FINAL Presentations (8th week)
Homework Assignment #1
Basic Tips
Vibe Code Assignments
• Strict Guidelines
Daniel Khashabi
11
Early AI Research (1950s-1970s)
Daniel Khashabi
12
Machine Learning Emerges (1980s-1990s)
Daniel Khashabi
13
The Rise of Modern AI (2000s-2010s)
Daniel Khashabi
14
Foundation of LLMs
▪ Word embeddings (Word2Vec, 2013)
▪ Sequence-to-sequence models (RNNs)
▪ Attention mechanism
▪ Transformer architecture (2017)
▪ Shift from recurrent networks to parallel
processing
Daniel Khashabi
15
Progress in AI
Artificial Intelligence (AI) is making substantial inroads into our everyday lives, demonstrating
tremendous potential across numerous domains, including business/finance and healthcare. This
course aims to impart learners with crucial understanding of AI's core technologies, such as neural
networks, deep learning, computer vision, natural language processing, and generative AI. We will
also provide a succinct introduction to the burgeoning areas within AI. This course takes a hands-
on, experiential learning approach (VIBE CODING!), making use of the latest cloud computing
platforms to provide practical understanding and application. Through this course, students will
establish a robust comprehension of vital AI technologies, equipping themselves with the working
knowledge required to harness these technologies in driving business growth and creating value.
Technology is still evolving very rapidly. Therefore, there is a level of experimentation with new
material that will take place during the semester. Students are required to be flexible as and when
topics or material in class are revised or modified. We will do our best to ensure that no undue
burden is placed on students.
24
Contents
Brief History of AI
• NEO Moment (#GTC2025)
AI Winter to Winter
Trifecta
Scaling Laws
Sentences to Embeddings
Conclusions
GENERATIVE AI
LARGE LANGUAGE MODELS
NEO!
Learning occurs
by making errors
– Back-Prop!
@Prof Jim Liew 28
https://www.reddit.com/r/artificial/comments/d4pm74/a_brief_history_of_ai_from_1940s_till_today_image/
More recent History of AI Development
Hardware
Algos/
Data Models
3/25/2025 30
3 Important Components for Current AI Success!
The amount of
computing power,
per dollar
Daniel Khashabi
https://www.lesswrong.com/posts/c6KFvQcZggQKZzxr9/trends-in-gpu-price-performance 33
Data: Massive Amount of Data
Daniel Khashabi
Image source: https://www.forbes.com/sites/tomcoughlin/2018/11/27/175-zettabytes-by-2025/?sh=1e6ca8455459
34
Algos: Algorithmic innovations
▪ Advances in optimization
Daniel Khashabi
35
Current state of Large Language Models
y = f(∑(wi * xi) + b)
Where:
• xi : input
• wi : weight
• b: bias
f: activation function (e.g., step or sigmoid)
| x1 x2 z = x1 * w1 + x2 * w2 + b Output|
|---- ---- ----------------------------------- --------- |
|0 0 (0) * 1 + (0) * 1 – 1.5 = -1.5 ?
____
|0 1 (0) * 1 + (1) * 1 – 1.5 = -0.5 ?
____
|1 0 (1) * 1 + (0) * 1 – 1.5 = -0.5 ?
____
|1 1 (1) * 1 + (1) * 1 – 1.5 = 0.5 ?
____
Example - AND Gate
• Inputs: x1, x2
• Weights: w1 = 1, w2 = 1
• Bias: b = -1.5
• Activation function: Step function, i.e. max(0, x)
| x1 x2 z = x1 * w1 + x2 * w2 + b Output|
|---- ---- ----------------------------------- --------- |
|0 0 (0) * 1 + (0) * 1 – 1.5 = -1.5 0
____
|0 1 (0) * 1 + (1) * 1 – 1.5 = -0.5 0
____
|1 0 (1) * 1 + (0) * 1 – 1.5 = -0.5 0
____
|1 1 (1) * 1 + (1) * 1 – 1.5 = 0.5 0.5
____
Example - AND Gate
• Inputs: x1, x2
• Weights: w1 = 1, w2 = 1
• Bias: b = -1.5
• Activation function: Step function, i.e. max(0, x)
| x1 x2 z = x1 * w1 + x2 * w2 + b Output|
|---- ---- ----------------------------------- --------- |
|0 0 (0) * 1 + (0) * 1 – 1.5 = -1.5 0
____
|0 1 (0) * 1 + (1) * 1 – 1.5 = -0.5 0
____
|1 0 (1) * 1 + (0) * 1 – 1.5 = -0.5 0
____
|1 1 (1) * 1 + (1) * 1 – 1.5 = 0.5 0.5
____
and
51
Upload the McKinsey’s state of AI pdf into
NotebookLM
Summary
appears in
the middle
panel.
https://huggingface.co/spaces/multimodalart/stable-video-diffusion
What if you company has no expert Data Scientist on staff, but need
to analyze all this data here..
Tips: Watch non-technical primers to build your intuition. Learn Python (for free). Do AI projects with your
daughters! https://medium.com/javarevisited/10-free-python-tutorials-and-courses-from-google-microsoft-and-coursera-for-beginners-96b9ad20b4e6
https://jalammar.github.io/visual-interactive-guide-basics-neural-networks/
3/25/2025 @Prof Jim Liew 63