Scribd
Upload
98 views23 pages

LLM and Generative AI Report - SDAIA

This document discusses the history and development of large language models (LLMs). It notes that LLMs started with word embeddings in the 2000s and progressed to transformer architectures in 2017. Recent LLMs like GPT-3, ChatGPT, and PaLM have achieved broader capabilities but also raise new issues regarding safety, bias, and transparency. Future progress will depend on addressing technical challenges through continued research.

Uploaded by

nalamri
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
98 views23 pages

LLM and Generative AI Report - SDAIA

This document discusses the history and development of large language models (LLMs). It notes that LLMs started with word embeddings in the 2000s and progressed to transformer architectures in 2017. Recent LLMs like GPT-3, ChatGPT, and PaLM have achieved broader capabilities but also raise new issues regarding safety, bias, and transparency. Future progress will depend on addressing technical challenges through continued research.

Uploaded by

nalamri
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 23

)2

2023
4

13

15

16

17

19

This image was created using AI


Large Language Models - LLMs
Foundation Models

OpenAI
2022 ChatGPT(

%50
%5 2026
. 2021
1

This image was created using AI

4
Language Model
Large Language Model
Foundation Models

This image was created using AI

5
ASR(

2018 2015 2013 2001

Attention
Pretrained Language Mechanism Neural Language Models(
Words Embeddings(
Models
Word2vec

RNN

RvNN(

Transformer Architecture( Sequence-To-Sequence( Multi-Task Learning(

2017 2014 2008

6
This image was created using AI
Llama 2( 2 Claude 2( 2 Bard GPT-4( 4

Bard GPT-4

Claude 2 Llama 2

HuggingChat

This image was created using AI

8
Prompt Engineering

9
4

HTML JASON

3 1
4 2

10
8

10

11
This image was created using AI
1.5 2020
1.6
. 2
6

This image was created using AI

Microsoft(
GitHub Copilot
2

13
.3 3- OpenAI

OpenAI
. %94
4
%58

%1.2 OpenAI
ChatGPT Plus
.5

University of Massachusetts Amherst


. 6
BERT

3 5

4 6

14
AI21 Labs 21 Cohere OpenAI

15
37+ %50
9
2026 8
2026

10-5
10

This image was created using AI 10


11
2021 2026

8 10

9 11

16
•

•
-

•
This image was created using AI
GPT-3
2020
API

Wu Dao 2.0
2021

Switch-C
1.6 2021

PanGu-Alpha
200 2021

LaMDA
2021

HyperCLOVA
82 2021
HyperCLOVA Studio(

MT-NLG
530 2021
API

19
PaLM
540 2022

OPT-175B
2022

BLOOM
46
2022
13

ChatGPT
2022
API

LLaMA
65 20 2023

Bard
2023

Falcon LLM
40 2023

20
Claude
2023

GPT-4
ChatGPT Puls 2023

Tongyi Qianwen
2023

HuggingChat
2023

ALLAM
2023

PaLM 2
100 2023
API

ERNIE 3.5
2023

21
Pangu Models 3.0
100 2023

API Claude 2
2023

Llama 2
2023

22
2023

SDAIA.SAUDI SDAIA-KSA

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy