ChatGPT4.

0
!"#$%&'()
目录

ChatGPT4.0 ................................................................................................................................................................. 1
!"#$%&'() ................................................................................................................................................... 1
*+ LLM ,-+.'+/0 ............................................................................................................................. 3
1*2,- ................................................................................................................................................................... 3
1. ChatGPT 3456 ................................................................................................................................................... 3
2. ChatGPT 3789:%61;<=>?@ABCD2 ....................................................................................... 3
3. ChatGPT 3E45%61ChatGPT ,-+FGHI2 ....................................................................................... 5
4. ChatGPT 378BJ%61ChatGPT %KL&JMN_Transformer2 ............................................................. 8
5. ChatGPT O!PQ11750 RST2 .................................................................................................................... 19
6. UVWX ChatGPT %YZ-[1ChatGPT YZ\%]—^_`a2 ............................................................ 20
1b2c' ................................................................................................................................................................. 20
1d2/0 ................................................................................................................................................................. 21
1. efghijkl%/0l ................................................................................................................................. 21
2. mnop%/0l ................................................................................................................................................. 21
3. qrst%/0l ................................................................................................................................................. 21
4. Luvw/xyz{' ............................................................................................................................................ 22
ChatGPT4.0 %|}Lu ............................................................................................................................................ 22
b+ LLM !~•?€$%c' ....................................................................................................................... 22
1*2ChatGPT D\45 ......................................................................................................................................... 22
1. ChatGPT c' ......................................................................................................................................................... 22
2. •‚ƒ„…†‡ ..................................................................................................................................................... 22
d+ Mˆ"#‰78Š' ChatGPT ............................................................................................................... 28
1*2‹ŒW•Ž+••Œ•M‘A ..................................................................................................................... 28
1b2"’W“” ChatGPT •–—˜%"’™š›œ•žŸT +¡¢£¤›mn¡¥"’¦§ ............ 28
1d2¨©W“” ChatGPT Oª%«¬-u«®D›¯°±o%¨©²³ .................................................... 28
1´2"µWCD"µo¶·”g¸›œ•T¹º»’¼£¤-¡¢T ½›ˆ¯YZ%CD"µ ......... 28
!" LLM #$"%&"'(
ChatGPT ¾•%HI¿ÀÁ3ª§e¦§(Large language model›ÃÄ LLM)%c'ÅÆ›ÇÈKƒÉÊ.'
”ËŽÌÍ%Ϊ§e¦§Ï1LLM2›ÐzÑ0” ChatGPTÅ

1*2,-

1. ChatGPT 3456

l ChatGPT1—ÒÓ Chat Generative Pre-Trained Transformer23 2022 Ô 11 ÕÖ OpenAI ×Ø%*Ù AI ÚÛ

¦§1Ü{XÝ%Þßà AI ¦§2›'áâãä•åæçèãé%^¿›ChatGPT Ü{êëìíîïÅ

çð”ÌñÉ«9ò›ChatGPT óôY+óCD›{Çîï•õö÷+øùúû+üýzZk%Žþ+ÿ
!z.Ë%"é›#$ó%&™% AI Þß'(Å

ChatGPT )*Oª%^_Þß®D›å+,z0”-.XÝ+/012+¶3:í@45+êë^¿6J
7ÅÌ{±8@A«%ôYÞß›*9:tÁ;¶<Ã=>?2@AB<Ó^¿6–«C¢þD>*E—
˜FçX{G%CDKƒ:íHIÅ

l AJX” ChatGPT K!LM.Nû[W

① ChatGPT %ïI3OP?Q%VRÅ

② ChatGPT 3ST=U›3ÖV׉j*W%STîcÅ

XY 1 ChatGPT %.Nû[

!"#$%&'()* +,-./01 23456

Z [HX ChatGPT %[\›ChatGPT 3]Ÿ^O%›FÍ_9:úûïIÅÍX” 2021 Ô`•%]a>[Ÿ

0›bÇ7RŠ' ChatGPT›Í%ïIzDc/›ãdêe}Cçèf±Å

2. ChatGPT 3789:%61;<=>?@ABCD2

① ABCDgh;>?<=›,iiz3

jkABCDlm>noí®›,Í%BJ,-pk@A«ª;%BJHàK!qd%rsÅABCDó
oxgh>;<=$%*t“¿uv›7>?w`p%x`+/0y--z-7›,!{oH|pkK!
zÉÅ

}7›AB>?OPÑÑ3†~T=¦§•ª€T $=UÐg›•‚ƒA«ª;$«„…†{‡l7:
ˆ“‰ÅŠ*‹@A«ª;$%>?wŒ•x`-OP%ê.clŸ{ª%zÉÅ
 Ž•›ABCD¦§••‘’-a‘%D“›”zƒA«ª;$K•%/03Ç?(Ó“‰%Ū;$%
qr––3@A%:—?˜-a‘'(^²!*™%›ÐABCDz)*ŠECDÅ

šŽ›c›ABCDgh>;<=%no,œ›Ípk3*E•°%CD'²›@A«ª;Ÿ{ª%zÉÅ

② >?w vs Token

>?w- token ž3@/0y-Ÿè%Ÿ ›,!)'%9¡-c'ÁK!*tzÉÅ

>?w3ª;$%“¿¢w›£¤¥¦-y->?/§Å>?w`pÇ…†çx›†~zÉ%•í-¥ä
Hà›¨í©ª%>?OPÅ>?w{Çy--K•ª€%/0›å+¥‘‘`«%•L/0-gêÌñ
>?w%KL/§ÅšŽ›>?w3:ˆ'Kqd%/0y-‘`*Å

ç¬`È›token 3!¬-M<=$.'%*MŸ ›Y®*E{ǯ¬-M:°-[-y-%±§›†.

'”Y®²M³9%X´+µ¶T 7ÅToken %)'¨à{Ç3T_+_·+±§7›”{Ç3¸3•%
b}N¹°ºÅ!¬-M:°$›Token ¯'”»¼:°$%½E¾€+T «§-&-±7Å

jk>?w- token !9¡ÁK!*tzÉ›,ÍJž3/0y--¥ä%“‰¢wÅ>?w†~¿/§-

/0¥ä›±8>«„¬-M$%ÀÁ‚¶¬-¢w%®DÅÐ token œ{ǯ¬-M:°-[-y-›±
8>¬-M:°$T «§-&-7®DÅ

③ ÂÓ~ÄMN

ÂÓ~ÄMN†~ÅÆÂÓÇ3ÈÉʲtä•/0%H˛NJ¦§âèÂ@ËŽÌ•çè%/0Å

GPT 3*MÍmn%e¦§›Í%fÎ3Ï'> Transformer $%ÂÓMNÅ! GPT $›êÂÓMN

¯ÐÑc'ÅÌ$›†~ÒÓM¹Æ%ä•Ô€uÕJÓÖ×+Ø+µ›{Ǭ-ÙXc%ÂÓÚq›
•ÐmÛ¦§%äÙÅ

ÂÓ~ÄMN3!ŠM~:$±8%ÅÖ”ä•Ü݆._å檀Þè%/0›}7ß'à7›ÒŠ
t/0”áÓÖ×+Ø+µ›_Š¦§%ÂÓuâ›ã䦧%åæÅÓ>çèŠEaé%Ù8›{Ç
ÅÆ*9%ÂÓÇ3g~ÄÊŠtÞ'/0Å}7›!^¿:íÌ•$›Ó>çè:íq©%¢à›{
dž~ÂÓ~ÄMNÈÉÊËŽ:í¹Æ`•%¢à›ç覧q©:íçÉ%¢àÅÉo›!^¿u
«Ì•$›”{dž~ÂÓ~ÄMNÈÉÊzçè%/0›þ%¦§%u«…tÅ

ê`›! GPT ëì$›ÂÓ~ÄMN{ÇíóWx-[-y-^¿/0›þ%¦§åæ-jklÅ

④ Ãï%¿À vs ABCDDð9:Ãï

Ãï%¿À3‘ñ›‘ñ3:ˆ'òóKŸMˆÀ!&$ôë-×:==õc9:%VR›3òó'Kª
€ŸMˆX•ö÷ø9:•'^ëõc%ìù~:ÅŠÊ%ˆ-==¾=3ÇÞMˆÓ“‰%M‘¦úz
>›bÇM‘9:z>‘ñ+Ãï+êûÃïÅ

êûÃï%Z¿J'3ü:ˆ'K%òóÇiòóK%ˆÀ߆:Kýþ›•ÐübŸòóÿ!ŸÏ”ù
':K%HÔ&JÅM‘9:z>êûÃï›”"z)*:KD“›z›#5Ŭ›ê3zD$©—%%
&'ýé›()*¾›Ÿt*+"_Xê%/L–í,-›ÞË•°:KÅÃï%$pJ'MNŸLuz
./”ŠEòóK%ˆ-==õc›Ð3Š'ª€òóX/0}C0K-c'ÅABCD¦ú%"3Ãï
X/00K-Š'$•°”ŸM'%LuŦúŠLu.k{Ƕ;A\{o%BJ›)Ÿ1_2µ›”
Ÿí®{DÅ

bÇêûÃï]Ÿ3ˆ~M‘±8›OABCDµm4õ’¼›5•%VRÞË06Å
3. ChatGPT 3E45%61ChatGPT ,-+FGHI2

l êke¦§1NLP2%×7›ûd?˜dM89Å

① :*89Çe³¬¦§Óû›Í%\ËçXâ;;Ü#Í*ÜÝ›üÍÒŠÜÝ<íà›<Z ÁÈ
^è²Í=Ì$*M_%Ù8ŸæÅ,ŠM¦§ŸLª>‹›*3^¿e¡ïÕD“zO›¬7Xe³
¬¦§Ð›Î?@ABÏ@ÎB@A?Ï3É*MÃCBb3Ë^¿Kƒðoo›eܳ¬¦§%²M
^_ÚqDE_Ù8Fr›zÏ”-˦§&-Å

② :b89àÔ€¦§%G:›Ÿå[*Á¼Lª>‹›Éo”[*><à•%^¿/0HIö÷Å,àÔ
€¦§”Ÿ²t•J›*3¢à%Ô€3K*%›ÞËyu²to¡à%oqæ¡›b3¦§mnoƒ„
Ù8LtÎMNÏ›Fmn~:3OC%›PQ-“#hRSTªFmnopUsÅŠPQŽLM89%
êke¦§âDy-çXâ%BJ›¬7â%^¿[V+aWuV@û÷¦§X¯›,ÞËy-©
ªÌ•ÅÐ Transformer HI%Y™›ZF|¾>ŠEýéÅ

③ :d89›Transformer [*>êke¦§%ÂÓMNö÷›Ü†~à@à%è^lmn›Í_#ÓM
à`pÅ°¢•%Úq[\›F†~<Cmn¦àª]þ^mn_tÅZ3 Transformer HI%Y™›ÍÒ
êke¦§@•:d×789——Ímne¦§›ÜÍD†~mn›Ò^`û÷@çèÀÁ+Kƒ#
f“þl”Ùg›ù•í˜%^¿þD#a‰Å

l ChatGPT %fÎÌ•3:í*M“•-%bõ”›Z cŸ^¿›:í*M±•A«deUf%È*M•-

KƒÅbg“•-”›hZ TiRMOj+T_=dk7A«leKƒ³¬uv›z=`Èg{DÙ8%
KƒÅChatGPT <z3m`X¬^_¿%›Ð3DzEáÁ%“ÃCno”Ó. Å5·›ChatGPT _:
í*M{D%¢àºY›<#ÙÓM¢à%ŸæpÒW

Ë ChatGPT ìíƒe^`ŠÊ%Ì•o›Í±qÁâ3*rs*rx×öW“!cŸ%^¿%“‰Á›È
*Màct3456”——<FÓuž_vw*Mà1ójkxx›Ívw*M“token”›Š{Dâ3¢à
%*Lu›Š"3Ó45ÍŸo_“6–˜à”%,š2Å

!Ó*y$›Íž_mÛ*MzŸŸæ%¢àºYÅ,3›Íct{|PM¢àgvwÛÍZ!eJ%^
`1¶Ì8Ìñ}~2$3K!•Ml%ÅŸA{DùÓct{|ÎpÒ5%Ï%¢à1ܯuo5%
ΟæÏ%¢à2Å,Š"3*t>€%]aV•‚‚×:%xHÅšÓÖ”²E,š;;”nŸ*ÛB
J_Ÿ*E<=à%-[;;7RBJê3{|pÒ5%%¢à›BJ†._mÛ*ƒ„.Ι…Ï%^
`›•z†®Ì86–“1Ÿo‡ˆ‰_q©2Å7RŸo1•Mx2BJ{|ðäpÒ%¢à›{D_
mÛ*ƒÎóŸŠÏ%^`ÅŠQK!•MlË!›7RBJouŠ'çÉ%þ®›{{DÓuž_m
ÛzÉ%^`Å
 !Ž~:$›_Ÿ*M³9%bg“Œt”1temperature2ST›Í*9ðäpÒ%¢à_¯Š'%•æ›
X”^`:훊M“Œt”5WÅÆÓ 0.8ŵmO4%3›ŠQ]ŸŠ'“-Ž”BŠâ3c¯6•!±•
$™J'%]±Å}7›“Œt”Ÿ `bÇK!›3šÓhTuØ1g곬ˆ-=%‘’uØ2“W¯
Š'›,ˆ•"BJb’›ÍJ`p]Ÿ“ˆ-”^²Å

l È|Ò7®78”mÁ¼ŸæYÅ

① •–›BJ—˜12FG% “e¦§ “>?OPW

② ™•›BJÒš•>[ŠM>?OP›<›ŽÍ378BJ%Å,œŽÓ•›BJ{ÇÒŠM“OP¦§”
JÓ*MžŸc'ÛBJ%^¿$›<Z ¦§ùÓct ¡%Ÿæ›"éŽ 5 M¢àW

”lVR•›_ÒÌ¢£Ó†à¤à=%“T •”W

③ q©“c'¦§“%aé—!Ó*y$w•Ÿæ5%%à1!Ž¶3$h9Ó¦§$% “*9”2W

④ 7R¥4õȦ_#Ê6!ŠE1”§t”2aéÈ›{¨"_Ù8çË©ª-q©%aéÅ
⑤ ,7Rzê3ü{ “«¬ “à›Ð3Ÿo•Mü{ “„«¬ “à1”•Ml “Xc “Œt “Ó 0.82-6BJ"s
{Çõe^¿>W

ü ÐÓuŠÊ\›ž_ŸzÉ%•M{|›Xc%^¿”_zÉÅ

ÜŠ!:*y›Z cŸ%^¿›”Ÿ{o{D%“È*Mà”{D{|1!ŒtÓ 0.8 %aéÈ2›c›Í

J%Ÿæ{¨"_Èã13%›!ŠMXTXÁ%m\Xc”*M n–1 %“®v”¯°›Š3eÂ%*±³¬
³²2W

ü Ž•›³´9vJÓÌ8@®9vŸæuØŸè%]ˆ%Sµ›Í3Ö¶·ª=%eÂ=w¸¹·º»
Ï·³´1George Kingsley Zipf2” 1949 Ô×Y%±(9vÅ

Í{ÇY¼ÓW!êkeÂ%ef½Q›*M¢àÙ8%•æ@Í!•æYQ%pÒíõ¬ÅbÇ›
•æ5%%¢àÙ8%•æª¼3Ù8•æ:b¹%¢à% 2 ½›ÐÙ8•æ:b¹%¢àœ3Ù8•
æ:´¹%¢à% 2 ½Å
4. ChatGPT 378BJ%61ChatGPT %KL&JMN_Transformer2

ChatGPT 3¯°! Transformer - NLP %“‰Á›!Xݲ³$%)'c'ÅChatGPT ×7%Zh3Ímn¦§

%×7›Ímn¦§•–d¾®”¿À 2017 ÔþÙ transformer Áˆ

① Transformer ÂÃ

l Ó45d' Transformer

!]Ÿ transformer %oÄ›3'%3 RNN1¶‰3Ìñ¢Ô¶ÅÔ¾E LSTM/GRU 72gJÓ¸[3‘Å

RNN ¦ÆÓuâDÇ}*Mä• token -Ž*u%ÈÉýþ›k•mÛäÙÅÍ%o°VˆŠmŠM¦§D
ÊmÛsËÌ%./è²›Š”ŠmÍzDÊ<C¬-›¦§åæiuäÅ

2017 Ô google %M‘ÍÎÏÐ! NIPS Á×Y>ÑAttention is all you needÒ%^`›V6l%þÙ>!°º

¢Óëì›ì—ÔÕ CNN+RNN›âÇ Attention ÂÓVˆ%â%OPÁˆ›ÒÓ Transformer›Ž^±
8%Ì•3M‘ÍÎÅ

l Transformer ûd,-ÂÃ

l Seq2Seq Ì•

Seq2Seq Ì•h%3ä•-äÙž3°º%Ì•›äÙ%stzk9oÖ'%¦§›ŠEaé*±3!M‘
ÍÎ%Ì•$Ù8%›Ò. $^ÍÎí×^›Ø5ŠÜ×^%stŸ{D¬$^Ù›”Ÿ{D_¬$^
s›bÇäÙ%st"zk9>Å7X›ä•%$^stÓ 4›äÙ%×^stÓ 2.
Seq2Seq Ì•†.'%3 Encoder+Decoder ¦à›–Ò*M°º¸3í*MÁÈ^DE›¥Š' Decoder g
[3ÅËk›BJÑÑÚ context vector JÓ¸3‘Û[3‘%ä•Å

l Attention ÂÓMN

Ë~Û/0Ü•ÝÞo›BJ%ª;_ÚÂÓß!ûd/0Á›Š3ª;%ÂÓMNÅÓMà% Q
1Query›d¦Ö×%2_Z ùM°º$%Ó*M K1Key›7à¯Ö%2¬-mu›k•“”mu¥u
o³²

Attention %á‹W

ST•W笔 CNN+RNN Ì©ªtóU›ST”ó•›bÇX-“%dé”"óU

_t¨WAttention [*Ê> RNN i̾'¦§zD<C¬-%ö÷ÅAttention MN%Ó*y¬-z./”

Á*y%¬-VR›šŽ{Ç- CNN *Ê<Cy-Å

åRWW! Attention MN@•`Ž›Ÿ*Mö÷ªw{âãWsËÌ%/0_¯ä=›"WƒqrD“ä

%A›qzå~¦%]a3*Ê%Å
② Transfeomer BJô:

l •~•%áæV•›•–Ò Transformer ¦§Ë\*MžçèJÅ!M‘ÍÎ$›"3ä•*Ee›

äÙé*EeÂ

l Ø5êVŠMžç›{ÇëÛÍ3Ö¸3ìí+[3ìí-ñJ%x`ìí

l ¸3ìíLuÖ*î¸3‘ˆíÅ[3ìíLu”3ÖçÉT€%[3‘ˆí

l bŸ%¸3‘!VˆÁž3çÉ%›,ñJ]ŸïðSTÅÓM[3‘žu[íLMÝG
l •¸3‘ä•%ÜÝ•–_?~*MêÂÓ1self-attention2G›ŠGíî¸3‘!XÓM¢à¸3
oèÂä•ÜÝ%Ìñ¢àÅêÂÓG%äÙ_¥¦ÛŽñ1feed-forward2>?OP$ÅÓM¹Æ
%¢àXc%Žñ>?OPžì—*Ê1é*E[a3W*GòóÓ*M¢à%*Lôõ>?OP2Å
[3‘$”Ÿ¸3‘%êÂÓ1self-attention2G-Žñ1feed-forward2GÅöŽ`•›ŠLMG`
p÷Ÿ*MÂÓG›'gèÂä•ÜÝ%çèLu1- seq2seq ¦§%ÂÓJ'ç„2

l ½EÔ€¶ø€3#Ê!¦§%zÉLu$Òä•¢=ÓäÙ%Å

ƒªLu NLP c'*Ê›•–ÒÓMä•¢à†~àù•-Ë¢=ÓàÔ€ÅÓM¢àž¯ù•Ó 512

L%Ë€›àù•~:â×:!5FG%¸3‘$ÅbŸ%¸3‘žŸ*MçÉ%³‹›ÜñJ`«
*MÔ€ºY›ºY$%ÓMÔ€ªUÓ 512 LÅ!FG15V•2¸3‘$Í"3àÔ€›,3!Ì
ñ¸3‘$›Í"3È*G¸3‘%äÙ1”3*MÔ€ºY2

Ô€ºYúå3BJ{ÇÅÆ%ûSTW*±3BJmn•$5sÜÝ%stÅ

l Òä•°º}Càù•`•›ÓM¢àž_ô?¸3‘$%LMÝGÅTransformer %*M˜³l›!
ŠQä•°º$ÓM¹Æ%¢àžŸêe•³%üýô•¸3‘Å!êÂÓG$›Štüý`pK
!./è²ÅÐŽñ1feed-forward2G]ŸŠt./è²ÅšŽ!Žñ1feed-forward2Go{Ç<C
þC½EüýÅ
l ¸3~:W

*M¸3‘`«Ô€ºYJÓä•›`!ÒÔ€ºY$%Ô€¥¦ÛêÂÓG}Cy-›k•¥¦
ÛŽñ>?OPG$›ÒäÙVR¥¦ÛÈ*M¸3‘$Å

äÙ°º%ÓM¢àž?~ê¸3~:Åk•›ÍJ½ê†~ŽÔ¥ÿ>?OPWì—çÉ%OP›
ÐÓMÔ€žuÕ†~ÍÅ

l •~•áæëêÂÓMN

•!¦§y-ä•°º%ÓM¢à›êÂÓ_èÂùMä•°º%bŸ¢à›íX¿¢àó
W%}C¸3ÅRNN _ÒÍc?y-~%Ž|%bŸ¢à+Ô€%Y®@ÍZ!y-%ËŽ¢à+Ô
€V•™gÅÐêÂÓMN_ÒbŸçè¢à%-[œ•ÛBJZ!y-%¢à$Å

ËBJ!¸3‘#51!$5ÁG¸3‘2$¸3ÎitÏŠM¢ào›ÂÓMN%Lu_¦èÂÎThe
AnimalÏ›ÒÍ%Y®%*Lu¸•ÎitÏ%¸3$Å
l •"•áæëêÂÓMN

¬-êÂÓ%:*y"3•ÓM¸3‘%ä•Ô€1ÓM¢à%àÔ€2$:ídMԀŔ"3
xX”ÓM¢à›BJ6–*MÖ×Ô€1Q2+*MØÔ€1K2+*MµÔ€1V2ÅŠdMÔ€
3†~àù•@dMÚqDE•ç#6¯%›ÍJ%Lt3 64›Ðàù•-¸3‘%ä•+äÙÔ€
% L t 3 512. , ± q Á z O é L t ó U › Š â 3 * E “ ” Á ˆ Á % { | › { Ç Š o T Â Ã “
1multiheaded attention2%ªLu¬-0$z¾Å

l †~DE&-±8êÂÓMN

:*y3¬-Ö×DE+ØDE-µDEÅÓŽ›BJÒä•ÜÝ%àù•%}DE x $›ÒÌ#ÇB
Jmn%ÚqDE1WQ+WK+WV2Å

X DE$%Ó*CXc”ä•ÜÝ$%*M¢àÅBJ¥uëÛàù•Ô€1512›¶X$ 4 M¤Ý2
- q/k/v Ô€164›¶X$% 3 M¤Ý2%ªUrsÅ

5•›Ö”BJy-%3DE›BJ{Ç'*M&àg¬-êÂÓG%äÙÅ
5. ChatGPT O!PQ11750 RST2

ChatGPT ¥” AIGC )'c'›ç¬~¦% AI 9ò›!¦§«§+c'ëì+'¢=7G|(8Ù˜%³‹Å

1 2HIH|WChatGPT ¥”êkeÂy-ëì›@)*%êkeÂHI笛ChatGPT Ö'ª¦§}Cmn›
<w•ABõñ+O=U(RLHF)HË›±8>åR%•†þ^B

2 2c'H|WChatGPT ¥”:íà AI›ç¬”uV§ AI›z/0”cŸ%Kƒ›c!^,6J›¶3y-›

-.7oM6–l/0KmÛc'

3 2'¢=H|WChatGPT !'¢=H|1†ÙO”Ç– AI c'%2“›*H|'áT¨_+s›é*H|m

Û>"3Ó¶Y%<HTT%4$›c'Ÿ5¨_zÐÅ

ChatGPT ¦§á6!”eÂ:íÅ2017 Ô•›c'785Ð%3 BERT - GPT ¦§Çi!Št¦§“‰Á\Ù

%|}¦§ÅBERT ¦§!VˆÁ3*MoG%ÅÔ transformer % Encoder ¦§›GPT 3Ö 12 M Transformer $
% Decoder ¦Æ?9|•ìíÅç¬gx›BERT ¦§%fÎá6!”êkeÂ-[›GPT ¦§%fÎá6!
”êkeÂ:íÅBERT %|}¦§Ÿ RoBERTa+ALBERT 7›GPT %|}¦§Ÿ GPT2+GPT3+ChatGPT 7Å

•!ABõñ+O=U(RLHF)HË%w•›¦§DÊ!@A«:‰ßëo†~A«%õñ}CO==UÅA
«:‰œ{X(•¦§:í%VR}C9|+¬ð-p°›í}CmnÅChatGPT !åRÁlmqª
…;›!eÂ:íëì¨íá6Å

ª¦§%fγ²3¦§STo+mnT €ªÅŸ’¼<=›mn 1750 RSTeª¦§ GPT-3›ãdÁº

M CPU/GPU24 Uozp=xä•T ÅÌDRçË”V>–?”x@-Õ@›*u&-"dAS 450 ºBwÅ
%C%’×í¿Ã‹!›ûô%ª¦§âDÖª§<H&D¶•T’¼MˆEFÅChatGPT 3“” 8000 RM¢
à%ef½›åæ> 1750 RMSTÅŽ‰3 ChatGPT %mnT ›•‰3Í•ŠtmnT $b=U+GHÈ
g%KƒÅI€STu¦ü ChatGPT DÊJ”ó©ª%e¦à-è²›þ%©ªêkeÂy-Ì•jklÅ

KÒ AI ¦§uíL«›*3uV§ AI›b3:í§ AI›Ž‰ûd«„?2@A›þD*MuVVR@Í-›

•‰œ3:í'ábã%/0^¿ÅChatGPT ¥”•‰›FÍc?˜oM×789Å7L ChatGPT3.5 M¿NŸ
O 1700 RST›Í¬ 4.0 M¿%T ST{D_¥Pª 100 ½›Í¬Qg 3-5 Ô›ChatGPT {D_êee¶3@
^¿›Ûo€=žR“ºâãþ*t"#+S^¿ãé›Í"Dm`eÙg›å+XY@á•%:íÅ

6. UVWX ChatGPT %YZ-[1ChatGPT YZ\%];^_`a2

ChatGPT 3*MTà1function2›Üä•*MÜÝ›"äÙÜÝ•|ctäÙ%àU%Væ›lÓ*MVæ5
%%àU›õ©}CàU`aÅÉ*MXݘWqÓQbŸ~¦%ßëž_*™¯ä•Û function Q|›
function {|d`P*MàUÅŠM function „.©ª›{D_Ÿ 1700 RMÇÁ%ST›bÇÓuäÙ%ïIž
zçÉÅ

1b2c'

zÉ”uV§ AI /0”uVcŸKƒ›:íà AI1Generative AI2{dž~=UcŸT -/0:íoE¨à

%˜%Kƒ›!6–lBJ%ëì}Cc'›œŽ:íà AI %c'ûdå+:í^¿+Xƒ+XÝ+Xá•+
¶3+3D 7Å

ChatGPT 3Y§%:íà AIÅChatGPT †~=Uª€ef<†~:í¦§:í^¿îï›Ì“‰ GPT-3 3*M

ª§e¦§Åt¦§†~Xª€ef%Ímn›=U>eÂ%eË+e¡+e'7³²›<†~XeÂ%:
íÌ•}C"4›Ç.c½Ec'/0ÅœŽ›ö> ChatGPT •›Ÿª€ AIGC c'9ò“” GPT-3 ¦§Å
1d2/0

1. efghijkl%/0l

u GPT3 efgh

GPT-3 mnŠ'>oMef½›å+ WebText+BooksCorpus+Common Crawl+Wikipedia -Ìñ&V%T hÅ

WebText 3*M'”êkeÂ:í%T •›å+•Oj$þl%oE«§%^¿KƒÅBooksCorpus 3*MÖ
o¿¿Ýdìí%ª§T •ÅCommon Crawl 3*Mß^OKZ[œ›å+T\RMOPj|-^ZÅ
Wikipedia 3*MèS%\<—d›å+T\ºƒ^`›]iÛ>•˜W]íÛ<=,-%½MH|Å

ö>ŠtT •›OpenAI ÷Š'>*tžŸT •}Cmn›ŠtT •ûdgê”^¢•J_`-‹á›å

+!\ö+1Þa'+˜ba'7Åê'ЛGPT-3 %mnT •u¦ç˪› [HÂÛmnT
•¼Ó 45TB›å+oMzÉ%ëì-û÷›cd>ÐÑ%eÂ-’ï78Å

u GPT-3 %efgh%/0l3{DPQÍ!²tëì+û÷-e)Èjkl{DK!•JÅ)'gxW

① Ê¿uØW GPT-3 Š'%ªu¦ef½ûdgê”×^ªe+˜b7›Štef{D_PQ¦§!²t³

9ëì¶/0ÈY8ðr›}7f=+Ëv7¡¢ëìÅ

② •IëìWGPT-3 !²t³9ëìÈ{DK!’ï•I›}7!¬-M<=-N–¢7ë웊tëìã
d³g%¡¢’ï-ëìIeÅ

③ eÂ-^=rsWGPT-3 3!×^ef½Á}CÍmn%›šŽ{DK!XÌñeÂ-^=%-[Á%h
6›}7X”$^%©ªeËVˆ-á%-[7Å

④ ¦§iyWGPT-3 {D_ÞËy-*t³gaé›}7¦jL{%e)+kl%/07Å

u GPT4 Z!mnÙo

jk GPT-3 c?cd>ª€%oÊ=ef½›,pkK!!*tÙoö÷ÅX”²t³9%ë춉HÔ›
GPT-3 {DY8zÊpW›¬7f=+Ëv7¡¢ëì%’ïÅŽ•›GPT-3 !-[eÂ%e¡æ¡-z-H
|÷Ÿ*tzn`y›}7‡Ç}C)ŸÀÁè²%oyz--z=Å

šŽ›GPT-4 Ò_[* GPT-3 K!%efÙoö÷›†~Pªef½%78-u¦›Éoá=¦§mn%Hà›

ŠÌDóWxcXówoÊ=-©ª%êkeÂy-Ì•Å!ŠM~:$›÷{dž~T Ÿ:Â%Hàgþ
%¦§%…t-jkl›}7†~AB:ÂT •gmn¦§Å

GPT-4 Ò_ówÂqXef½%cd-štqr›þ^¦§%eÂ-[-CD:íD“Å

2. mnop%/0l

ChatGPT 3*E“”êkeÂy-%-˦§›Ìîïö÷%D“ûd./”Íb=UÛ%ef½-’ï½Å
c› ChatGPT {ÇîïnozÉû÷%ö÷›,3ÍÞËm`”l5˜%#s›šÓÍ]Ÿ%y8±tö%x
`›<FÌmnT †.3gê”u9op78K%T •Å

3. qrst%/0l

ChatGPT X”äÙ%st3Ÿ*9%/0l%ÅÖ” ChatGPT 3†~Í=È*Màeg:íîï%›ÌäÙ%

st†.vÛ–Žä•-¦§ªU7šw%0NÅjk ChatGPT {Ç:íVÜÝ%îï›,͆.z_9:„
.s%+©ª%îÓ~s%äÙ{DPQ¦§%¬-op~s¶zx9ÅŽ•›Ö” ChatGPT ãdc{
DxÍ=È*M5{D%àe›ŸoÍ{D_Ù8îïKƒ¶eËH|%zxyl¶zjklÅ

4. Luvw/xyz{'

ChatGPT4.0 %|}Lu

① eÂ…tª]þ%

② îïö÷jklþ%

③ o¦þä•

④ ¡¢lþ%›å+?€=+==+:ˆ=7ëì

⑤ œŽQëÛST%ª]þ%

)" LLM *+,-./01&

1*2ChatGPT D\45

1. ChatGPT c'

① Kƒ:í

② zd

③ u«+a‘uV

④ T Vl

⑤ ÍÎ

⑥ Ìñ

2. •‚ƒ„…†‡

ChatGPT %mn~:ª'Á{uÓ 3 yW

1.Ímn*Mûª%e¦§B

2.«•AB•uT ›mn*M{|¦§B

3.Š'O==UHË"4á=e¦§Å

Ímn*Mûª%e¦§• GPT/Bert V•›Ímne¦§“¿ ¡ŠÊ*ML9à7à›Ü†~ê$}H

àgÍmnª¦§Åk•¥!Ž“‰Á›!È~)'Ì•Á}C fine-tuning1"42ÅÌ$ GPT šÓ'%3¢
Ô Transformer [3‘›šŽFÔ”êkeÂ:í›Ð Bert '%3ÅÔ Transformer ¸3‘›šŽFÔ”êke
Â-[ÅšÓ Bert %ioVh- Google !¢ö%Oª•€“›•w¢•PÔ% AI c'&D•‚5%¨_ƒx
D“›ØMoÄ!ªoT%•¢‰žówëW Bert›P„3 OpenAI ×Ø% GPT2 ”3õ€™™›Š”Ó•g%
ƒ•…È>†‡Å

ŠEL9à%e¦§›Ì Capability1D“23¢*%›ÜÍΦ§âDÍΛˆ‰¦§âDˆ‰›zd¦§
âD\zd77›d!±qÌ•$Š'›ãd½ê!½ê%T Á\"4mn›Š†k{zCD›Ó>}*y
Ô«„A«CL%†'e¦§G³›GPT2 V•@•óo%Ì•}CÍmn›ŠQ%6˜`y!”͆~ê$
}%¦§g\$}=U%Ì•Å?~ŠÊmn%¦§›D!]ŸŠXÈ~Ì•}Cmn%‹íÈ›"!È~Ì
•ÁŸ{W%Y8Å”"3x Capability Ÿ>ðª%P7›,Žo% Alignment1X³2÷çXðä›±qc'
Á÷zDì—¦ö fine-tuning›-3Ó zero-shot leaning1§Ê¿=U2Œ9>“‰ÅÓ>[* Alignment ö÷›
GPT3 Š'>óª%¦§›óo%T ›<á=> in-context learning1ÁÈ^=U2%mnHà›Ü!mno¦
ô•`•A«eÂ% Prompt(þ®)›ÇhP¦§Ít\t45›Š}*yþ^>¦§ zero-shot learning %D“›
êÐÂ`›e¦§!Ž!•g•ª%HÔ×7Å

X 1 zÉSTu¦e¦§ zero-shot åRX¬

Z7Á| GPT3 Ž^$%X¬Xb®›zero-shot •t./”ªe¦§1LLM2›{Çx• GPT3 V•%e¦

§%×7›c?@•‚#h%‘†AÞè>›êkeÂy-%×7c?—|}•>ûªe¦§o¶›,Š<
z•€BJ¦-[-ghÌCÿÅ

ChatGPT ”Z3./”*Mªu¦%e¦§1LLM2g}C’“ë%›)'~:7X 2 b®W

 X 2 (•=Ímne¦§

†k›Ö”S@(•¦§"4%AB:íT €{•›X”ùMe¦§%mnT ÐÂ3”I*•›šŽ(

•=e¦§o›Š*y%"4X ChatGPT ù'ЪŸ3{Ÿ{Þ%Å

c›?~…ÎŬ% LLM % Capability - Alignment –cúÛ„.W%&™›,3ÑÑ—gÍmn¶w*t$

}^¿"4mÛ%e¦§·¼÷3ÞËcXA«b:—%Y±eÂ()%©ªl›ŠE¦§!±qc'$o

s_˜™ÇÈ•JW

• þDÞåîïW]Ÿ ¡'á%•kh®›ï„böÅ

• Kƒš¸ª–W›œZ ^_ŸæuØ•ˆÙz•-%KƒÅ

• •‚{[\lWAJ{‡-[¦§378mÙ³9*+%›‡Çk/îï%jklÅ

• KƒFNŸ-W¦§•T $”lFN›PQz&™¶zjk%Í=Å

• xõÞßD“äWs^¿:íðä›ÁÈ^ÞË\ÛxõÅ

mnA«FW¦§

Ó>}*y+Oe¦§%åR›AJ5XÒO==U@•Ûe¦§`$Å,Ö”M‘‡Çž€êkeÂä

Ù%À€WŸ›ŠM’¼HÔ*m×7 ¡›<Fz¯¡¢A¢ëWÅc› DeepMind )"þÙ> RLHF

1Reinforcement Learning with human feedback2%mnHË›,”*m]Ÿ!±q9ò$ëNíåÅOpenAI !

InstructGPT $'*MUu¦% GPT3 ¦§†~ RLHF "4•9:>¬,• GPT3 óW%åRN6> RLHF %O

ª›••% ChatGPT YZÒ RLHF ×£¤ªÅ

X 3 ,• RL ¥Á
îÿ*È,•%O==U¥Á›Agent d“”()#Ù%{|/§gz=á=ê%%+SÅØ5!BJ%ÚÛ

M‘A%/0È›†ke¦§JÓ*M Agent›Í“”'áä•ÁÈ^e)1Environment2gäÙ^¿

1action2ÅØ5Ö45g9¡ŠM{|TT-6Z7Ž^b›âŸA¦Dʧ<äÙ^¿%WŸ›Ø5"ü

Ag¨ËŠM{|TT›Š"3bg% human feedbackÅ,3ŠMó˜~:ãdz=}C›†kzDüA*m

!Ø•u›Øz©"ª*Mšt=U¦§›¦=UA«§<äÙÀ€%~:›”3«Ÿ>{|¦§1Reward

Model2›7X 4 b®Å

X 4 {|1FW2¦§mn¥Á

{|¦§±qÁ"3¦=UA«%FW›šŽ”¯¬JFW¦§Åñ%“¿œ:"3”m*M•u¦§›`«

*²º%^¿›<äÙ*M:€{|›ŠM{|ÇT_%¨à¶Y>A«Xä•äÙWŸ%FWÅèØ!”Š

M¦§cËäÙ*M:€{|›ŠÊH{@8Ÿ% RL -ËÞ-X`Å{|¦§“¿Á3“”Ìñ%e¦§

¶‰3†~ Transformer •TV•mnÅ

OpenAI Š''áÇ–†~ GPT API þÞ% prompt›k•Š'(•e¦§g:í*²º%˜^¿JÓþ®:

íX1prompt-generation pairs2Åk•¥ÖA«mn®gX(• LM :í%^¿}Cp°ÅjkBJ5(%ÿË

3üA«m`#ŠtäÙ}C•u›,Š!±•$3{‡\Û%›A%zÉ•u:jƒ„PQŠtuT¯±q

ŸbFr›Ðp°ÉÊ{Ç'g¬ðoM¦§äÙ%À€›<FDÊ6¯*MóW%Zœ=T •ÅŸ{oE

HË'”X^¿}Cp°›*E¬ðí®%Hà3ü'á¬ðe¦§“”É*M prompt äÙ%zÉ^¿›†

~LM¦§%ä٬𛥊'7 Elo rating system1Elo ²³2`«%Hàg:í¦§-äÙ`p%çXp

Ò›ŠÊ"DÒpÒ:j=ÓBJbã%:€{|/§Å

ˆŽ›RLHF ²³%LMŽÆ‹í"úí>›`Èg"3Š' RL g}*y"4e¦§>Å

O==U"4

c›¢öc?•°±¤O==Uz.'”e¦§›,p²ŸnoMˆ-<’A¢!)2O==U"4—L¶

Lue¦§ST%{Cl›OpenAI "3Ì$5)¶Yl%ÅChatGPT Š'%3 OpenAI êeþÙ%í‘%

SOTA O==U¦§ PPO g}Ce¦§"4›œŽ!e¦§Álmí®% RL -˔⟠PPO›Ø5`È

g"üBJgë*ÈŠM"4~:378¯»¼í*M RL ö÷%Å

†k›+S1Policy23*Me¦§›Í`v Prompt ?î^¿°º1¶‰â3^¿Á%ŸæuØ2Å+S%

ëJ‰p3e¦§àUYXc%bŸ token1†.! 50000 ³´€¬2›•=‰pœ3bŸ{Dä•% token

°º1”3ýþ‰p!àUYªU^ä• token ªU%€¬2›{|TTœÖÁ¼%FW¦§-+S¢µ¼¶ï

É*9Å”3ùM~:ªŸ3ŠÊ%W

➪ •mn•ÖÊ*M promptWB

➪ •,•%e¦§9:*M^¿°º›•ËŽ"4·¶%e¦§9:*M^¿°ºB

➪ ÚËŽ+S9:%^¿ä•ÛFW¦§›mÛ*M:€{|B

➪ Ò^¿}CX¬›*±Š' KL âtg¬-ÍJ`p%rs›ŠMJÓ*E¾=¼¶›g¸•¦§:íDÊ

¹ºFW¦§»šÂªe%^¿B

➪ V•"mÛ>'” RL ó˜%5·%{|TTW›z~ OpenAI !mn InstructGPT o›÷!ŠM“‰Ávw

>¼•%!A«:••Á%Ímn½tB
➪ `Èg"3¯‘† PPO *ʆ~5ª=ËŽ¾u%î£g}C!\ó˜Å

X 5 O==U"4¥Á

e¦§?~ PPO -Ë%z=êB·¶›•w{|TT%z=AB¿F›ŠMe¦§Ò7É AlphaGo ØÊz

=ìí}CêB}=›5·úÛÀAÁÂ%åRÅ

þ®B:

! NLP $% Prompt HË$›Prompt Engineering 3*[“‰BJÅPrompt Engineering h%378ŠXËŽÌ•

:í prompt ¦oÅ5“‰% prompt ˆ–HË3ABˆ–›ŠXœ:ö÷Ŭ•.%^¿¦oÅPrompt ¦o%ˆ
–HàXåR%•€„.ª›3 prompt HËí®@ðˆèqd%šwÅØ578ˆ¯XÈ~Ì•Ÿå% prompt
¦o-6Šƒ^`ÃòUê>• 2 Ô 10 ƒŽ^$ 3 E Prompt Engineering HË›ûdå+ABˆ– prompt+ê
ë:í prompt+ȉp prompt3 E«§›ëë«_Ž^$ž378ˆ– prompt ¦o<ÇŽþ^ prompt åR%Å
2" 3456789:& ChatGPT

1*2‹ŒW•Ž+••Œ•M‘A

1. ChatGPT {Ç'”V×CD‹ŒM‘A›{Ƕ;AB‹Œ}C“‰‹ŒÄ×-ö÷[ï›7‹áÄ×9ò
2¤+••Œ•7ö÷ÅChatGPT zÑDÊîï‹áö÷›÷DÊ-[‹á%ÃX-aW›•Ð#ÙówAl
=%î©ÅCD‹ŒM‘A{ÇÓ‹áþD 24 Uozp=%Œ•›ªªþ%>‹áÅÃt-^¢%Œ•åæÅ

2. ChatGPT {ÇuV‹á%XÝa‘›73ðÅÃ+3ðÆÇ7aW›•Ð±8X‹áa‘%ïÕ-uVÅ‹
áa‘uV{Çíî^¢óWx>[‹áãé-'(›io4ùŒ•+S|}Œ•À€›þ^‹áÅÃt-È
ÉtÅ

ChatGPT {Ç'”êkeÂ:í›{ÇZ ‹áö÷êë:íïI-[*HIÅêkeÂ:í{ǪªÊÙ‹

á7àop›þ%‹áŒ•åæ-ÅÃtÅÉo›êkeÂ:í÷{ÇÓ^¢þD:j=%‹áŒ•î©›0
$‹áŒ•%*Ql-jklÅ

ChatGPT {dž~uV‹áXÝKƒ-a‘›íî^¢¯°‹á˃›>[‹á%@W+ÌÍUf+ÎS&™
7/0Å‹á˃uV{Çíî^¢óWx>[‹áãé-þDMl=%Œ•›þ%‹áÈÉt-ÅÃtÅ

1b2"’W“” ChatGPT •–—˜%"’™š›œ•žŸT +¡¢£¤›mn¡¥"’¦§

Chatbot-GPT {ÇŠ'ABCDHIuV#¿Ï/%T ›þDÏ/ëþ+&DЕT +C¢uV+“¿|u

V7/0›4$•°’¼›Ñî"#*+ÅÍ{dž~êkeÂy-HI›-[-[\õÒ%T ›<:íŸ
èÏ/-ÓÔ%½EN[-Í=ÅŠtN[-Í={Çå+Ï/%×7+³9&D%¢Õ›÷{Çå+è”Ó
Ô2¤%¯ÖÅ

Ž•›Chatbot-GPT {Çíî:9£¤-’¼^Z›Ç«¯×-uV˜b-Ï//0ÅŠt£¤-^Z{dž~
êë=-CD=%Hà}CpM-¸Á›•Ðw¨uV-*+%_t›þ%:9åæÅ

ØÁb¼›Chatbot-GPT {Çíî"#‰ó¨+ój+ó—|xuVÓÔÏ/›°•ABCDí¿›þ%*+å
æ›<—|ãä"#¨ÙÅ

1d2¨©W“” ChatGPT Oª%«¬-u«®D›¯°±o%¨©²³

Chat GPT k±)Ÿ*9%«¬-u«D“›{Ç'”ˆ¯±o%¨©²³Å}7›7R*MºœMˆZ!1=

s.Þ„›Chat GPT {Ç'”uV˜WÞ„T <¬ð*978K%Þ„CÓ›þDu«¯ÖÇ«¨_õcö
÷›<#Ù«¬aé%[*HIÅ

,ãdÂÃ%3›Chat GPT %«¬-u«D“Ÿ*9%/0l›ãdŠXzÉ/0}C.Ë%mn-Új›Ç

þ%²³%jkl-{GlÅé•›¨©²³÷ãdµÛoET gh+T ÜÝ+¯¦-±o*+7oM(
Þ›zcÑ./” Chat GPT ¢*HI›ãdØ•½EHI-HËgˆ¯ìù%¨©²³Å

1´2"µWCD"µo¶·”g¸›œ•T¹º»’¼£¤-¡¢T ½›ˆ¯YZ%CD"µ

Chat GPT !"#µöëìŸ{ª%c'2“ÅÍ{dž~uV‹á"#@W+Еœ:-Ï/ß67T ›Ó

‹áþDCD"#¯Ö-›-HIÅ

BJ{dž~ Chat GPT @‹á}C±oÞß›Ç>[‹á%"#FW-¨Ùøv“›k•Ï'M‘=U-êk

eÂy-HIg:í9N=%"#¯ÖÅÍ{Çíî‹áN9•.%"#ì•+›-"#¨ÙÇi”lî£Å
Ëk›ˆ¯CD"#µöãd.G©ª%-Ë-T ¦§›ÐFãdXT À€-Èžà—7H|}C0áÅ
Ž•›µö¯Ö%åR”ãd?~±•%1(-z=%á=Å