Skip to content
Draft
Show file tree
Hide file tree
Changes from 4 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 4 additions & 5 deletions chapters/ko/_toctree.yml
Original file line number Diff line number Diff line change
Expand Up @@ -51,13 +51,12 @@
sections:
- local: chapter3/2
title: ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ
- local: chapter3/5
title: ํ•™์Šต ๊ณก์„  ์ดํ•ดํ•˜๊ธฐ

- title: 3. ๐Ÿค— ์‚ฌ์ „ํ›ˆ๋ จ๋œ ๋ชจ๋ธ ๋ฏธ์„ธ์กฐ์ •
sections:
- local: chapter3/3
title: Trainer API๋ฅผ ์‚ฌ์šฉํ•œ ๋ชจ๋ธ ๋ฏธ์„ธ์กฐ์ •
- local: chapter3/5
title: ํ•™์Šต ๊ณก์„  ์ดํ•ดํ•˜๊ธฐ
- local: chapter3/6
title: ํŒŒ์ธํŠœ๋‹

- title: 5. ๐Ÿค— Datasets ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ
sections:
Expand Down
46 changes: 46 additions & 0 deletions chapters/ko/chapter3/6.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
<FrameworkSwitchCourse {fw} />

# ํŒŒ์ธํŠœ๋‹ ์™„๋ฃŒ![[fine-tuning-check]]

<CourseFloatingBanner
chapter={3}
classNames="absolute z-10 right-0 top-0"
/>

์ •๋ง ๊ด‘๋ฒ”์œ„ํ•œ ๋‚ด์šฉ์„ ๋‹ค๋ค˜์Šต๋‹ˆ๋‹ค! ์ฒ˜์Œ ๋‘ ์ฑ•ํ„ฐ์—์„œ ๋ชจ๋ธ๊ณผ ํ† ํฌ๋‚˜์ด์ €์— ๋Œ€ํ•ด ๋ฐฐ์› ๊ณ , ์ด์ œ ์ตœ์‹  ๋ชจ๋ฒ” ์‚ฌ๋ก€๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ๋ถ„์˜ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ ํŒŒ์ธํŠœ๋‹ํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์•Œ๊ฒŒ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์š”์•ฝํ•˜์ž๋ฉด, ์ด ์ฑ•ํ„ฐ์—์„œ๋Š” ๋‹ค์Œ์„ ๋ฐฐ์› ์Šต๋‹ˆ๋‹ค.

* [Hub](https://huggingface.co/datasets)์˜ ๋ฐ์ดํ„ฐ ์„ธํŠธ์™€ ์ตœ์‹  ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ ๊ธฐ๋ฒ•์— ๋Œ€ํ•ด ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค.
* ๋™์  ํŒจ๋”ฉ๊ณผ ๋ฐ์ดํ„ฐ ์ฝœ๋ ˆ์ดํ„ฐ ์‚ฌ์šฉ์„ ํฌํ•จํ•˜์—ฌ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋ฅผ ํšจ์œจ์ ์œผ๋กœ ๋กœ๋“œํ•˜๊ณ  ์ „์ฒ˜๋ฆฌํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ๋ฐฐ์› ์Šต๋‹ˆ๋‹ค.
* ์ตœ์‹  ๊ธฐ๋Šฅ์„ ํฌํ•จํ•œ ๊ณ ์ˆ˜์ค€ `Trainer` API๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํŒŒ์ธํŠœ๋‹๊ณผ ํ‰๊ฐ€๋ฅผ ๊ตฌํ˜„ํ–ˆ์Šต๋‹ˆ๋‹ค.
* PyTorch๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์™„์ „ํ•œ ์ปค์Šคํ…€ ํ›ˆ๋ จ ๋ฃจํ”„๋ฅผ ์ฒ˜์Œ๋ถ€ํ„ฐ ๊ตฌํ˜„ํ–ˆ์Šต๋‹ˆ๋‹ค.
* ๐Ÿค— Accelerate๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ›ˆ๋ จ ์ฝ”๋“œ๊ฐ€ ๋‹ค์ค‘ GPU ๋˜๋Š” TPU์—์„œ ์›ํ™œํ•˜๊ฒŒ ์ž‘๋™ํ•˜๋„๋ก ํ–ˆ์Šต๋‹ˆ๋‹ค.
* ํ˜ผํ•ฉ ์ •๋ฐ€๋„ ํ›ˆ๋ จ๊ณผ ๊ทธ๋ž˜๋””์–ธํŠธ ๋ˆ„์ ๊ณผ ๊ฐ™์€ ์ตœ์‹  ์ตœ์ ํ™” ๊ธฐ๋ฒ•์„ ์ ์šฉํ–ˆ์Šต๋‹ˆ๋‹ค.

<Tip>

๐ŸŽ‰ **์ถ•ํ•˜ํ•ฉ๋‹ˆ๋‹ค!** ํŠธ๋žœ์Šคํฌ๋จธ ๋ชจ๋ธ ํŒŒ์ธํŠœ๋‹์˜ ๊ธฐ์ดˆ๋ฅผ ๋งˆ์Šคํ„ฐํ–ˆ์Šต๋‹ˆ๋‹ค. ์ด์ œ ์‹ค์ œ ML ํ”„๋กœ์ ํŠธ์— ๋„์ „ํ•  ์ค€๋น„๊ฐ€ ๋˜์—ˆ์Šต๋‹ˆ๋‹ค!

๐Ÿ“– **๊ณ„์† ํ•™์Šตํ•˜๊ธฐ**: ์ง€์‹์„ ๋” ๊นŠ์ด ์Œ“๊ธฐ ์œ„ํ•ด ๋‹ค์Œ ๋ฆฌ์†Œ์Šค๋ฅผ ํƒ์ƒ‰ํ•ด๋ณด์„ธ์š”.
- ํŠน์ • NLP ์ž‘์—…์„ ์œ„ํ•œ [๐Ÿค— Transformers ์ž‘์—… ๊ฐ€์ด๋“œ](https://huggingface.co/docs/transformers/main/en/tasks/sequence_classification)
- ํฌ๊ด„์ ์ธ ๋…ธํŠธ๋ถ์„ ์œ„ํ•œ [๐Ÿค— Transformers ์˜ˆ์ œ](https://huggingface.co/docs/transformers/main/en/notebooks)

๐Ÿš€ **๋‹ค์Œ ๋‹จ๊ณ„**
- ๋ฐฐ์šด ๊ธฐ๋ฒ•์„ ์‚ฌ์šฉํ•˜์—ฌ ์ž์‹ ๋งŒ์˜ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋กœ ํŒŒ์ธํŠœ๋‹์„ ์‹œ๋„ํ•ด๋ณด์„ธ์š”.
- [Hugging Face Hub](https://huggingface.co/models)์—์„œ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ๋‹ค์–‘ํ•œ ๋ชจ๋ธ ์•„ํ‚คํ…์ฒ˜๋ฅผ ์‹คํ—˜ํ•ด๋ณด์„ธ์š”.
- [Hugging Face ์ปค๋ฎค๋‹ˆํ‹ฐ](https://discuss.huggingface.co/)์— ์ฐธ์—ฌํ•˜์—ฌ ํ”„๋กœ์ ํŠธ๋ฅผ ๊ณต์œ ํ•˜๊ณ  ๋„์›€์„ ๋ฐ›์œผ์„ธ์š”.

</Tip>

์ด๊ฒƒ์€ ๐Ÿค— Transformers์™€์˜ ์—ฌ์ •์˜ ์‹œ์ž‘์ผ ๋ฟ์ž…๋‹ˆ๋‹ค. ๋‹ค์Œ ์ฑ•ํ„ฐ์—์„œ๋Š” ๋ชจ๋ธ๊ณผ ํ† ํฌ๋‚˜์ด์ €๋ฅผ ์ปค๋ฎค๋‹ˆํ‹ฐ์™€ ๊ณต์œ ํ•˜๊ณ  ๊ณ„์† ์„ฑ์žฅํ•˜๋Š” ์‚ฌ์ „ํ›ˆ๋ จ๋œ ๋ชจ๋ธ ์ƒํƒœ๊ณ„์— ๊ธฐ์—ฌํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ํƒ์ƒ‰ํ•  ๊ฒƒ์ž…๋‹ˆ๋‹ค.

์—ฌ๊ธฐ์„œ ๊ฐœ๋ฐœํ•œ ๊ธฐ์ˆ ๋“ค(๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ, ํ›ˆ๋ จ ๊ตฌ์„ฑ, ํ‰๊ฐ€, ์ตœ์ ํ™”)์€ ๋ชจ๋“  ๊ธฐ๊ณ„ํ•™์Šต ํ”„๋กœ์ ํŠธ์˜ ๊ธฐ์ดˆ์ž…๋‹ˆ๋‹ค. ํ…์ŠคํŠธ ๋ถ„๋ฅ˜, ๊ฐœ์ฒด ์ธ์‹, ์งˆ์˜ ์‘๋‹ต ๋˜๋Š” ๊ธฐํƒ€ NLP ์ž‘์—…์„ ํ•˜๋“  ์ƒ๊ด€์—†์ด, ์ด๋Ÿฌํ•œ ๊ธฐ๋ฒ•๋“ค์ด ํฐ ๋„์›€์ด ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค.

<Tip>

๐Ÿ’ก **์„ฑ๊ณต์„ ์œ„ํ•œ ์ „๋ฌธ๊ฐ€ ํŒ**
- ์ปค์Šคํ…€ ํ›ˆ๋ จ ๋ฃจํ”„๋ฅผ ๊ตฌํ˜„ํ•˜๊ธฐ ์ „์— ํ•ญ์ƒ `Trainer` API๋ฅผ ์‚ฌ์šฉํ•œ ๊ฐ•๋ ฅํ•œ ๊ธฐ์ค€์„ ๋ถ€ํ„ฐ ์‹œ์ž‘ํ•˜์„ธ์š”.
- ๐Ÿค— Hub์„ ์‚ฌ์šฉํ•˜์—ฌ ๋” ๋‚˜์€ ์ถœ๋ฐœ์ ์„ ์œ„ํ•ด ์ž์‹ ์˜ ์ž‘์—…๊ณผ ์œ ์‚ฌํ•œ ์‚ฌ์ „ํ›ˆ๋ จ๋œ ๋ชจ๋ธ์„ ์ฐพ์œผ์„ธ์š”.
- ์ ์ ˆํ•œ ํ‰๊ฐ€ ์ง€ํ‘œ๋กœ ํ›ˆ๋ จ์„ ๋ชจ๋‹ˆํ„ฐ๋งํ•˜๊ณ  ์ฒดํฌํฌ์ธํŠธ ์ €์žฅ์„ ์žŠ์ง€ ๋งˆ์„ธ์š”.
- ์ปค๋ฎค๋‹ˆํ‹ฐ๋ฅผ ํ™œ์šฉํ•˜์„ธ์š” - ๋ชจ๋ธ๊ณผ ๋ฐ์ดํ„ฐ ์„ธํŠธ๋ฅผ ๊ณต์œ ํ•˜์—ฌ ๋‹ค๋ฅธ ์‚ฌ๋žŒ๋“ค์„ ๋„์šฐ๊ณ  ์ž์‹ ์˜ ์ž‘์—…์— ๋Œ€ํ•œ ํ”ผ๋“œ๋ฐฑ์„ ๋ฐ›์œผ์„ธ์š”.

</Tip>