์ฝ˜ํ…์ธ  ๋Œ€ํ‘œ ์ด๋ฏธ์ง€ - ๐Ÿค– Python + LlamaIndex๋กœ ๋ฌธ์„œ ๊ธฐ๋ฐ˜ Q&A ๊ฐœ๋ฐœํ•˜๊ธฐ

๐Ÿค– Python + LlamaIndex๋กœ ๋ฌธ์„œ ๊ธฐ๋ฐ˜ Q&A ๊ฐœ๋ฐœํ•˜๊ธฐ

AI๊ฐ€ ๋‚ด ๋ฌธ์„œ๋ฅผ ์ฝ๊ณ  ์ฒ™์ฒ™ ๋‹ต๋ณ€ํ•ด์ฃผ๋Š” ์‹œ์Šคํ…œ ๋งŒ๋“ค๊ธฐ ใ…‹ใ…‹ใ…‹

์š”์ฆ˜ ChatGPT ์“ฐ๋‹ค๋ณด๋ฉด ์ง„์งœ ์‹ ๊ธฐํ•˜์ž–์•„์š”? ์งˆ๋ฌธํ•˜๋ฉด ๋ฐ”๋กœ๋ฐ”๋กœ ๋‹ต๋ณ€ํ•ด์ฃผ๊ณ  ใ…‹ใ…‹ใ…‹ ๊ทผ๋ฐ ์ƒ๊ฐํ•ด๋ณด๋ฉด ์šฐ๋ฆฌ ํšŒ์‚ฌ ๋ฌธ์„œ๋‚˜ ๊ฐœ์ธ ์ž๋ฃŒ๋“ค์€ ChatGPT๊ฐ€ ๋ชจ๋ฅด์ž–์•„์š”? ๐Ÿค”

"์•„ ์šฐ๋ฆฌ ํšŒ์‚ฌ ๋งค๋‰ด์–ผ 1000ํŽ˜์ด์ง€ ๋˜๋Š”๋ฐ ์ด๊ฑฐ AIํ•œํ…Œ ํ•™์Šต์‹œ์ผœ์„œ ์ง์›๋“ค์ด ๋ฌผ์–ด๋ณด๋ฉด ๋ฐ”๋กœ ๋‹ต๋ณ€ํ•ด์ฃผ๊ฒŒ ํ•  ์ˆ˜ ์—†๋‚˜?"

์ด๋Ÿฐ ์ƒ๊ฐ ํ•œ๋ฒˆ์ฏค ํ•ด๋ณด์…จ์ฃ ? ์˜ค๋Š˜์€ ๋ฐ”๋กœ ๊ทธ๊ฑธ ๋งŒ๋“œ๋Š” ๋ฐฉ๋ฒ•์„ ์•Œ๋ ค๋“œ๋ฆด๊ฒŒ์š”! Python์ด๋ž‘ LlamaIndex๋ผ๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์“ฐ๋ฉด ์ƒ๊ฐ๋ณด๋‹ค ๊ฐ„๋‹จํ•˜๊ฒŒ ๊ตฌํ˜„ ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค ๐Ÿ’ช

๐Ÿ“„ ๋ฌธ์„œ๋“ค PDF, TXT, DOCX ๋งค๋‰ด์–ผ, ๋ณด๊ณ ์„œ ์‚ฌ๋‚ด ๋ฌธ์„œ ๋“ฑ ๐Ÿ”ฎ LlamaIndex ๋ฌธ์„œ ๋ถ„์„ ๋ฐ ์ธ๋ฑ์‹ฑ ๋ฒกํ„ฐ ์ž„๋ฒ ๋”ฉ ์ƒ์„ฑ ๊ฒ€์ƒ‰ ์—”์ง„ ๊ตฌ์ถ• ๐Ÿ’ฌ Q&A ์‹œ์Šคํ…œ ์งˆ๋ฌธ ์ž…๋ ฅ โ†“ ์ •ํ™•ํ•œ ๋‹ต๋ณ€ ์ถœ๋ ฅ ์‚ฌ์šฉ์ž ์งˆ๋ฌธํ•˜๊ธฐ โœจ
๐ŸŽฏ LlamaIndex๊ฐ€ ๋ญ”๋ฐ์š”?

LlamaIndex๋Š” LLM(Large Language Model) ๊ธฐ๋ฐ˜ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ๋งŒ๋“ค ๋•Œ ๋ฌธ์„œ ๋ฐ์ดํ„ฐ๋ฅผ ์‰ฝ๊ฒŒ ์—ฐ๊ฒฐํ•ด์ฃผ๋Š” ํ”„๋ ˆ์ž„์›Œํฌ์˜ˆ์š”. ์‰ฝ๊ฒŒ ๋งํ•˜๋ฉด GPT ๊ฐ™์€ AI ๋ชจ๋ธ์ด ์šฐ๋ฆฌ ๋ฌธ์„œ๋ฅผ ์ฝ๊ณ  ์ดํ•ดํ•  ์ˆ˜ ์žˆ๊ฒŒ ๋„์™€์ฃผ๋Š” ๋„๊ตฌ๋ผ๊ณ  ๋ณด์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค ใ…Žใ…Ž

์˜ˆ์ „์—๋Š” ์ด๋Ÿฐ ์‹œ์Šคํ…œ ๋งŒ๋“ค๋ ค๋ฉด ์ง„์งœ ๋ณต์žกํ–ˆ๊ฑฐ๋“ ์š”? ๋ฌธ์„œ ํŒŒ์‹ฑํ•˜๊ณ , ๋ฒกํ„ฐ ์ž„๋ฒ ๋”ฉ ๋งŒ๋“ค๊ณ , ๊ฒ€์ƒ‰ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ตฌํ˜„ํ•˜๊ณ ... ๋จธ๋ฆฌ ์•„ํ”„์ฃ  ๐Ÿ˜ต

๊ทผ๋ฐ LlamaIndex ์“ฐ๋ฉด ์ด ๋ชจ๋“  ๊ณผ์ •์ด ๋ช‡ ์ค„์˜ ์ฝ”๋“œ๋กœ ํ•ด๊ฒฐ๋ฉ๋‹ˆ๋‹ค! ์ง„์งœ๋ฃจ์š” ใ…‹ใ…‹ใ…‹

๐Ÿ”ฅ LlamaIndex์˜ ํ•ต์‹ฌ ๊ธฐ๋Šฅ๋“ค ๐Ÿ“š ๋‹ค์–‘ํ•œ ๋ฌธ์„œ ํฌ๋งท ์ง€์› ๐Ÿ” ์Šค๋งˆํŠธ ๊ฒ€์ƒ‰ ์—”์ง„ ๐Ÿง  ์ปจํ…์ŠคํŠธ ๊ด€๋ฆฌ โšก ๋น ๋ฅธ ์‘๋‹ต ์†๋„ ๐Ÿ”— LLM ํ†ตํ•ฉ
๐Ÿ› ๏ธ ๊ฐœ๋ฐœ ํ™˜๊ฒฝ ์„ธํŒ…ํ•˜๊ธฐ

์ž ์ด์ œ ๋ณธ๊ฒฉ์ ์œผ๋กœ ์‹œ์ž‘ํ•ด๋ณผ๊นŒ์š”? ๋จผ์ € ํ•„์š”ํ•œ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋“ค์„ ์„ค์น˜ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. Python 3.8 ์ด์ƒ ๋ฒ„์ „์ด๋ฉด ๋ฉ๋‹ˆ๋‹ค!

1๏ธโƒฃ ๊ธฐ๋ณธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์„ค์น˜

ํ„ฐ๋ฏธ๋„์ด๋‚˜ ๋ช…๋ น ํ”„๋กฌํ”„ํŠธ์—์„œ ๋‹ค์Œ ๋ช…๋ น์–ด๋ฅผ ์‹คํ–‰ํ•˜์„ธ์š”:

pip install llama-index
pip install openai
pip install pypdf
pip install python-docx

์ด๋ ‡๊ฒŒ ํ•˜๋ฉด LlamaIndex ๋ณธ์ฒด์™€ ๋ฌธ์„œ ์ฒ˜๋ฆฌ์— ํ•„์š”ํ•œ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋“ค์ด ํ•œ๋ฐฉ์— ์„ค์น˜๋ฉ๋‹ˆ๋‹ค ๐Ÿ‘

2๏ธโƒฃ OpenAI API ํ‚ค ์ค€๋น„

LlamaIndex๋Š” ๊ธฐ๋ณธ์ ์œผ๋กœ OpenAI์˜ GPT ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•ด์š”. ๊ทธ๋ž˜์„œ OpenAI API ํ‚ค๊ฐ€ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.

OpenAI ์›น์‚ฌ์ดํŠธ(platform.openai.com)์—์„œ ๊ณ„์ • ๋งŒ๋“ค๊ณ  API ํ‚ค ๋ฐœ๊ธ‰๋ฐ›์œผ์‹œ๋ฉด ๋ผ์š”. ์œ ๋ฃŒ๊ธด ํ•œ๋ฐ ํ…Œ์ŠคํŠธ์šฉ์œผ๋กœ๋Š” ๋ช‡ ๋‹ฌ๋Ÿฌ๋ฉด ์ถฉ๋ถ„ํ•ฉ๋‹ˆ๋‹ค ใ…‹ใ…‹

๐Ÿ’ก ๊ฟ€ํŒ! API ํ‚ค๋Š” ์ ˆ๋Œ€ ์ฝ”๋“œ์— ์ง์ ‘ ๋„ฃ์ง€ ๋งˆ์„ธ์š”! ํ™˜๊ฒฝ ๋ณ€์ˆ˜๋กœ ๊ด€๋ฆฌํ•˜๋Š” ๊ฒŒ ์•ˆ์ „ํ•ฉ๋‹ˆ๋‹ค. .env ํŒŒ์ผ ๋งŒ๋“ค์–ด์„œ ๊ด€๋ฆฌํ•˜๊ฑฐ๋‚˜, ์‹œ์Šคํ…œ ํ™˜๊ฒฝ ๋ณ€์ˆ˜๋กœ ์„ค์ •ํ•˜์„ธ์š”~
๐Ÿ“ ์ฒซ ๋ฒˆ์งธ ๋ฌธ์„œ Q&A ์‹œ์Šคํ…œ ๋งŒ๋“ค๊ธฐ

์ด์ œ ์ง„์งœ ์ฝ”๋“œ๋ฅผ ์ž‘์„ฑํ•ด๋ณผ ์‹œ๊ฐ„์ด์—์š”! ๊ฐ€์žฅ ๊ธฐ๋ณธ์ ์ธ ํ˜•ํƒœ๋ถ€ํ„ฐ ์‹œ์ž‘ํ•ด๋ด…์‹œ๋‹ค ๐Ÿš€

3๏ธโƒฃ ๊ธฐ๋ณธ ์ฝ”๋“œ ์ž‘์„ฑ

import os
from llama_index import VectorStoreIndex, SimpleDirectoryReader, ServiceContext
from llama_index.llms import OpenAI

# OpenAI API ํ‚ค ์„ค์ •
os.environ["OPENAI_API_KEY"] = "your-api-key-here"

# ๋ฌธ์„œ ๋กœ๋“œ (documents ํด๋”์— ์žˆ๋Š” ๋ชจ๋“  ํŒŒ์ผ)
documents = SimpleDirectoryReader("documents").load_data()

# LLM ์„ค์ • (GPT-3.5-turbo ์‚ฌ์šฉ)
llm = OpenAI(model="gpt-3.5-turbo", temperature=0.1)
service_context = ServiceContext.from_defaults(llm=llm)

# ์ธ๋ฑ์Šค ์ƒ์„ฑ
index = VectorStoreIndex.from_documents(
    documents, 
    service_context=service_context
)

# ์ฟผ๋ฆฌ ์—”์ง„ ์ƒ์„ฑ
query_engine = index.as_query_engine()

# ์งˆ๋ฌธํ•˜๊ธฐ!
response = query_engine.query("์ด ๋ฌธ์„œ์˜ ์ฃผ์š” ๋‚ด์šฉ์€ ๋ญ์•ผ?")
print(response)

์™€ ์ด๊ฒŒ ๋์ด์—์š” ใ…‹ใ…‹ใ…‹ ์ง„์งœ ๊ฐ„๋‹จํ•˜์ฃ ? ์ด ์ฝ”๋“œ๋งŒ์œผ๋กœ๋„ ๋ฌธ์„œ๋ฅผ ์ฝ๊ณ  ์งˆ๋ฌธ์— ๋‹ต๋ณ€ํ•˜๋Š” AI ์‹œ์Šคํ…œ์ด ์™„์„ฑ๋ฉ๋‹ˆ๋‹ค!

๐Ÿ” ์ฝ”๋“œ ์„ค๋ช… 1. SimpleDirectoryReader: ์ง€์ •ํ•œ ํด๋”์˜ ๋ชจ๋“  ๋ฌธ์„œ๋ฅผ ์ž๋™์œผ๋กœ ์ฝ์–ด์˜ต๋‹ˆ๋‹ค. PDF, TXT, DOCX ๋“ฑ ๋‹ค์–‘ํ•œ ํฌ๋งท ์ง€์›!

2. VectorStoreIndex: ๋ฌธ์„œ๋ฅผ ๋ฒกํ„ฐ๋กœ ๋ณ€ํ™˜ํ•ด์„œ ๊ฒ€์ƒ‰ ๊ฐ€๋Šฅํ•œ ์ธ๋ฑ์Šค๋ฅผ ๋งŒ๋“ค์–ด์š”. ์ด๊ฒŒ ํ•ต์‹ฌ์ด์—์š” ๐ŸŽฏ

3. query_engine: ์‹ค์ œ๋กœ ์งˆ๋ฌธ์„ ๋ฐ›์•„์„œ ๋‹ต๋ณ€์„ ์ƒ์„ฑํ•˜๋Š” ์—”์ง„์ž…๋‹ˆ๋‹ค. ๊ด€๋ จ ๋ฌธ์„œ ๋ถ€๋ถ„์„ ์ฐพ์•„์„œ GPT์—๊ฒŒ ์ „๋‹ฌํ•ด์ค˜์š”.
LlamaIndex ์ž‘๋™ ์›๋ฆฌ ๐Ÿ“„ ์›๋ณธ ๋ฌธ์„œ ํ…์ŠคํŠธ ์ถ”์ถœ ์ฒญํฌ ๋ถ„ํ•  ๐Ÿ”ข ์ž„๋ฒ ๋”ฉ ๋ฒกํ„ฐ ๋ณ€ํ™˜ [0.1, 0.5, ...] ๐Ÿ’พ ์ธ๋ฑ์Šค ๋ฒกํ„ฐ ์ €์žฅ ๊ฒ€์ƒ‰ ์ค€๋น„ ์™„๋ฃŒ โ“ ์‚ฌ์šฉ์ž ์งˆ๋ฌธ ์ž์—ฐ์–ด ์ž…๋ ฅ ์˜ˆ: ๊ฐ€๊ฒฉ์ด ์–ผ๋งˆ์•ผ? ๐Ÿ” ์œ ์‚ฌ๋„ ๊ฒ€์ƒ‰ ๊ด€๋ จ ๋ฌธ์„œ ์ฐพ๊ธฐ Top-K ์ถ”์ถœ ๐Ÿ’ฌ GPT ๋‹ต๋ณ€ ์ปจํ…์ŠคํŠธ ๊ธฐ๋ฐ˜ ์ •ํ™•ํ•œ ์‘๋‹ต ์ƒ์„ฑ ์ฐธ์กฐ
โš™๏ธ ๊ณ ๊ธ‰ ์„ค์ •๊ณผ ์ตœ์ ํ™”

๊ธฐ๋ณธ ์ฝ”๋“œ๋Š” ๋ดค์œผ๋‹ˆ ์ด์ œ ์ข€ ๋” ์‹ค์ „์—์„œ ์“ธ ์ˆ˜ ์žˆ๊ฒŒ ์—…๊ทธ๋ ˆ์ด๋“œํ•ด๋ด…์‹œ๋‹ค! ์„ฑ๋Šฅ๋„ ์˜ฌ๋ฆฌ๊ณ  ๊ธฐ๋Šฅ๋„ ์ถ”๊ฐ€ํ•˜๊ณ  ใ…Žใ…Ž

4๏ธโƒฃ ์ฒญํฌ ํฌ๊ธฐ ์กฐ์ •ํ•˜๊ธฐ

๋ฌธ์„œ๋ฅผ ๋„ˆ๋ฌด ์ž‘๊ฒŒ ์ชผ๊ฐœ๋ฉด ๋งฅ๋ฝ์ด ๋Š๊ธฐ๊ณ , ๋„ˆ๋ฌด ํฌ๊ฒŒ ํ•˜๋ฉด ๊ฒ€์ƒ‰ ์ •ํ™•๋„๊ฐ€ ๋–จ์–ด์ ธ์š”. ์ ์ ˆํ•œ ๋ฐธ๋Ÿฐ์Šค๊ฐ€ ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค!

from llama_index.node_parser import SimpleNodeParser

# ๋…ธ๋“œ ํŒŒ์„œ ์„ค์ •
node_parser = SimpleNodeParser.from_defaults(
    chunk_size=1024,  # ์ฒญํฌ ํฌ๊ธฐ (ํ† ํฐ ๋‹จ์œ„)
    chunk_overlap=20  # ์ฒญํฌ ๊ฐ„ ๊ฒน์นจ (๋งฅ๋ฝ ์œ ์ง€)
)

service_context = ServiceContext.from_defaults(
    llm=llm,
    node_parser=node_parser
)

chunk_size๋Š” ๋ณดํ†ต 512~2048 ์‚ฌ์ด๊ฐ€ ์ ๋‹นํ•ด์š”. ๋ฌธ์„œ ํŠน์„ฑ์— ๋”ฐ๋ผ ์กฐ์ •ํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค ๐Ÿ‘Œ

5๏ธโƒฃ ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ ์ปค์Šคํ„ฐ๋งˆ์ด์ง•

๊ธฐ๋ณธ OpenAI ์ž„๋ฒ ๋”ฉ ๋ง๊ณ  ๋‹ค๋ฅธ ๋ชจ๋ธ๋„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์–ด์š”. ๋น„์šฉ ์ ˆ๊ฐ์ด๋‚˜ ์„ฑ๋Šฅ ํ–ฅ์ƒ์„ ์œ„ํ•ด!

from llama_index.embeddings import HuggingFaceEmbedding

# ํ•œ๊ตญ์–ด์— ๊ฐ•ํ•œ ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ ์‚ฌ์šฉ
embed_model = HuggingFaceEmbedding(
    model_name="jhgan/ko-sroberta-multitask"
)

service_context = ServiceContext.from_defaults(
    llm=llm,
    embed_model=embed_model
)

ํ•œ๊ตญ์–ด ๋ฌธ์„œ ๋‹ค๋ฃฐ ๋•Œ๋Š” ํ•œ๊ตญ์–ด ํŠนํ™” ๋ชจ๋ธ ์“ฐ๋Š” ๊ฒŒ ํ›จ์”ฌ ์ข‹์•„์š”! ์ •ํ™•๋„๊ฐ€ ํ™• ์˜ฌ๋ผ๊ฐ‘๋‹ˆ๋‹ค ๐Ÿš€

โš ๏ธ ์ฃผ์˜์‚ฌํ•ญ HuggingFace ๋ชจ๋ธ ์ฒ˜์Œ ์‚ฌ์šฉํ•  ๋•Œ๋Š” ๋‹ค์šด๋กœ๋“œ ์‹œ๊ฐ„์ด ์ข€ ๊ฑธ๋ ค์š”. ๋ชจ๋ธ ํฌ๊ธฐ๊ฐ€ ๋ช‡๋ฐฑ MB ๋˜๊ฑฐ๋“ ์š” ใ…‹ใ…‹ ์ธํ„ฐ๋„ท ์—ฐ๊ฒฐ ํ™•์ธํ•˜์‹œ๊ณ  ์—ฌ์œ ๋กญ๊ฒŒ ๊ธฐ๋‹ค๋ฆฌ์„ธ์š”~
6๏ธโƒฃ ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ ํ™œ์šฉํ•˜๊ธฐ

๋ฌธ์„œ์— ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ๋ฅผ ์ถ”๊ฐ€ํ•˜๋ฉด ๊ฒ€์ƒ‰ ์ •ํ™•๋„๊ฐ€ ๋” ์˜ฌ๋ผ๊ฐ€์š”. ๋‚ ์งœ, ์นดํ…Œ๊ณ ๋ฆฌ, ์ž‘์„ฑ์ž ๊ฐ™์€ ์ •๋ณด๋“ค์ด์š”!

from llama_index import Document

# ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ์™€ ํ•จ๊ป˜ ๋ฌธ์„œ ์ƒ์„ฑ
documents = [
    Document(
        text="์ œํ’ˆ A์˜ ๊ฐ€๊ฒฉ์€ 50,000์›์ž…๋‹ˆ๋‹ค.",
        metadata={
            "category": "๊ฐ€๊ฒฉ์ •๋ณด",
            "product": "์ œํ’ˆA",
            "date": "2024-01-15"
        }
    ),
    Document(
        text="์ œํ’ˆ A๋Š” ํŒŒ๋ž€์ƒ‰๊ณผ ๋นจ๊ฐ„์ƒ‰์ด ์žˆ์Šต๋‹ˆ๋‹ค.",
        metadata={
            "category": "์ƒํ’ˆ์ •๋ณด",
            "product": "์ œํ’ˆA",
            "date": "2024-01-15"
        }
    )
]

index = VectorStoreIndex.from_documents(documents)

# ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ ํ•„ํ„ฐ๋ง๊ณผ ํ•จ๊ป˜ ๊ฒ€์ƒ‰
from llama_index.vector_stores import MetadataFilters, ExactMatchFilter

filters = MetadataFilters(
    filters=[ExactMatchFilter(key="category", value="๊ฐ€๊ฒฉ์ •๋ณด")]
)

query_engine = index.as_query_engine(filters=filters)
response = query_engine.query("์ œํ’ˆ A ๊ฐ€๊ฒฉ ์•Œ๋ ค์ค˜")

์ด๋ ‡๊ฒŒ ํ•˜๋ฉด ํŠน์ • ์นดํ…Œ๊ณ ๋ฆฌ ๋ฌธ์„œ๋งŒ ๊ฒ€์ƒ‰ํ•  ์ˆ˜ ์žˆ์–ด์„œ ๋‹ต๋ณ€ ์ •ํ™•๋„๊ฐ€ ํ›จ์”ฌ ๋†’์•„์ง‘๋‹ˆ๋‹ค! ์‹ค๋ฌด์—์„œ ์ง„์งœ ์œ ์šฉํ•ด์š” ๐Ÿ’ฏ

๐Ÿ’พ ์ธ๋ฑ์Šค ์ €์žฅํ•˜๊ณ  ๋ถˆ๋Ÿฌ์˜ค๊ธฐ

๋งค๋ฒˆ ๋ฌธ์„œ ์ธ๋ฑ์‹ฑํ•˜๋ฉด ์‹œ๊ฐ„๋„ ์˜ค๋ž˜ ๊ฑธ๋ฆฌ๊ณ  API ๋น„์šฉ๋„ ๋งŽ์ด ๋‚˜๊ฐ€์š”. ํ•œ ๋ฒˆ ๋งŒ๋“  ์ธ๋ฑ์Šค๋Š” ์ €์žฅํ•ด๋’€๋‹ค๊ฐ€ ์žฌ์‚ฌ์šฉํ•˜๋Š” ๊ฒŒ ์ข‹์Šต๋‹ˆ๋‹ค!

7๏ธโƒฃ ์ธ๋ฑ์Šค ์ €์žฅ

# ์ธ๋ฑ์Šค๋ฅผ ๋””์Šคํฌ์— ์ €์žฅ
index.storage_context.persist(persist_dir="./storage")

print("์ธ๋ฑ์Šค ์ €์žฅ ์™„๋ฃŒ! โœ…")

์ด๋ ‡๊ฒŒ ํ•˜๋ฉด storage ํด๋”์— ์ธ๋ฑ์Šค๊ฐ€ ์ €์žฅ๋ฉ๋‹ˆ๋‹ค. ๋‹ค์Œ์— ๋‹ค์‹œ ์“ธ ์ˆ˜ ์žˆ์–ด์š”!

8๏ธโƒฃ ์ €์žฅ๋œ ์ธ๋ฑ์Šค ๋ถˆ๋Ÿฌ์˜ค๊ธฐ

from llama_index import StorageContext, load_index_from_storage

# ์ €์žฅ๋œ ์ธ๋ฑ์Šค ๋กœ๋“œ
storage_context = StorageContext.from_defaults(
    persist_dir="./storage"
)
index = load_index_from_storage(storage_context)

# ๋ฐ”๋กœ ์‚ฌ์šฉ ๊ฐ€๋Šฅ!
query_engine = index.as_query_engine()
response = query_engine.query("์งˆ๋ฌธ ๋‚ด์šฉ")

๋กœ๋”ฉ ์†๋„๊ฐ€ ์—„์ฒญ ๋น ๋ฅด์ฃ ? ๋ช‡ ์ดˆ๋ฉด ๋๋‚˜์š” ใ…‹ใ…‹ใ…‹ ์ด๊ฒŒ ์ง„์งœ ์‹ค์ „ ํŒ์ž…๋‹ˆ๋‹ค ๐ŸŽฏ

๐Ÿ’ก ํ”„๋กœ ํŒ! ๋ฌธ์„œ๊ฐ€ ์—…๋ฐ์ดํŠธ๋˜๋ฉด ์ธ๋ฑ์Šค๋„ ๋‹ค์‹œ ๋งŒ๋“ค์–ด์•ผ ํ•ด์š”. ๋ฌธ์„œ ์ˆ˜์ • ๋‚ ์งœ ์ฒดํฌํ•ด์„œ ์ž๋™์œผ๋กœ ์žฌ์ธ๋ฑ์‹ฑํ•˜๋Š” ๋กœ์ง ๋„ฃ์œผ๋ฉด ์™„๋ฒฝํ•ฉ๋‹ˆ๋‹ค! ์žฌ๋Šฅ๋„ท ๊ฐ™์€ ํ”Œ๋žซํผ์—์„œ ์ด๋Ÿฐ ์ž๋™ํ™” ์Šคํ‚ฌ ๋ฐฐ์šฐ๋ฉด ์ง„์งœ ๋„์›€ ๋งŽ์ด ๋ผ์š” ๐Ÿ˜Š
๐ŸŽจ ์‹ค์ „ ์˜ˆ์ œ: ํšŒ์‚ฌ ๋งค๋‰ด์–ผ Q&A ๋ด‡

์ด์ œ ๋ฐฐ์šด ๊ฑธ ๋‹ค ํ•ฉ์ณ์„œ ์‹ค์ œ๋กœ ์“ธ ์ˆ˜ ์žˆ๋Š” ์‹œ์Šคํ…œ์„ ๋งŒ๋“ค์–ด๋ด…์‹œ๋‹ค! ํšŒ์‚ฌ ๋งค๋‰ด์–ผ Q&A ๋ด‡์„ ๋งŒ๋“ค์–ด๋ณผ๊ฒŒ์š” ๐Ÿค–

import os
from llama_index import (
    VectorStoreIndex, 
    SimpleDirectoryReader, 
    ServiceContext,
    StorageContext,
    load_index_from_storage
)
from llama_index.llms import OpenAI
from llama_index.node_parser import SimpleNodeParser
from pathlib import Path

class ManualQABot:
    def __init__(self, documents_path, storage_path="./storage"):
        self.documents_path = documents_path
        self.storage_path = storage_path
        self.index = None
        self.query_engine = None
        
        # OpenAI API ํ‚ค ์„ค์ •
        os.environ["OPENAI_API_KEY"] = "your-api-key"
        
        # LLM ๋ฐ ์„œ๋น„์Šค ์ปจํ…์ŠคํŠธ ์„ค์ •
        llm = OpenAI(model="gpt-3.5-turbo", temperature=0.1)
        node_parser = SimpleNodeParser.from_defaults(
            chunk_size=1024,
            chunk_overlap=20
        )
        self.service_context = ServiceContext.from_defaults(
            llm=llm,
            node_parser=node_parser
        )
    
    def build_index(self):
        """๋ฌธ์„œ์—์„œ ์ธ๋ฑ์Šค ์ƒ์„ฑ"""
        print("๐Ÿ“š ๋ฌธ์„œ ๋กœ๋”ฉ ์ค‘...")
        documents = SimpleDirectoryReader(self.documents_path).load_data()
        print(f"โœ… {len(documents)}๊ฐœ ๋ฌธ์„œ ๋กœ๋“œ ์™„๋ฃŒ!")
        
        print("๐Ÿ”จ ์ธ๋ฑ์Šค ์ƒ์„ฑ ์ค‘...")
        self.index = VectorStoreIndex.from_documents(
            documents,
            service_context=self.service_context
        )
        print("โœ… ์ธ๋ฑ์Šค ์ƒ์„ฑ ์™„๋ฃŒ!")
        
        # ์ธ๋ฑ์Šค ์ €์žฅ
        self.index.storage_context.persist(persist_dir=self.storage_path)
        print(f"๐Ÿ’พ ์ธ๋ฑ์Šค ์ €์žฅ ์™„๋ฃŒ: {self.storage_path}")
        
        self.query_engine = self.index.as_query_engine()
    
    def load_index(self):
        """์ €์žฅ๋œ ์ธ๋ฑ์Šค ๋กœ๋“œ"""
        if not Path(self.storage_path).exists():
            print("โŒ ์ €์žฅ๋œ ์ธ๋ฑ์Šค๊ฐ€ ์—†์Šต๋‹ˆ๋‹ค. build_index()๋ฅผ ๋จผ์ € ์‹คํ–‰ํ•˜์„ธ์š”.")
            return False
        
        print("๐Ÿ“‚ ์ €์žฅ๋œ ์ธ๋ฑ์Šค ๋กœ๋”ฉ ์ค‘...")
        storage_context = StorageContext.from_defaults(
            persist_dir=self.storage_path
        )
        self.index = load_index_from_storage(
            storage_context,
            service_context=self.service_context
        )
        self.query_engine = self.index.as_query_engine()
        print("โœ… ์ธ๋ฑ์Šค ๋กœ๋“œ ์™„๋ฃŒ!")
        return True
    
    def ask(self, question):
        """์งˆ๋ฌธํ•˜๊ณ  ๋‹ต๋ณ€ ๋ฐ›๊ธฐ"""
        if self.query_engine is None:
            print("โŒ ์ธ๋ฑ์Šค๊ฐ€ ๋กœ๋“œ๋˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.")
            return None
        
        print(f"\nโ“ ์งˆ๋ฌธ: {question}")
        print("๐Ÿค” ๋‹ต๋ณ€ ์ƒ์„ฑ ์ค‘...")
        
        response = self.query_engine.query(question)
        
        print(f"\n๐Ÿ’ฌ ๋‹ต๋ณ€:\n{response}\n")
        print("-" * 50)
        
        return response
    
    def chat_loop(self):
        """๋Œ€ํ™”ํ˜• ๋ฃจํ”„"""
        print("\n๐Ÿค– ํšŒ์‚ฌ ๋งค๋‰ด์–ผ Q&A ๋ด‡์ž…๋‹ˆ๋‹ค!")
        print("์งˆ๋ฌธ์„ ์ž…๋ ฅํ•˜์„ธ์š”. (์ข…๋ฃŒ: 'quit' ๋˜๋Š” 'exit')\n")
        
        while True:
            question = input("๐Ÿ‘ค ์งˆ๋ฌธ: ").strip()
            
            if question.lower() in ['quit', 'exit', '์ข…๋ฃŒ']:
                print("๐Ÿ‘‹ ๋ด‡์„ ์ข…๋ฃŒํ•ฉ๋‹ˆ๋‹ค. ์•ˆ๋…•ํžˆ ๊ฐ€์„ธ์š”!")
                break
            
            if not question:
                continue
            
            self.ask(question)

# ์‚ฌ์šฉ ์˜ˆ์ œ
if __name__ == "__main__":
    # ๋ด‡ ์ดˆ๊ธฐํ™”
    bot = ManualQABot(documents_path="./company_manuals")
    
    # ์ฒ˜์Œ ์‹คํ–‰: ์ธ๋ฑ์Šค ์ƒ์„ฑ
    # bot.build_index()
    
    # ์ดํ›„ ์‹คํ–‰: ์ €์žฅ๋œ ์ธ๋ฑ์Šค ๋กœ๋“œ
    if bot.load_index():
        # ๋Œ€ํ™”ํ˜• ๋ชจ๋“œ ์‹œ์ž‘
        bot.chat_loop()
    else:
        # ์ธ๋ฑ์Šค๊ฐ€ ์—†์œผ๋ฉด ์ƒ์„ฑ
        bot.build_index()
        bot.chat_loop()

์™€ ์ด์ œ ์ง„์งœ ์™„์„ฑ๋„ ์žˆ๋Š” ์‹œ์Šคํ…œ์ด ๋์ฃ ? ์ด ์ฝ”๋“œ๋Š” ์‹ค์ œ ํšŒ์‚ฌ์—์„œ ๋ฐ”๋กœ ์“ธ ์ˆ˜ ์žˆ๋Š” ์ˆ˜์ค€์ด์—์š”! ๐ŸŽ‰

๐ŸŽฏ ์ด ์ฝ”๋“œ์˜ ์žฅ์ ๋“ค โ€ข ํด๋ž˜์Šค ๊ธฐ๋ฐ˜ ๊ตฌ์กฐ: ์žฌ์‚ฌ์šฉํ•˜๊ธฐ ์‰ฝ๊ณ  ์œ ์ง€๋ณด์ˆ˜๊ฐ€ ํŽธํ•ด์š”
โ€ข ์ธ๋ฑ์Šค ์บ์‹ฑ: ํ•œ ๋ฒˆ ๋งŒ๋“ค๋ฉด ๊ณ„์† ์žฌ์‚ฌ์šฉ ๊ฐ€๋Šฅ
โ€ข ๋Œ€ํ™”ํ˜• ์ธํ„ฐํŽ˜์ด์Šค: ์‚ฌ์šฉ์ž๊ฐ€ ํŽธํ•˜๊ฒŒ ์งˆ๋ฌธํ•  ์ˆ˜ ์žˆ์–ด์š”
โ€ข ์—๋Ÿฌ ์ฒ˜๋ฆฌ: ์˜ˆ์™ธ ์ƒํ™ฉ๋„ ์ž˜ ์ฒ˜๋ฆฌ๋ฉ๋‹ˆ๋‹ค
โ€ข ํ™•์žฅ ๊ฐ€๋Šฅ: ๊ธฐ๋Šฅ ์ถ”๊ฐ€ํ•˜๊ธฐ ์‰ฌ์šด ๊ตฌ์กฐ์˜ˆ์š”
๐Ÿ”ง ์„ฑ๋Šฅ ์ตœ์ ํ™” ํŒ๋“ค

์‹ค์ œ๋กœ ์šด์˜ํ•˜๋‹ค ๋ณด๋ฉด ์„ฑ๋Šฅ ์ด์Šˆ๊ฐ€ ์ƒ๊ธธ ์ˆ˜ ์žˆ์–ด์š”. ํŠนํžˆ ๋ฌธ์„œ๊ฐ€ ๋งŽ๊ฑฐ๋‚˜ ์‚ฌ์šฉ์ž๊ฐ€ ๋งŽ์„ ๋•Œ์š”! ๋ช‡ ๊ฐ€์ง€ ์ตœ์ ํ™” ๋ฐฉ๋ฒ•์„ ์•Œ๋ ค๋“œ๋ฆด๊ฒŒ์š” โšก

9๏ธโƒฃ ๋ฒกํ„ฐ DB ์‚ฌ์šฉํ•˜๊ธฐ

๋ฌธ์„œ๊ฐ€ ๋งŽ์•„์ง€๋ฉด ๋ฉ”๋ชจ๋ฆฌ ๋ถ€์กฑ ๋ฌธ์ œ๊ฐ€ ์ƒ๊ธธ ์ˆ˜ ์žˆ์–ด์š”. ์ด๋Ÿด ๋•Œ๋Š” ์ „๋ฌธ ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋ฅผ ์‚ฌ์šฉํ•˜์„ธ์š”!

from llama_index.vector_stores import ChromaVectorStore
from llama_index.storage.storage_context import StorageContext
import chromadb

# Chroma DB ์ดˆ๊ธฐํ™”
chroma_client = chromadb.PersistentClient(path="./chroma_db")
chroma_collection = chroma_client.get_or_create_collection("company_docs")

# ๋ฒกํ„ฐ ์Šคํ† ์–ด ์„ค์ •
vector_store = ChromaVectorStore(chroma_collection=chroma_collection)
storage_context = StorageContext.from_defaults(vector_store=vector_store)

# ์ธ๋ฑ์Šค ์ƒ์„ฑ (๋ฒกํ„ฐ DB ์‚ฌ์šฉ)
index = VectorStoreIndex.from_documents(
    documents,
    storage_context=storage_context
)

Chroma ๋ง๊ณ ๋„ Pinecone, Weaviate, Qdrant ๊ฐ™์€ ๋ฒกํ„ฐ DB๋“ค๋„ ์žˆ์–ด์š”. ๊ฐ๊ฐ ์žฅ๋‹จ์ ์ด ์žˆ์œผ๋‹ˆ ํ”„๋กœ์ ํŠธ์— ๋งž๊ฒŒ ์„ ํƒํ•˜์‹œ๋ฉด ๋ฉ๋‹ˆ๋‹ค!

๐Ÿ”Ÿ ์‘๋‹ต ์†๋„ ๊ฐœ์„ 

๋‹ต๋ณ€ ์ƒ์„ฑ ์†๋„๋ฅผ ๋†’์ด๋Š” ๋ฐฉ๋ฒ•๋“ค์ด์—์š”:

# 1. ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ ๊ฐœ์ˆ˜ ์ œํ•œ
query_engine = index.as_query_engine(
    similarity_top_k=3  # ์ƒ์œ„ 3๊ฐœ๋งŒ ๊ฒ€์ƒ‰ (๊ธฐ๋ณธ๊ฐ’: 2)
)

# 2. ์ŠคํŠธ๋ฆฌ๋ฐ ์‘๋‹ต ์‚ฌ์šฉ
query_engine = index.as_query_engine(
    streaming=True
)
response = query_engine.query("์งˆ๋ฌธ")
for text in response.response_gen:
    print(text, end="", flush=True)

# 3. ๋” ๋น ๋ฅธ ๋ชจ๋ธ ์‚ฌ์šฉ
llm = OpenAI(model="gpt-3.5-turbo")  # gpt-4๋ณด๋‹ค ๋น ๋ฆ„

์ŠคํŠธ๋ฆฌ๋ฐ ์‘๋‹ต์€ ChatGPT์ฒ˜๋Ÿผ ๊ธ€์ž๊ฐ€ ํ•˜๋‚˜์”ฉ ๋‚˜ํƒ€๋‚˜๋Š” ํšจ๊ณผ์˜ˆ์š”. ์‚ฌ์šฉ์ž ๊ฒฝํ—˜์ด ํ›จ์”ฌ ์ข‹์•„์ง‘๋‹ˆ๋‹ค ใ…Žใ…Ž

๐Ÿ’ก ๋น„์šฉ ์ ˆ๊ฐ ํŒ! OpenAI API ๋น„์šฉ์ด ๋ถ€๋‹ด๋˜๋ฉด ๋กœ์ปฌ LLM ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•  ์ˆ˜๋„ ์žˆ์–ด์š”. Llama 2, Mistral ๊ฐ™์€ ์˜คํ”ˆ์†Œ์Šค ๋ชจ๋ธ๋“ค์ด ์žˆ์Šต๋‹ˆ๋‹ค. ์„ฑ๋Šฅ์€ ์ข€ ๋–จ์–ด์ง€์ง€๋งŒ ๋ฌด๋ฃŒ๋กœ ์“ธ ์ˆ˜ ์žˆ์–ด์š”! ์žฌ๋Šฅ๋„ท์—์„œ ์ด๋Ÿฐ ์˜คํ”ˆ์†Œ์Šค ํ™œ์šฉ๋ฒ• ๋ฐฐ์šฐ๋ฉด ๋น„์šฉ ๋งŽ์ด ์•„๋‚„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค ๐Ÿ’ฐ
์„ฑ๋Šฅ ์ตœ์ ํ™” ์ „๋žต โšก ์†๋„ ๊ฐœ์„  โ€ข ์ฒญํฌ ํฌ๊ธฐ ์ตœ์ ํ™” โ€ข ์บ์‹ฑ ํ™œ์šฉ โ€ข ์ŠคํŠธ๋ฆฌ๋ฐ ์‘๋‹ต ๐Ÿ’พ ๋ฉ”๋ชจ๋ฆฌ ๊ด€๋ฆฌ โ€ข ๋ฒกํ„ฐ DB ์‚ฌ์šฉ โ€ข ๋ฐฐ์น˜ ์ฒ˜๋ฆฌ โ€ข ์ธ๋ฑ์Šค ๋ถ„ํ•  ๐Ÿ’ฐ ๋น„์šฉ ์ ˆ๊ฐ โ€ข ๋กœ์ปฌ ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ โ€ข ์ž‘์€ LLM ์‚ฌ์šฉ โ€ข ๊ฒฐ๊ณผ ์บ์‹ฑ ๐ŸŽฏ ์ •ํ™•๋„ ํ–ฅ์ƒ โ€ข ๋ฉ”ํƒ€๋ฐ์ดํ„ฐ ํ™œ์šฉ โ€ข ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰ โ€ข ๋ฆฌ๋žญํ‚น ์ ์šฉ ๐Ÿ”’ ๋ณด์•ˆ ๊ฐ•ํ™” โ€ข API ํ‚ค ์•”ํ˜ธํ™” โ€ข ์ ‘๊ทผ ๊ถŒํ•œ ๊ด€๋ฆฌ โ€ข ๋กœ๊ทธ ๋ชจ๋‹ˆํ„ฐ๋ง ๐Ÿ“Š ๋ชจ๋‹ˆํ„ฐ๋ง โ€ข ์‘๋‹ต ์‹œ๊ฐ„ ์ถ”์  โ€ข ์—๋Ÿฌ์œจ ์ฒดํฌ โ€ข ์‚ฌ์šฉ๋Ÿ‰ ๋ถ„์„
๐Ÿš€ ๊ณ ๊ธ‰ ๊ธฐ๋Šฅ๋“ค

๊ธฐ๋ณธ Q&A ์‹œ์Šคํ…œ์€ ๋งŒ๋“ค์—ˆ์œผ๋‹ˆ ์ด์ œ ๋” ๋ฉ‹์ง„ ๊ธฐ๋Šฅ๋“ค์„ ์ถ”๊ฐ€ํ•ด๋ด…์‹œ๋‹ค! ์‹ค์ „์—์„œ ์ง„์งœ ์œ ์šฉํ•œ ๊ฒƒ๋“ค์ด์—์š” ๐Ÿ˜Ž

1๏ธโƒฃ1๏ธโƒฃ ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰

๋ฒกํ„ฐ ๊ฒ€์ƒ‰๊ณผ ํ‚ค์›Œ๋“œ ๊ฒ€์ƒ‰์„ ํ•จ๊ป˜ ์‚ฌ์šฉํ•˜๋ฉด ์ •ํ™•๋„๊ฐ€ ๋” ์˜ฌ๋ผ๊ฐ€์š”!

from llama_index.retrievers import VectorIndexRetriever, BM25Retriever
from llama_index.query_engine import RetrieverQueryEngine

# ๋ฒกํ„ฐ ๊ฒ€์ƒ‰ ๋ฆฌํŠธ๋ฆฌ๋ฒ„
vector_retriever = VectorIndexRetriever(
    index=index,
    similarity_top_k=5
)

# BM25 ํ‚ค์›Œ๋“œ ๊ฒ€์ƒ‰ ๋ฆฌํŠธ๋ฆฌ๋ฒ„
bm25_retriever = BM25Retriever.from_defaults(
    docstore=index.docstore,
    similarity_top_k=5
)

# ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰ ์—”์ง„
from llama_index.retrievers import QueryFusionRetriever

retriever = QueryFusionRetriever(
    [vector_retriever, bm25_retriever],
    similarity_top_k=5,
    num_queries=1
)

query_engine = RetrieverQueryEngine(retriever=retriever)

์ด๋ ‡๊ฒŒ ํ•˜๋ฉด ์˜๋ฏธ์  ์œ ์‚ฌ์„ฑ๊ณผ ํ‚ค์›Œ๋“œ ๋งค์นญ์„ ๋™์‹œ์— ๊ณ ๋ คํ•ด์„œ ๋” ์ •ํ™•ํ•œ ๋‹ต๋ณ€์„ ์ค„ ์ˆ˜ ์žˆ์–ด์š”! ํŠนํžˆ ์ „๋ฌธ ์šฉ์–ด๊ฐ€ ๋งŽ์€ ๋ฌธ์„œ์—์„œ ํšจ๊ณผ์ ์ž…๋‹ˆ๋‹ค ๐ŸŽฏ

1๏ธโƒฃ2๏ธโƒฃ ๋Œ€ํ™” ๊ธฐ๋ก ์œ ์ง€

์ด์ „ ๋Œ€ํ™” ๋‚ด์šฉ์„ ๊ธฐ์–ตํ•˜๊ฒŒ ๋งŒ๋“ค๋ฉด ๋” ์ž์—ฐ์Šค๋Ÿฌ์šด ๋Œ€ํ™”๊ฐ€ ๊ฐ€๋Šฅํ•ด์š”!

from llama_index.memory import ChatMemoryBuffer

# ๋ฉ”๋ชจ๋ฆฌ ๋ฒ„ํผ ์ƒ์„ฑ (์ตœ๊ทผ 10๊ฐœ ๋ฉ”์‹œ์ง€ ๊ธฐ์–ต)
memory = ChatMemoryBuffer.from_defaults(token_limit=3000)

# ์ฑ„ํŒ… ์—”์ง„ ์ƒ์„ฑ
chat_engine = index.as_chat_engine(
    chat_mode="context",
    memory=memory,
    system_prompt=(
        "๋‹น์‹ ์€ ํšŒ์‚ฌ ๋งค๋‰ด์–ผ ์ „๋ฌธ๊ฐ€์ž…๋‹ˆ๋‹ค. "
        "์นœ์ ˆํ•˜๊ณ  ์ •ํ™•ํ•˜๊ฒŒ ๋‹ต๋ณ€ํ•ด์ฃผ์„ธ์š”."
    )
)

# ๋Œ€ํ™”ํ•˜๊ธฐ
response1 = chat_engine.chat("์ œํ’ˆ A์˜ ๊ฐ€๊ฒฉ์ด ์–ผ๋งˆ์•ผ?")
print(response1)

# ์ด์ „ ๋Œ€ํ™” ๊ธฐ์–ตํ•จ!
response2 = chat_engine.chat("๊ทธ๋Ÿผ ํ• ์ธ์€ ์žˆ์–ด?")  # "์ œํ’ˆ A"๋ฅผ ๊ธฐ์–ต
print(response2)

์™€ ์ด์ œ ์ง„์งœ ChatGPT์ฒ˜๋Ÿผ ๋Œ€ํ™”๊ฐ€ ๋˜์ฃ ? ใ…‹ใ…‹ใ…‹ ์‚ฌ์šฉ์ž ๊ฒฝํ—˜์ด ์™„์ „ ๋‹ฌ๋ผ์ง‘๋‹ˆ๋‹ค!

1๏ธโƒฃ3๏ธโƒฃ ์†Œ์Šค ์ถ”์  ๊ธฐ๋Šฅ

๋‹ต๋ณ€์ด ์–ด๋А ๋ฌธ์„œ์—์„œ ๋‚˜์™”๋Š”์ง€ ๋ณด์—ฌ์ฃผ๋ฉด ์‹ ๋ขฐ๋„๊ฐ€ ์˜ฌ๋ผ๊ฐ€์š”!

query_engine = index.as_query_engine(
    response_mode="compact",
    verbose=True
)

response = query_engine.query("์ œํ’ˆ ๊ฐ€๊ฒฉ ์•Œ๋ ค์ค˜")

# ๋‹ต๋ณ€ ์ถœ๋ ฅ
print(f"๋‹ต๋ณ€: {response}\n")

# ์†Œ์Šค ๋ฌธ์„œ ์ •๋ณด ์ถœ๋ ฅ
print("๐Ÿ“š ์ฐธ๊ณ  ๋ฌธ์„œ:")
for i, node in enumerate(response.source_nodes, 1):
    print(f"\n{i}. ํŒŒ์ผ: {node.metadata.get('file_name', 'Unknown')}")
    print(f"   ํŽ˜์ด์ง€: {node.metadata.get('page_label', 'N/A')}")
    print(f"   ๋‚ด์šฉ ์ผ๋ถ€: {node.text[:100]}...")
    print(f"   ์œ ์‚ฌ๋„ ์ ์ˆ˜: {node.score:.3f}")

์ด๋ ‡๊ฒŒ ํ•˜๋ฉด ์‚ฌ์šฉ์ž๊ฐ€ ๋‹ต๋ณ€์„ ๋” ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๊ณ , ํ•„์š”ํ•˜๋ฉด ์›๋ณธ ๋ฌธ์„œ๋ฅผ ์ง์ ‘ ํ™•์ธํ•  ์ˆ˜๋„ ์žˆ์–ด์š”! ๊ธฐ์—…์šฉ ์‹œ์Šคํ…œ์—์„œ๋Š” ํ•„์ˆ˜ ๊ธฐ๋Šฅ์ž…๋‹ˆ๋‹ค ๐Ÿ“‹

๐ŸŽจ UI ๊ฐœ์„  ์•„์ด๋””์–ด ํ„ฐ๋ฏธ๋„ ๋ง๊ณ  ์›น ์ธํ„ฐํŽ˜์ด์Šค๋กœ ๋งŒ๋“ค๋ฉด ๋” ์ข‹๊ฒ ์ฃ ? Streamlit์ด๋‚˜ Gradio ๊ฐ™์€ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์“ฐ๋ฉด ์‰ฝ๊ฒŒ ๋งŒ๋“ค ์ˆ˜ ์žˆ์–ด์š”!

pip install streamlit ์„ค์น˜ํ•˜๊ณ  ๊ฐ„๋‹จํ•œ ์›น UI ๋งŒ๋“ค์–ด๋ณด์„ธ์š”. ๋ฒ„ํŠผ ํด๋ฆญํ•˜๊ณ  ์ฑ„ํŒ…์ฐฝ์—์„œ ๋Œ€ํ™”ํ•˜๋Š” ํ˜•ํƒœ๋กœ์š” ใ…Žใ…Ž
๐Ÿ› ์ž์ฃผ ๋งŒ๋‚˜๋Š” ์—๋Ÿฌ์™€ ํ•ด๊ฒฐ๋ฒ•

๊ฐœ๋ฐœํ•˜๋‹ค ๋ณด๋ฉด ์—๋Ÿฌ๊ฐ€ ๋‚˜๋Š” ๊ฑด ๋‹น์—ฐํ•ด์š”! ์ž์ฃผ ๋‚˜์˜ค๋Š” ์—๋Ÿฌ๋“ค๊ณผ ํ•ด๊ฒฐ ๋ฐฉ๋ฒ•์„ ์ •๋ฆฌํ•ด๋ดค์Šต๋‹ˆ๋‹ค ๐Ÿ”ง

โŒ RateLimitError

์ฆ์ƒ: OpenAI API ํ˜ธ์ถœ ์ œํ•œ ์ดˆ๊ณผ
ํ•ด๊ฒฐ:
# ์žฌ์‹œ๋„ ๋กœ์ง ์ถ”๊ฐ€
from tenacity import retry, stop_after_attempt, wait_exponential

@retry(
    stop=stop_after_attempt(3),
    wait=wait_exponential(multiplier=1, min=4, max=10)
)
def query_with_retry(query_engine, question):
    return query_engine.query(question)
๋˜๋Š” ์œ ๋ฃŒ ํ”Œ๋žœ์œผ๋กœ ์—…๊ทธ๋ ˆ์ด๋“œํ•˜๊ฑฐ๋‚˜, ๋กœ์ปฌ ๋ชจ๋ธ ์‚ฌ์šฉ์„ ๊ณ ๋ คํ•ด๋ณด์„ธ์š”!
โŒ OutOfMemoryError ์ฆ์ƒ: ๋ฉ”๋ชจ๋ฆฌ ๋ถ€์กฑ์œผ๋กœ ํ”„๋กœ๊ทธ๋žจ ์ข…๋ฃŒ
ํ•ด๊ฒฐ:
โ€ข ์ฒญํฌ ํฌ๊ธฐ๋ฅผ ์ค„์ด์„ธ์š” (1024 โ†’ 512)
โ€ข ๋ฒกํ„ฐ DB ์‚ฌ์šฉ (Chroma, Pinecone ๋“ฑ)
โ€ข ๋ฌธ์„œ๋ฅผ ์—ฌ๋Ÿฌ ๊ฐœ์˜ ์ธ๋ฑ์Šค๋กœ ๋ถ„ํ• 
โ€ข ๋ฐฐ์น˜ ํฌ๊ธฐ ์กฐ์ •
โŒ ํ•œ๊ตญ์–ด ๋‹ต๋ณ€ ํ’ˆ์งˆ ์ €ํ•˜ ์ฆ์ƒ: ์˜์–ด๋Š” ์ž˜ ๋˜๋Š”๋ฐ ํ•œ๊ตญ์–ด๋Š” ์ด์ƒํ•˜๊ฒŒ ๋‹ต๋ณ€
ํ•ด๊ฒฐ:
โ€ข ํ•œ๊ตญ์–ด ํŠนํ™” ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ ์‚ฌ์šฉ
โ€ข ํ”„๋กฌํ”„ํŠธ์— "ํ•œ๊ตญ์–ด๋กœ ๋‹ต๋ณ€ํ•ด์ฃผ์„ธ์š”" ๋ช…์‹œ
โ€ข GPT-4 ๊ฐ™์€ ๋” ์ข‹์€ ๋ชจ๋ธ ์‚ฌ์šฉ
โ€ข ๋ฌธ์„œ ์ „์ฒ˜๋ฆฌ ์‹œ ์ธ์ฝ”๋”ฉ ํ™•์ธ (UTF-8)
๐Ÿ’ก ๋””๋ฒ„๊น… ํŒ!
verbose=True ์˜ต์…˜ ์ผœ๋ฉด ๋‚ด๋ถ€ ๋™์ž‘ ๊ณผ์ •์ด ๋‹ค ๋ณด์—ฌ์š”. ๋ญ๊ฐ€ ๋ฌธ์ œ์ธ์ง€ ํŒŒ์•…ํ•˜๊ธฐ ์‰ฌ์›Œ์ง‘๋‹ˆ๋‹ค!

query_engine = index.as_query_engine(verbose=True)
๐Ÿ“ฑ ์‹ค์ „ ๋ฐฐํฌ ๊ฐ€์ด๋“œ

๊ฐœ๋ฐœ์€ ๋๋‚ฌ๊ณ  ์ด์ œ ์‹ค์ œ๋กœ ์„œ๋น„์Šคํ•ด์•ผ์ฃ ? ๋ฐฐํฌ ๋ฐฉ๋ฒ•์„ ์•Œ๋ ค๋“œ๋ฆด๊ฒŒ์š”! ๐Ÿš€

1๏ธโƒฃ4๏ธโƒฃ FastAPI๋กœ REST API ๋งŒ๋“ค๊ธฐ

from fastapi import FastAPI, HTTPException
from pydantic import BaseModel
import uvicorn

app = FastAPI(title="๋ฌธ์„œ Q&A API")

# ๋ด‡ ์ดˆ๊ธฐํ™” (์ „์—ญ ๋ณ€์ˆ˜)
bot = ManualQABot(documents_path="./documents")
bot.load_index()

class Question(BaseModel):
    text: str

class Answer(BaseModel):
    answer: str
    sources: list = []

@app.post("/ask", response_model=Answer)
async def ask_question(question: Question):
    try:
        response = bot.ask(question.text)
        
        # ์†Œ์Šค ์ •๋ณด ์ถ”์ถœ
        sources = []
        if hasattr(response, 'source_nodes'):
            for node in response.source_nodes:
                sources.append({
                    "file": node.metadata.get('file_name', 'Unknown'),
                    "score": float(node.score)
                })
        
        return Answer(
            answer=str(response),
            sources=sources
        )
    except Exception as e:
        raise HTTPException(status_code=500, detail=str(e))

@app.get("/health")
async def health_check():
    return {"status": "healthy"}

if __name__ == "__main__":
    uvicorn.run(app, host="0.0.0.0", port=8000)

์ด์ œ http://localhost:8000/ask๋กœ POST ์š”์ฒญ ๋ณด๋‚ด๋ฉด ๋‹ต๋ณ€์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์–ด์š”! Swagger UI๋„ ์ž๋™์œผ๋กœ ์ƒ์„ฑ๋ฉ๋‹ˆ๋‹ค (/docs ์ ‘์†) ๐Ÿ“ก

1๏ธโƒฃ5๏ธโƒฃ Docker ์ปจํ…Œ์ด๋„ˆํ™”

๋ฐฐํฌ๋ฅผ ์‰ฝ๊ฒŒ ํ•˜๋ ค๋ฉด Docker ์‚ฌ์šฉํ•˜๋Š” ๊ฒŒ ์ข‹์•„์š”!

# Dockerfile
FROM python:3.10-slim

WORKDIR /app

COPY requirements.txt .
RUN pip install --no-cache-dir -r requirements.txt

COPY . .

EXPOSE 8000

CMD ["python", "api.py"]

# requirements.txt
llama-index==0.9.0
openai==1.0.0
fastapi==0.104.0
uvicorn==0.24.0
pypdf==3.17.0
python-docx==1.1.0

# ๋นŒ๋“œ ๋ฐ ์‹คํ–‰
docker build -t qa-bot .
docker run -p 8000:8000 -v ./documents:/app/documents qa-bot

์ด์ œ ์–ด๋””์„œ๋“  ๋˜‘๊ฐ™์€ ํ™˜๊ฒฝ์œผ๋กœ ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ์–ด์š”! ํด๋ผ์šฐ๋“œ ๋ฐฐํฌ๋„ ์‰ฌ์›Œ์ง‘๋‹ˆ๋‹ค โ˜๏ธ

1๏ธโƒฃ6๏ธโƒฃ ํด๋ผ์šฐ๋“œ ๋ฐฐํฌ ์˜ต์…˜๋“ค

AWS EC2: ๊ฐ€์žฅ ๊ธฐ๋ณธ์ ์ธ ๋ฐฉ๋ฒ•. ์„œ๋ฒ„ ํ•˜๋‚˜ ๋นŒ๋ ค์„œ ์ง์ ‘ ์„ค์น˜
Google Cloud Run: ์„œ๋ฒ„๋ฆฌ์Šค๋กœ ์ž๋™ ์Šค์ผ€์ผ๋ง. ์‚ฌ์šฉํ•œ ๋งŒํผ๋งŒ ๊ณผ๊ธˆ
Heroku: ๊ฐ„๋‹จํ•˜๊ฒŒ ๋ฐฐํฌ ๊ฐ€๋Šฅ. ์†Œ๊ทœ๋ชจ ํ”„๋กœ์ ํŠธ์— ์ข‹์Œ
Azure Container Instances: ์ปจํ…Œ์ด๋„ˆ ๊ธฐ๋ฐ˜ ๋ฐฐํฌ. ๊ด€๋ฆฌ ํŽธํ•จ

๊ฐœ์ธ์ ์œผ๋กœ๋Š” Cloud Run ์ถ”์ฒœํ•ด์š”! ์„ค์ • ๊ฐ„๋‹จํ•˜๊ณ  ๋น„์šฉ๋„ ์ €๋ ดํ•ฉ๋‹ˆ๋‹ค ใ…Žใ…Ž

๐Ÿ” ๋ณด์•ˆ ์ฒดํฌ๋ฆฌ์ŠคํŠธ
  • โœ… API ํ‚ค๋Š” ํ™˜๊ฒฝ ๋ณ€์ˆ˜๋กœ ๊ด€๋ฆฌ
  • โœ… HTTPS ์‚ฌ์šฉ (SSL ์ธ์ฆ์„œ ์ ์šฉ)
  • โœ… Rate Limiting ์„ค์ • (๋‚จ์šฉ ๋ฐฉ์ง€)
  • โœ… ์ธ์ฆ/์ธ๊ฐ€ ์‹œ์Šคํ…œ ๊ตฌํ˜„
  • โœ… ๋กœ๊ทธ ๋ชจ๋‹ˆํ„ฐ๋ง ์„ค์ •
  • โœ… ์ •๊ธฐ์ ์ธ ๋ณด์•ˆ ์—…๋ฐ์ดํŠธ
๐Ÿ’ฐ ๋น„์šฉ ์ตœ์ ํ™” ์ „๋žต

OpenAI API ์“ฐ๋‹ค ๋ณด๋ฉด ๋น„์šฉ์ด ์ƒ๊ฐ๋ณด๋‹ค ๋งŽ์ด ๋‚˜์˜ฌ ์ˆ˜ ์žˆ์–ด์š”. ๋˜‘๋˜‘ํ•˜๊ฒŒ ์ ˆ์•ฝํ•˜๋Š” ๋ฐฉ๋ฒ•๋“ค์„ ์•Œ๋ ค๋“œ๋ฆด๊ฒŒ์š”! ๐Ÿ’ธ

๐Ÿ“Š ๋น„์šฉ ๊ตฌ์กฐ ์ดํ•ดํ•˜๊ธฐ ์ž„๋ฒ ๋”ฉ ๋น„์šฉ: ๋ฌธ์„œ๋ฅผ ๋ฒกํ„ฐ๋กœ ๋ณ€ํ™˜ํ•  ๋•Œ (ํ•œ ๋ฒˆ๋งŒ ๋ฐœ์ƒ)
์ฟผ๋ฆฌ ๋น„์šฉ: ์งˆ๋ฌธํ•  ๋•Œ๋งˆ๋‹ค ๋ฐœ์ƒ (GPT ํ˜ธ์ถœ)
ํ† ํฐ ์ˆ˜: ์ž…๋ ฅ + ์ถœ๋ ฅ ํ† ํฐ ํ•ฉ๊ณ„๋กœ ๊ณ„์‚ฐ

GPT-3.5-turbo: $0.0015 / 1K tokens (์ž…๋ ฅ), $0.002 / 1K tokens (์ถœ๋ ฅ)
GPT-4: ์•ฝ 20๋ฐฐ ๋” ๋น„์Œˆ (ํ•˜์ง€๋งŒ ํ’ˆ์งˆ์€ ๋” ์ข‹์Œ)
1๏ธโƒฃ7๏ธโƒฃ ์บ์‹ฑ์œผ๋กœ ๋น„์šฉ ์ค„์ด๊ธฐ

from functools import lru_cache
import hashlib

class CachedQABot:
    def __init__(self):
        self.cache = {}
    
    def get_cache_key(self, question):
        return hashlib.md5(question.encode()).hexdigest()
    
    def ask(self, question):
        cache_key = self.get_cache_key(question)
        
        # ์บ์‹œ์— ์žˆ์œผ๋ฉด ๋ฐ”๋กœ ๋ฐ˜ํ™˜
        if cache_key in self.cache:
            print("๐Ÿ’พ ์บ์‹œ์—์„œ ๋‹ต๋ณ€ ๊ฐ€์ ธ์˜ด!")
            return self.cache[cache_key]
        
        # ์—†์œผ๋ฉด ์ƒˆ๋กœ ์ƒ์„ฑ
        response = self.query_engine.query(question)
        self.cache[cache_key] = response
        
        return response

๊ฐ™์€ ์งˆ๋ฌธ์ด ๋ฐ˜๋ณต๋˜๋ฉด API ํ˜ธ์ถœ ์•ˆ ํ•˜๊ณ  ์ €์žฅ๋œ ๋‹ต๋ณ€์„ ์žฌ์‚ฌ์šฉํ•ด์š”. ๋น„์šฉ์ด ํ™• ์ค„์–ด๋“ญ๋‹ˆ๋‹ค! ๐ŸŽ‰

1๏ธโƒฃ8๏ธโƒฃ ๋กœ์ปฌ ๋ชจ๋ธ ํ™œ์šฉ

from llama_index.llms import Ollama

# Ollama๋กœ ๋กœ์ปฌ LLM ์‚ฌ์šฉ (๋ฌด๋ฃŒ!)
llm = Ollama(model="llama2", request_timeout=120.0)

service_context = ServiceContext.from_defaults(
    llm=llm,
    embed_model="local"  # ๋กœ์ปฌ ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ
)

Ollama ์„ค์น˜ํ•˜๋ฉด Llama 2, Mistral ๊ฐ™์€ ์˜คํ”ˆ์†Œ์Šค ๋ชจ๋ธ์„ ๋กœ์ปฌ์—์„œ ๋ฌด๋ฃŒ๋กœ ๋Œ๋ฆด ์ˆ˜ ์žˆ์–ด์š”! GPU ์žˆ์œผ๋ฉด ์†๋„๋„ ๊ดœ์ฐฎ์Šต๋‹ˆ๋‹ค ๐Ÿ–ฅ๏ธ

๐Ÿ’ก ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ์ „๋žต! ๊ฐ„๋‹จํ•œ ์งˆ๋ฌธ์€ ๋กœ์ปฌ ๋ชจ๋ธ๋กœ, ๋ณต์žกํ•œ ์งˆ๋ฌธ์€ GPT-4๋กœ ์ฒ˜๋ฆฌํ•˜๋Š” ์‹์œผ๋กœ ์„ž์–ด ์“ฐ๋ฉด ๋น„์šฉ๊ณผ ํ’ˆ์งˆ์˜ ๊ท ํ˜•์„ ๋งž์ถœ ์ˆ˜ ์žˆ์–ด์š”! ์งˆ๋ฌธ ๋ณต์žก๋„๋ฅผ ๋จผ์ € ํŒ๋‹จํ•˜๋Š” ๋กœ์ง์„ ์ถ”๊ฐ€ํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค ๐ŸŽฏ
๐ŸŽ“ ์‹ค์ „ ํ”„๋กœ์ ํŠธ ์•„์ด๋””์–ด

๋ฐฐ์šด ๊ฑธ ํ™œ์šฉํ•ด์„œ ๋งŒ๋“ค ์ˆ˜ ์žˆ๋Š” ์žฌ๋ฏธ์žˆ๋Š” ํ”„๋กœ์ ํŠธ๋“ค์„ ์†Œ๊ฐœํ• ๊ฒŒ์š”! ํฌํŠธํด๋ฆฌ์˜ค์—๋„ ์ข‹๊ณ  ์‹ค์ œ๋กœ ์“ธ๋ชจ๋„ ์žˆ์–ด์š” ๐Ÿ˜Š

1๏ธโƒฃ ๐Ÿ“š ๊ฐœ์ธ ์ง€์‹ ๊ด€๋ฆฌ ์‹œ์Šคํ…œ ๋‚ด๊ฐ€ ์ฝ์€ ์ฑ…, ๋…ผ๋ฌธ, ๋ธ”๋กœ๊ทธ ๊ธ€๋“ค์„ ๋ชจ์•„์„œ ๋‚˜๋งŒ์˜ AI ๋น„์„œ ๋งŒ๋“ค๊ธฐ!
"๋‚ด๊ฐ€ ์ฝ์€ ์ฑ… ์ค‘์— ์ƒ์‚ฐ์„ฑ ๊ด€๋ จ๋œ ๋‚ด์šฉ ์ •๋ฆฌํ•ด์ค˜" ์ด๋Ÿฐ ์งˆ๋ฌธ ๊ฐ€๋Šฅ ใ…‹ใ…‹

ํ™œ์šฉ ๋ฌธ์„œ: PDF ๋…ผ๋ฌธ, ์ „์ž์ฑ…, ๋งˆํฌ๋‹ค์šด ๋…ธํŠธ
์ถ”๊ฐ€ ๊ธฐ๋Šฅ: ํƒœ๊ทธ ์‹œ์Šคํ…œ, ๋‚ ์งœ๋ณ„ ๊ฒ€์ƒ‰, ์š”์•ฝ ๊ธฐ๋Šฅ
2๏ธโƒฃ ๐Ÿข ์‚ฌ๋‚ด ํ—ฌํ”„๋ฐ์Šคํฌ ๋ด‡ ํšŒ์‚ฌ ๊ทœ์ •, ๋ณต๋ฆฌํ›„์ƒ, IT ๋งค๋‰ด์–ผ ๋“ฑ์„ ํ•™์Šต์‹œ์ผœ์„œ ์ง์›๋“ค ์งˆ๋ฌธ์— ์ž๋™ ์‘๋‹ต!
"์—ฐ์ฐจ ์‹ ์ฒญ์€ ์–ด๋–ป๊ฒŒ ํ•ด?" โ†’ ์ฆ‰์‹œ ๋‹ต๋ณ€ + ๊ด€๋ จ ๋ฌธ์„œ ๋งํฌ

ํ™œ์šฉ ๋ฌธ์„œ: ์ธ์‚ฌ ๊ทœ์ •, IT ๊ฐ€์ด๋“œ, FAQ
์ถ”๊ฐ€ ๊ธฐ๋Šฅ: ์Šฌ๋ž™/ํŒ€์ฆˆ ์—ฐ๋™, ํ‹ฐ์ผ“ ์ž๋™ ์ƒ์„ฑ
3๏ธโƒฃ ๐Ÿ“– ํ•™์Šต ๋„์šฐ๋ฏธ ๊ต๊ณผ์„œ๋‚˜ ๊ฐ•์˜ ์ž๋ฃŒ๋ฅผ ์—…๋กœ๋“œํ•˜๊ณ  ๊ณต๋ถ€ํ•  ๋•Œ ์งˆ๋ฌธํ•˜๋Š” ์‹œ์Šคํ…œ!
"์ด ์ฑ•ํ„ฐ์˜ ํ•ต์‹ฌ ๊ฐœ๋… 3๊ฐ€์ง€๋งŒ ์•Œ๋ ค์ค˜" ๊ฐ™์€ ์งˆ๋ฌธ์œผ๋กœ ํšจ์œจ์  ํ•™์Šต

ํ™œ์šฉ ๋ฌธ์„œ: ๊ต๊ณผ์„œ PDF, ๊ฐ•์˜ ๋…ธํŠธ, ์ฐธ๊ณ  ์ž๋ฃŒ
์ถ”๊ฐ€ ๊ธฐ๋Šฅ: ํ€ด์ฆˆ ์ƒ์„ฑ, ์š”์•ฝ ๊ธฐ๋Šฅ, ์ง„๋„ ์ถ”์ 
4๏ธโƒฃ ๐Ÿฅ ์˜๋ฃŒ ์ •๋ณด ๊ฒ€์ƒ‰ ์‹œ์Šคํ…œ ์˜ํ•™ ๋…ผ๋ฌธ์ด๋‚˜ ๊ฐ€์ด๋“œ๋ผ์ธ์„ ํ•™์Šต์‹œ์ผœ์„œ ์˜๋ฃŒ์ง„ ์˜์‚ฌ๊ฒฐ์ • ์ง€์›!
(์ฃผ์˜: ์‹ค์ œ ์ง„๋ฃŒ์—๋Š” ์ „๋ฌธ๊ฐ€ ๊ฒ€์ฆ ํ•„์ˆ˜)

ํ™œ์šฉ ๋ฌธ์„œ: ์ง„๋ฃŒ ๊ฐ€์ด๋“œ๋ผ์ธ, ๋…ผ๋ฌธ, ์•ฝ๋ฌผ ์ •๋ณด
์ถ”๊ฐ€ ๊ธฐ๋Šฅ: ์ฐธ๊ณ  ๋ฌธํ—Œ ์ž๋™ ์ธ์šฉ, ์‹ ๋ขฐ๋„ ํ‘œ์‹œ
5๏ธโƒฃ ๐Ÿ›’ ์ƒํ’ˆ ์ถ”์ฒœ ์ฑ—๋ด‡ ์‡ผํ•‘๋ชฐ ์ƒํ’ˆ ์ •๋ณด๋ฅผ ํ•™์Šต์‹œ์ผœ์„œ ๊ณ ๊ฐ ์งˆ๋ฌธ์— ๋งž๋Š” ์ƒํ’ˆ ์ถ”์ฒœ!
"20๋งŒ์›๋Œ€ ๋…ธํŠธ๋ถ ์ถ”์ฒœํ•ด์ค˜" โ†’ ์กฐ๊ฑด์— ๋งž๋Š” ์ƒํ’ˆ + ์ƒ์„ธ ์„ค๋ช…

ํ™œ์šฉ ๋ฌธ์„œ: ์ƒํ’ˆ ์„ค๋ช…์„œ, ๋ฆฌ๋ทฐ, ์ŠคํŽ™ ์‹œํŠธ
์ถ”๊ฐ€ ๊ธฐ๋Šฅ: ๊ฐ€๊ฒฉ ๋น„๊ต, ์žฌ๊ณ  ํ™•์ธ, ๊ตฌ๋งค ๋งํฌ

์ด๋Ÿฐ ํ”„๋กœ์ ํŠธ๋“ค ๋งŒ๋“ค์–ด์„œ ์žฌ๋Šฅ๋„ท์— ๋“ฑ๋กํ•˜๋ฉด ์ˆ˜์ต๋„ ๋‚ผ ์ˆ˜ ์žˆ์–ด์š”! ์š”์ฆ˜ AI ๊ธฐ๋ฐ˜ ์„œ๋น„์Šค ์ˆ˜์š”๊ฐ€ ์—„์ฒญ ๋งŽ๊ฑฐ๋“ ์š” ๐Ÿ’ฐ

๐Ÿ”ฎ ๋ฏธ๋ž˜ ์ „๋ง๊ณผ ๋ฐœ์ „ ๋ฐฉํ–ฅ

LlamaIndex์™€ ๋ฌธ์„œ ๊ธฐ๋ฐ˜ Q&A ์‹œ์Šคํ…œ์€ ๊ณ„์† ๋ฐœ์ „ํ•˜๊ณ  ์žˆ์–ด์š”. ์•ž์œผ๋กœ ์–ด๋–ป๊ฒŒ ๋ณ€ํ• ์ง€ ์‚ดํŽด๋ด…์‹œ๋‹ค! ๐Ÿš€

๐ŸŒŸ ์ฃผ๋ชฉํ•  ๋งŒํ•œ ํŠธ๋ Œ๋“œ๋“ค โ€ข ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ์ง€์›:
ํ…์ŠคํŠธ๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ์ด๋ฏธ์ง€, ํ‘œ, ๊ทธ๋ž˜ํ”„๋„ ์ดํ•ดํ•˜๋Š” ์‹œ์Šคํ…œ์œผ๋กœ ์ง„ํ™” ์ค‘์ด์—์š”. GPT-4V ๊ฐ™์€ ๋น„์ „ ๋ชจ๋ธ๊ณผ ๊ฒฐํ•ฉํ•˜๋ฉด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค!

โ€ข ์‹ค์‹œ๊ฐ„ ์—…๋ฐ์ดํŠธ:
๋ฌธ์„œ๊ฐ€ ์ˆ˜์ •๋˜๋ฉด ์ž๋™์œผ๋กœ ์ธ๋ฑ์Šค ์—…๋ฐ์ดํŠธํ•˜๋Š” ๊ธฐ๋Šฅ. ํ•ญ์ƒ ์ตœ์‹  ์ •๋ณด ์œ ์ง€ ๊ฐ€๋Šฅ ใ…Žใ…Ž

โ€ข ๋” ์ž‘๊ณ  ๋น ๋ฅธ ๋ชจ๋ธ:
Mistral 7B, Phi-2 ๊ฐ™์€ ์†Œํ˜• ๋ชจ๋ธ๋“ค์ด ์„ฑ๋Šฅ์€ ์ข‹์œผ๋ฉด์„œ ๋น ๋ฅด๊ณ  ์ €๋ ดํ•ด์ง€๊ณ  ์žˆ์–ด์š”. ๋กœ์ปฌ ์‹คํ–‰๋„ ์‰ฌ์›Œ์ง‘๋‹ˆ๋‹ค!

โ€ข RAG ๊ณ ๋„ํ™”:
Retrieval-Augmented Generation ๊ธฐ์ˆ ์ด ๊ณ„์† ๋ฐœ์ „ํ•ด์„œ ๋” ์ •ํ™•ํ•˜๊ณ  ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๋Š” ๋‹ต๋ณ€ ์ƒ์„ฑ ๊ฐ€๋Šฅ

โ€ข ์—์ด์ „ํŠธ ์‹œ์Šคํ…œ:
๋‹จ์ˆœ Q&A๋ฅผ ๋„˜์–ด์„œ ๋ณต์žกํ•œ ์ž‘์—…์„ ์ž๋™์œผ๋กœ ์ˆ˜ํ–‰ํ•˜๋Š” AI ์—์ด์ „ํŠธ๋กœ ์ง„ํ™” ์ค‘
๐Ÿ’ก ๊ณ„์† ๊ณต๋ถ€ํ•˜๋ ค๋ฉด? โ€ข LlamaIndex ๊ณต์‹ ๋ฌธ์„œ ์ •๊ธฐ์ ์œผ๋กœ ์ฒดํฌ
โ€ข Hugging Face ์ปค๋ฎค๋‹ˆํ‹ฐ์—์„œ ์ตœ์‹  ๋ชจ๋ธ ํƒ์ƒ‰
โ€ข Reddit r/MachineLearning, r/LocalLLaMA ๊ตฌ๋…
โ€ข ์˜คํ”ˆ์†Œ์Šค ํ”„๋กœ์ ํŠธ์— ๊ธฐ์—ฌํ•˜๋ฉด์„œ ์‹ค๋ ฅ ํ–ฅ์ƒ
โ€ข ์žฌ๋Šฅ๋„ท ๊ฐ™์€ ํ”Œ๋žซํผ์—์„œ ์‹ค์ „ ๊ฒฝํ—˜ ์Œ“๊ธฐ!
๋ฏธ๋ž˜์˜ ๋ฌธ์„œ Q&A ์‹œ์Šคํ…œ ๐ŸŽฏ ์ •ํ™•๋„ 99% โšก ์‹ค์‹œ๊ฐ„ ์‘๋‹ต ๐ŸŒ ๋‹ค๊ตญ์–ด ์ง€์› ๐Ÿš€ ์ง€๊ธˆ ์‹œ์ž‘ํ•˜๋ฉด ๋ฏธ๋ž˜๋ฅผ ์„ ๋„ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค! AI ๊ธฐ์ˆ ์€ ๋น ๋ฅด๊ฒŒ ๋ฐœ์ „ํ•˜๊ณ  ์žˆ์–ด์š”. ์ง€๊ธˆ์ด ๋ฐฐ์šฐ๊ธฐ ๊ฐ€์žฅ ์ข‹์€ ์‹œ๊ธฐ์ž…๋‹ˆ๋‹ค.
๐ŸŽฌ ๋งˆ๋ฌด๋ฆฌํ•˜๋ฉฐ

์™€ ์—ฌ๊ธฐ๊นŒ์ง€ ์ฝ์œผ์…จ๋‹ค๋ฉด ์ •๋ง ๋Œ€๋‹จํ•˜์„ธ์š”! ๐Ÿ‘๐Ÿ‘๐Ÿ‘

Python๊ณผ LlamaIndex๋กœ ๋ฌธ์„œ ๊ธฐ๋ฐ˜ Q&A ์‹œ์Šคํ…œ ๋งŒ๋“œ๋Š” ๋ฐฉ๋ฒ•์„ ์ฒ˜์Œ๋ถ€ํ„ฐ ๋๊นŒ์ง€ ๋‹ค๋ค„๋ดค์–ด์š”. ๊ธฐ๋ณธ ๊ฐœ๋…๋ถ€ํ„ฐ ์‹œ์ž‘ํ•ด์„œ ์‹ค์ „ ๋ฐฐํฌ, ์ตœ์ ํ™”, ๊ณ ๊ธ‰ ๊ธฐ๋Šฅ๊นŒ์ง€ ์ •๋ง ๋งŽ์€ ๋‚ด์šฉ์„ ๋‹ด์•˜๋„ค์š” ใ…Žใ…Ž

์ฒ˜์Œ์—๋Š” ๋ณต์žกํ•ด ๋ณด์ผ ์ˆ˜ ์žˆ์ง€๋งŒ, ํ•˜๋‚˜์”ฉ ๋”ฐ๋ผํ•˜๋‹ค ๋ณด๋ฉด ์ƒ๊ฐ๋ณด๋‹ค ์–ด๋ ต์ง€ ์•Š์•„์š”! ์ค‘์š”ํ•œ ๊ฑด ์ง์ ‘ ํ•ด๋ณด๋Š” ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์ž‘์€ ํ”„๋กœ์ ํŠธ๋ถ€ํ„ฐ ์‹œ์ž‘ํ•ด์„œ ์ ์  ๊ธฐ๋Šฅ์„ ์ถ”๊ฐ€ํ•ด๋‚˜๊ฐ€์„ธ์š” ๐Ÿš€

์ด ๊ธฐ์ˆ ์€ ์ •๋ง ๋‹ค์–‘ํ•œ ๋ถ„์•ผ์— ์ ์šฉํ•  ์ˆ˜ ์žˆ์–ด์š”. ํšŒ์‚ฌ ์—…๋ฌด ์ž๋™ํ™”, ๊ณ ๊ฐ ์„œ๋น„์Šค, ๊ต์œก, ์˜๋ฃŒ, ๋ฒ•๋ฅ  ๋“ฑ๋“ฑ... ๊ฐ€๋Šฅ์„ฑ์€ ๋ฌด๊ถ๋ฌด์ง„ํ•ฉ๋‹ˆ๋‹ค! ๐Ÿ’ก

ํ˜น์‹œ ๋ง‰ํžˆ๋Š” ๋ถ€๋ถ„์ด ์žˆ๊ฑฐ๋‚˜ ๋” ๋ฐฐ์šฐ๊ณ  ์‹ถ์œผ์‹œ๋‹ค๋ฉด ์žฌ๋Šฅ๋„ท์—์„œ ๊ด€๋ จ ์ „๋ฌธ๊ฐ€๋“ค์„ ์ฐพ์•„๋ณด์„ธ์š”. ์‹ค์ „ ๊ฒฝํ—˜์ด ํ’๋ถ€ํ•œ ๋ถ„๋“คํ•œํ…Œ ๋ฐฐ์šฐ๋ฉด ํ›จ์”ฌ ๋น ๋ฅด๊ฒŒ ์„ฑ์žฅํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค ๐Ÿ˜Š

์—ฌ๋Ÿฌ๋ถ„๋„ ๋ฉ‹์ง„ AI ์‹œ์Šคํ…œ ๋งŒ๋“ค์–ด์„œ ์„ธ์ƒ์„ ๋” ํŽธ๋ฆฌํ•˜๊ฒŒ ๋งŒ๋“ค์–ด๋ณด์„ธ์š”! ํ™”์ดํŒ…์ž…๋‹ˆ๋‹ค ๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ

๐ŸŒŸ ํ•ต์‹ฌ ์š”์•ฝ ๐ŸŒŸ

โœ… LlamaIndex๋Š” ๋ฌธ์„œ ๊ธฐ๋ฐ˜ AI ์‹œ์Šคํ…œ ๊ตฌ์ถ•์„ ์‰ฝ๊ฒŒ ๋งŒ๋“ค์–ด์ค˜์š”
โœ… ๊ธฐ๋ณธ Q&A ์‹œ์Šคํ…œ์€ ๋ช‡ ์ค„์˜ ์ฝ”๋“œ๋กœ ๊ตฌํ˜„ ๊ฐ€๋Šฅ
โœ… ์ฒญํฌ ํฌ๊ธฐ, ์ž„๋ฒ ๋”ฉ ๋ชจ๋ธ, ๋ฒกํ„ฐ DB ๋“ฑ์œผ๋กœ ์ตœ์ ํ™”
โœ… ํ•˜์ด๋ธŒ๋ฆฌ๋“œ ๊ฒ€์ƒ‰, ๋Œ€ํ™” ๊ธฐ๋ก, ์†Œ์Šค ์ถ”์  ๋“ฑ ๊ณ ๊ธ‰ ๊ธฐ๋Šฅ ์ถ”๊ฐ€ ๊ฐ€๋Šฅ
โœ… FastAPI + Docker๋กœ ์‹ค์ „ ๋ฐฐํฌ
โœ… ์บ์‹ฑ๊ณผ ๋กœ์ปฌ ๋ชจ๋ธ๋กœ ๋น„์šฉ ์ ˆ๊ฐ
โœ… ๋‹ค์–‘ํ•œ ์‹ค์ „ ํ”„๋กœ์ ํŠธ์— ํ™œ์šฉ ๊ฐ€๋Šฅ
โœ… ๊ณ„์† ๋ฐœ์ „ํ•˜๋Š” ๋ถ„์•ผ๋‹ˆ๊นŒ ๊พธ์ค€ํžˆ ๊ณต๋ถ€ํ•˜์„ธ์š”!

ํ–‰๋ณตํ•œ ์ฝ”๋”ฉ ๋˜์„ธ์š”! ๐ŸŽ‰๐Ÿ’ปโœจ

๋Œ“๊ธ€ ์ž‘์„ฑ

์ด ๊ธ€์— ๋Œ€ํ•œ ์—ฌ๋Ÿฌ๋ถ„์˜ ์ƒ๊ฐ์„ ๋“ค๋ ค์ฃผ์„ธ์š”

๋Œ“๊ธ€ 0
๋Œ“๊ธ€์„ ๋ถˆ๋Ÿฌ์˜ค๋Š” ์ค‘์ž…๋‹ˆ๋‹ค.

์•„์ง ๋Œ“๊ธ€์ด ์—†์Šต๋‹ˆ๋‹ค.