Quickstart
1) Pozadavky
- Python 3.11+
- MySQL 8+
- nainstalovane Python balicky (
fastapi,uvicorn,torch,tokenizers,pymysql,requests)
2) Nastaveni prostredi
Minimalni env:
ENOAI_MYSQL_HOSTENOAI_MYSQL_PORTENOAI_MYSQL_DBENOAI_MYSQL_USERENOAI_MYSQL_PASSENOAI_PASSWORD_PEPPER
Volitelne:
ENOAI_CHECKPOINTENOAI_TOKENIZERENOAI_MODEL_NAMEENOAI_SYSTEM_PROMPT
3) Spusteni API
Z ai-runtime:
uvicorn server:app --host 0.0.0.0 --port 8000
Pri startupu se automaticky:
- inicializuje DB schema
- nacte model checkpoint
4) Health check
curl http://127.0.0.1:8000/health
5) Zakladni chat test
curl -X POST http://127.0.0.1:8000/chat \
-H "Content-Type: application/json" \
-d "{\"message\":\"Kdo jsi?\"}"