Quickstart

1) Pozadavky

  • Python 3.11+
  • MySQL 8+
  • nainstalovane Python balicky (fastapi, uvicorn, torch, tokenizers, pymysql, requests)

2) Nastaveni prostredi

Minimalni env:

  • ENOAI_MYSQL_HOST
  • ENOAI_MYSQL_PORT
  • ENOAI_MYSQL_DB
  • ENOAI_MYSQL_USER
  • ENOAI_MYSQL_PASS
  • ENOAI_PASSWORD_PEPPER

Volitelne:

  • ENOAI_CHECKPOINT
  • ENOAI_TOKENIZER
  • ENOAI_MODEL_NAME
  • ENOAI_SYSTEM_PROMPT

3) Spusteni API

Z ai-runtime:


uvicorn server:app --host 0.0.0.0 --port 8000

Pri startupu se automaticky:

  • inicializuje DB schema
  • nacte model checkpoint

4) Health check


curl http://127.0.0.1:8000/health

5) Zakladni chat test


curl -X POST http://127.0.0.1:8000/chat \
  -H "Content-Type: application/json" \
  -d "{\"message\":\"Kdo jsi?\"}"