Overview & Architecture
- Stack: React + Vite frontend with lightweight Express middleware mounted in Vite dev. Workers handle chunking and heavy client-side tasks.
- Data flow: Generate → Dataset → Judge → Close-the-loop. Uploads → Embeddings → (optional) Qdrant → Visualization. Transcribe can feed Embeddings/Vector DB.
- Key modules:
services/api.ts (LLM calls, chunking, embeddings, Qdrant), store/useAppStore.ts (state), components/*View.tsx (feature views), lib/ helpers (Qdrant client, text processing).
- Background tasks: Web worker for chunking; Whisper.js runs in-browser; puppeteer/yt-dlp optional for YouTube fetch.
- Backend routes (dev middleware): reverse-engineer (single/batch), YouTube audio fetch, website scrape.