Overview & Architecture

  • Stack: React + Vite frontend with lightweight Express middleware mounted in Vite dev. Workers handle chunking and heavy client-side tasks.
  • Data flow: Generate → Dataset → Judge → Close-the-loop. Uploads → Embeddings → (optional) Qdrant → Visualization. Transcribe can feed Embeddings/Vector DB.
  • Key modules: services/api.ts (LLM calls, chunking, embeddings, Qdrant), store/useAppStore.ts (state), components/*View.tsx (feature views), lib/ helpers (Qdrant client, text processing).
  • Background tasks: Web worker for chunking; Whisper.js runs in-browser; puppeteer/yt-dlp optional for YouTube fetch.
  • Backend routes (dev middleware): reverse-engineer (single/batch), YouTube audio fetch, website scrape.