feat(gmw): moderation explainability + semantic message search

- Persist structured verdict (flags/severity/confidence/evidence) on
  moderation_actions so the public web can show WHY a message was moderated.
- Add a persistent Qdrant archive collection (gmw_message_archive); embed
  every captured message at capture time (fire-and-forget, best-effort).
- Public semantic search over the archive (backend oRPC + FE toggle on the
  messages view). Both features are read-only/public and fully automatic.

Migration: 0015_add_moderation_explainability.sql

.hermes/plans/2026-08-13_gmw-frontend-greenfield.md

@@ -0,0 +1,418 @@
+# GMW Frontend — Greenfield Rebuild (Visual-System Overhaul + Custom UI + Motion/3D)
+
+> **For Hermes:** Execute with `subagent-driven-development` (one fresh subagent per task, two-stage review). Each task is 1–3 min, atomic, independently verifiable, committed after each. Reuse `src/lib/api/*`, `src/lib/ws/*`, `src/lib/types/*`, hooks verbatim. Never invent endpoints.
+
+**Goal:** Rebuild the GMW Discord-automod dashboard frontend from scratch — drop shadcn/ui + glass/teal/purple aesthetic entirely, replace with a custom, distinctive design system where every page has its own visual metaphor (no uniform bordered-card grid), and push the presentation layer with **Framer Motion (`motion`) choreography + signature Three.js scenes**. Re-integrate to the EXISTING backend API + WebSocket contract (do NOT touch the backend).
+
+**Architecture:** Next.js 16 App Router (SSR) + React 19 + TS strict + Tailwind v4. Keep the *plumbing* (data contract), rebuild the *skin + primitives + motion*. Each route = one self-contained `page.tsx` (server fetch + client view in the same file via a `"use client"` sibling export). Custom SVG charts (no recharts). Custom micro-primitives (no shadcn/base-ui). New token system in `globals.css`. **Motion:** `motion/react` app-wide for page transitions, spring micro-interactions, layout animation. **3D:** raw `three` (no react-three-fiber — leaner) in exactly TWO signature scenes, lazy-loaded client-only with graceful fallback. Deployed unchanged via existing flake + `gmw-proxy` nginx (`:4009` → Next `:4017`).
+
+**Tech Stack:** next@16, react@19, tailwindcss@4 (`@import "tailwindcss"`), `next/font/google` (Bricolage Grotesque + Inter + JetBrains Mono), `swr` (data revalidation), `lucide-react` (icons only), `motion` (Framer Motion successor — `motion/react`), `three` + `@types/three` (signature scenes only), `clsx` + `tailwind-merge`. **Removed:** `@shadcn/react`, `@base-ui/react`, `recharts`, `shadcn` CLI, `cmdk`, `sonner`, `react-day-picker`, `embla-carousel-react`, `react-resizable-panels`, `input-otp`, all 50 `components/ui/*`.
+
+---
+
+## 0. Design System (the creative core — read before coding)
+
+**Persona:** Controlled UX Designer + a tactical "ops console" voice. Material honesty: hierarchy via **scale/weight/tonal blocks**, NOT borders/shadows. Per `frontend-design` skill principle — spend the boldness in ONE signature place per page, keep the rest disciplined. Motion is choreography, not confetti: **one orchestrated moment per page**, everything else quiet.
+
+### Palette (warm, signal-driven — NO teal/cyan/purple/blue gradients)
+Light mode (`:root`):
+```
+--canvas:      oklch(0.96 0.012 80)    /* warm off-white, not cream */
+--surface:     oklch(0.92 0.014 80)    /* tonal block, replaces bordered card */
+--surface-2:   oklch(0.88 0.016 80)
+--ink:         oklch(0.22 0.02 70)     /* primary text */
+--ink-soft:    oklch(0.46 0.02 70)     /* secondary text */
+--hairline:    oklch(0.22 0.02 70 / 0.10)  /* structural rules ONLY, sparse */
+--signal:      oklch(0.78 0.17 125)    /* lime — OK / live / primary accent */
+--signal-ink:  oklch(0.20 0.03 70)     /* text ON signal */
+--amber:       oklch(0.80 0.15 70)     /* WARN */
+--vermilion:   oklch(0.62 0.21 25)     /* FLAGGED / destructive */
+--ring:        var(--signal)
+```
+Dark mode (`.dark`, default theme per `next-themes`):
+```
+--canvas:      oklch(0.13 0.015 70)    /* warm charcoal, not blue-black */
+--surface:     oklch(0.18 0.02 70)
+--surface-2:   oklch(0.23 0.022 70)
+--ink:         oklch(0.93 0.01 75)
+--ink-soft:    oklch(0.62 0.02 75)
+--hairline:    oklch(1 0 0 / 0.09)
+--signal:      oklch(0.88 0.18 125)
+--signal-ink:  oklch(0.18 0.03 70)
+--amber:       oklch(0.85 0.15 70)
+--vermilion:   oklch(0.68 0.21 25)
+```
+Three semantic signals reused everywhere: **lime = OK/live, amber = warn, vermilion = flag/danger**. This kills the purple-accent + teal-primary monotony.
+
+### Typography (3 roles, deliberate pairing — not "Inter everywhere")
+- **Display:** `Bricolage Grotesque` (700–800) — characterful grotesque for headers/big numbers.
+- **Body/UI:** `Inter` (400–600).
+- **Data/label:** `JetBrains Mono` (500/700) — all stats, timestamps, channel IDs, metrics.
+Load all three via `next/font/google` with CSS variables (keep current `--font-inter`/`--font-jetbrains-mono` names + add `--font-display`).
+
+### Layout & signature
+- **No `card` with border.** Use tonal `--surface` blocks with generous radius (`--r: 14px`) and internal padding; separate blocks with whitespace + sparse hairlines only where structurally meaningful.
+- **Signature element = "scan-tick":** a 1px animated pulse line (CSS keyframe `scan`) that marks every live/section header — NOT a card outline. Global canvas carries a faint warm dot-grid texture (low opacity) instead of the current bluish dotted radial-gradient.
+- **Nav = left "spine":** vertical rail of icon nodes joined by a hairline; active node gets a `--signal` dot + label reveal. Collapses to a bottom tab-bar < 768px (CSS only, no JS sidebar primitive).
+- **Header = "status bar":** connection state (WS dot), guild selector, live clock — mono font, reads like an instrument readout.
+
+## 0.1 Motion & 3D Layer (the "lebih kreatif" addition)
+
+### Motion rules (from `motion/react`)
+- **Page transitions:** one shared `RouteTransition` in `(dashboard)/layout.tsx` — `AnimatePresence mode="popLayout"` + `motion.div key={pathname}` (fade + 8px rise + slight blur-out, ~220ms, `easeOut`). Consistent everywhere, zero per-page boilerplate.
+- **Enter choreography (per page, ONE signature moment):** staggered rise-in for the hero/ticker group using `staggerChildren` variants; afterwards, quiet springs for hover/tap (`scale: 1.03` on interactive blocks, `whileTap` on buttons).
+- **Layout animation:** `layout` prop on list items (messages rows, recording rows, queue) so add/remove/filter reflows smoothly; `layoutId` for shared-element transitions (ticker → detail modal on dashboard).
+- **Live pulse:** `motion` drives the severity ticks / speaker rings with springs, not CSS `transition` alone.
+- **`useReducedMotion()`** (from `motion/react`) gates ALL heavy motion; CSS `@media (prefers-reduced-motion: reduce)` additionally kills `scan`/`spin-disc` keyframes. Accessibility floor, non-negotiable.
+- **No scroll-jacking, no marquee loops, no per-element confetti.** One moment per page. (`frontend-design` skill: "Satu momen orkestrasi biasanya lebih mengena daripada efek tersebar.")
+
+### 3D rules (raw `three`, no R3F — lean bundle)
+- Exactly **two** scenes, chosen because they carry real data meaning: **Dashboard hero** (`SignalField` — a particle field whose pulse density reflects live activity) and **Voice page** (`OrbField` — speakers as glowing orbs whose height/ring radius reacts to who is speaking). Everything else stays 2D/motion.
+- **Lazy + client-only:** `next/dynamic(() => import("./SignalField"), { ssr: false, loading: () => <StaticFallback/> })`. Three ships in its own chunk, loaded only on those two routes.
+- **WebGL guard:** if `!window.WebGLRenderingContext` or context creation fails → render the static SVG/CSS fallback (a stylized 2D version of the same visual). Never blank.
+- **Perf guardrails:** `dpr: [1, 1.75]`, `powerPreference: "high-performance"`, `antialias: true`; RAF loop paused on `document.hidden`; `dispose()` geometries/materials on unmount; particle count capped by `navigator.hardwareConcurrency` + viewport (`Math.min(900, w*h/2000)`).
+- **Style:** warm palette ONLY — signal-lime particles, amber/vermilion for flag/warn states; fog + soft additive blending for glow (no harsh white lights, no metallic PBR).
+- **Interactivity:** subtle pointer parallax (camera lerp toward cursor) + gentle idle rotation. No drag/drop, no raycasting menus.
+
+### Per-page metaphor (kills monotony — each page feels different)
+| Route | Metaphor | Signature visual | Motion / 3D |
+|---|---|---|---|
+| `/dashboard` | Live ops overview | **3D signal particle field** hero + asymmetric ticker blocks + radial moderation gauge | **3D SignalField** (reacts to activity), staggered ticker rise-in, gauge draws on mount |
+| `/messages` | Transcript | Left channel **timeline spine**; right = flowing message entries with left **severity tick** (no bordered cards); search = command palette | `layout` on message rows, spring severity ticks, palette types in |
+| `/voice` | Stage | **3D orb field** of speakers + equalizer rings; activity = horizontal **session ribbon** | **3D OrbField** (speaking → orb rises + ring pulses), session ribbon draws sequentially |
+| `/media` | Turntable | Rotating **disc** now-playing; queue = borderless list | CSS 3D disc spin (spring on play/pause), queue `layout` reflow, progress bar springs |
+| `/recordings` | Tape library | Rows with **waveform thumbnail** (custom SVG from duration) | Waveform bars spring on hover; new upload animates in (AnimatePresence) |
+| `/moderation` | Security log | Vertical **event flow** with status nodes (dot + line), not a table of cards | Nodes pulse on live action; timeline draws in sequence |
+| `/analysis` | Query console | Terminal-style search panel | Typing cursor + results stagger |
+
+---
+
+## 1. What to KEEP (reuse verbatim — correct + integrates to backend)
+- `src/lib/api/server.ts` — 11 server fetchers (`getDashboardStats`, `getActivity`, `getMediaStatus`, `getConfig`, `getModerationStats/Actions`, `getGuilds`, `getVoiceStatus`, `getRecordings`, `getMessages`). **No change.**
+- `src/lib/api/client.ts` — `apiRequest` + `ApiError`. **No change.**
+- `src/lib/ws/*` — `connection.ts`, `context.tsx`, `types.ts` (17 typed events: `message_created/updated/deleted/analyzed`, `voice_*`, `media_state`, `voice_pcm_data` binary). **No change.**
+- `src/lib/types/*` — all interfaces. **No change.**
+- `src/lib/format.ts`, `src/lib/utils.ts` (`cn`). **No change.**
+- `src/lib/navigation.ts` — `navItems`. Keep but extend icons/labels if needed.
+- Hooks: `src/hooks/*` (use-dashboard, use-media, use-messages, use-voice, use-moderation, use-recordings, use-guilds, use-config, use-chatbot-user, use-action, use-mobile), `src/lib/hooks/use-mounted.ts`. **Reuse** (verify no bad imports into deleted barrels).
+- Feature logic kept but **reskinned**: `src/components/media/music-player.tsx`, `src/components/voice/*`, `src/components/chatbot/*`, `src/components/messages/*`, `src/components/recordings/*`, `src/components/moderation/moderation-section.tsx`, `src/components/analysis/search-panel.tsx`, `src/components/dashboard/*` (charts → rewritten as custom SVG).
+
+## 2. What to DELETE
+- `src/components/ui/*` (all 50 shadcn primitives).
+- `components.json`, `@shadcn/react` + `@base-ui/react` + `shadcn` deps.
+- `recharts` (replace with custom SVG chart helpers in `src/components/charts/`).
+- `src/app/globals.css` → rewrite (no `@import "shadcn/tailwind.css"`, no `--color-primary` teal, no `.glass*`, no `.text-gradient`/`.gradient-border` teal/purple, no bluish body texture).
+- `src/components/layout/app-sidebar.tsx` (shadcn Sidebar) → replace with custom `Spine` nav.
+- All `page.tsx`+`view.tsx` pairs → merge into single `page.tsx` per route.
+
+## 3. What to BUILD (new)
+- New `globals.css` (tokens above + utilities + keyframes `scan`, `eq`, `fade-up`, `spin-disc`).
+- `src/components/primitives/` — minimal custom: `Button`, `Input`, `Select`, `Dialog`, `Tooltip`, `Badge`, `Progress`, `Avatar`, `Skeleton`, `Toast`, `Sheet`.
+- `src/components/motion/` — `RouteTransition.tsx`, `Stagger.tsx`, `variants.ts`.
+- `src/components/three/` — `SignalField.tsx`, `OrbField.tsx`, `WebGLGuard.tsx`, `StaticFallback.tsx`, `useThreeScene.ts`.
+- `src/components/charts/` — `Sparkline`, `AreaActivity`, `RadialGauge`, `SessionRibbon`, `Waveform`.
+- `src/components/layout/` — `Spine.tsx`, `StatusBar.tsx`, `ThemeToggle.tsx` (reskin).
+- 7 merged `page.tsx` files (one per route) implementing the metaphors above.
+- `src/app/layout.tsx` — root (fonts + ThemeProvider + Toaster), `src/app/(dashboard)/layout.tsx` — providers + Spine + StatusBar + RouteTransition + MiniPlayer + Chatbot, `src/app/page.tsx` → redirect `/dashboard`.
+
+---
+
+## 4. Target File & Folder Structure (authoritative)
+
+Everything below `services/frontend/src/` is the new tree. `REWRITE` replaces existing; `NEW` creates; `DELETE` removes. The `app/` route tree collapses `page.tsx`+`view.tsx` into single `page.tsx` files containing BOTH server fetch (default export) and client view (`"use client"` named export in same file).
+
+```
+services/frontend/
+├─ package.json                         REWRITE  (drop shadcn/base-ui/recharts; add motion, three, @types/three)
+├─ pnpm-workspace.yaml                  REWRITE  (onlyBuiltDependencies: keep build list minimal)
+├─ components.json                      DELETE   (shadcn registry config — no longer used)
+├─ next.config.ts                       KEEP     (output: standalone, trailingSlash, images.unoptimized)
+├─ tsconfig.json                        KEEP     (paths "@/*" → src/*, strict)
+├─ postcss.config.mjs                   KEEP     (@tailwindcss/postcss)
+├─ biome.json                           KEEP
+└─ src/
+   ├─ app/
+   │  ├─ layout.tsx                     REWRITE  (3 fonts + ThemeProvider + custom Toaster; rm sonner)
+   │  ├─ globals.css                    REWRITE  (new token system §0; rm glass/teal/purple)
+   │  ├─ page.tsx                       KEEP     (redirect → /dashboard/)
+   │  └─ (dashboard)/
+   │     ├─ layout.tsx                  REWRITE  (providers + Spine + StatusBar + RouteTransition + MiniPlayer + Chatbot; rm shadcn Sidebar)
+   │     ├─ dashboard/   page.tsx       REWRITE  (server fetch + <DashboardView/> client; 3D SignalField hero)
+   │     ├─ messages/    page.tsx       REWRITE  (server seeds + <MessagesView/>; spine + severity ticks)
+   │     ├─ voice/       page.tsx       REWRITE  (server seeds + <VoiceView/>; 3D OrbField hero)
+   │     ├─ media/       page.tsx       REWRITE  (server seeds + <MediaView/>; turntable disc)
+   │     ├─ recordings/  page.tsx       REWRITE  (server seeds + <RecordingsView/>; waveform rows)
+   │     ├─ moderation/  page.tsx       REWRITE  (server seeds + <ModerationView/>; event-flow)
+   │     └─ analysis/    page.tsx       REWRITE  (client <AnalysisView/>; query console)
+   ├─ components/
+   │  ├─ ui/                            DELETE   (all 50 shadcn primitives)
+   │  ├─ primitives/   NEW             (Button, Input, Select, Dialog, Tooltip, Badge, Progress, Avatar, Skeleton, Toast, Sheet, index.ts)
+   │  ├─ motion/       NEW             (variants.ts, Stagger.tsx, RouteTransition.tsx)
+   │  ├─ three/        NEW             (WebGLGuard, SignalField, OrbField, StaticFallback, useThreeScene)
+   │  ├─ charts/       NEW             (Sparkline, AreaActivity, RadialGauge, SessionRibbon, Waveform)
+   │  ├─ layout/       REWRITE         (Spine NEW, StatusBar NEW, ThemeToggle REWRITE, app-sidebar DELETE)
+   │  ├─ dashboard/    REWRITE         (stat-card DELETE; activity-chart/hourly/top-channels/moderation-donut/users/channels/reactions REWRITE)
+   │  ├─ messages/     REWRITE         (message-card DELETE; message-list/detail/detail-view/ai-status-badge/ai-analysis-panel/attachments-grid/lightbox/search-overlay REWRITE)
+   │  ├─ voice/        REWRITE         (voice-connection-card/connection-card/microphone-card DELETE; speaker-waveform/active-speakers-panel/activity-timeline/mic-control/listen-control REWRITE)
+   │  ├─ media/        REWRITE         (music-player, mini-player REWRITE)
+   │  ├─ recordings/   REWRITE         (recording-card DELETE; recording-player REWRITE)
+   │  ├─ moderation/   REWRITE         (moderation-section REWRITE)
+   │  ├─ analysis/     REWRITE         (search-panel REWRITE)
+   │  ├─ chatbot/      REWRITE         (chatbot-container, chat-panel REWRITE; chatbot-context, index KEEP)
+   │  └─ shared/       REWRITE         (empty-state, error-state, loading-skeleton, error-boundary, guild-selector REWRITE; index KEEP)
+   ├─ hooks/                           KEEP     (verify no bad imports)
+   ├─ lib/
+   │  ├─ api/          KEEP     (server.ts, client.ts, index.ts)
+   │  ├─ ws/           KEEP     (connection.ts, context.tsx, types.ts, ws-hook.ts)
+   │  ├─ types/        KEEP     (all interfaces)
+   │  ├─ hooks/        KEEP     (use-media-player.tsx, use-mounted.ts)
+   │  ├─ audio/        KEEP     (voice PCM decode helpers if present)
+   │  ├─ format.ts     KEEP
+   │  ├─ utils.ts      KEEP     (cn)
+   │  └─ navigation.ts KEEP
+   └─ (public assets)  KEEP
+```
+
+### 4.1 Single-file page pattern (mandatory)
+```tsx
+// server component (default export) — runs on the server, fetches initial data
+import { getX, getY } from "@/lib/api/server";
+import { XView } from "./page"; // self-import of the named client export
+
+export default async function Page() {
+  const [a, b] = await Promise.allSettled([getX(), getY()]);
+  return <XView initialA={a.status === "fulfilled" ? a.value : undefined}
+                  initialB={b.status === "fulfilled" ? b.value : undefined} />;
+}
+
+// client component (named export) — hydrated, takes initialData as SWR fallback
+"use client";
+export function XView({ initialA, initialB }: Props) {
+  const { data } = useX(initialA); // SWR fallbackData = initialA
+}
+```
+Self-referencing the named export keeps the file single-artifact while satisfying Next's RSC boundary (default = server, named = client). Tabs live inside `XView`.
+
+### 4.2 Import rules (lint gate)
+- No `@/components/ui/*` (deleted) — all UI via `@/components/primitives`.
+- `three` only imported inside `src/components/three/*`; pages import those via `next/dynamic({ ssr: false })`.
+- `motion` imported from `motion/react` only.
+- All data: `@/lib/api/server` (server) / `@/lib/api/client` (client) — never invented endpoints.
+
+---
+
+## TASKS (granular — every file is its own task)
+
+### PHASE 0 — Dependency surgery
+- **T0.1** Edit `package.json`: remove `dependencies["@base-ui/react"]`.
+- **T0.2** Remove `dependencies["@shadcn/react"]`.
+- **T0.3** Remove `dependencies["shadcn"]`.
+- **T0.4** Remove `dependencies["recharts"]`.
+- **T0.5** Remove `dependencies["cmdk"]`.
+- **T0.6** Remove `dependencies["sonner"]`.
+- **T0.7** Remove `dependencies["react-day-picker"]`.
+- **T0.8** Remove `dependencies["embla-carousel-react"]`.
+- **T0.9** Remove `dependencies["react-resizable-panels"]`.
+- **T0.10** Remove `dependencies["input-otp"]`.
+- **T0.11** Add `dependencies["motion"]: "^12.0.0"`, `dependencies["three"]: "^0.180.0"`, `devDependencies["@types/three"]: "^0.180.0"`.
+- **T0.12** `rm -f pnpm-lock.yaml && pnpm install` (regenerate lockfile).
+- **T0.13** Verify `pnpm ls recharts @shadcn/react @base-ui/react` → empty; `pnpm ls motion three @types/three` → present.
+- **T0.14** `cat pnpm-workspace.yaml`: confirm `onlyBuiltDependencies` keeps needed native builds, no broken shadcn postinstall.
+
+### PHASE 1 — Design tokens (globals.css)
+- **T1.1** Rewrite `@theme { }` head: light `:root` palette from §0 (canvas/surface/ink/ink-soft/hairline/signal/signal-ink/amber/vermilion/ring).
+- **T1.2** Add radius tokens `--r: 14px`, `--r-panel: 12px`, `--r-control: 8px`, `--r-pill: 9999px`.
+- **T1.3** Add `--font-display` token; keep `--font-sans`/`--font-mono`.
+- **T1.4** Add `.dark { }` override block with §0 dark values (warm charcoal).
+- **T1.5** Replace `@layer base body` bg: warm dot-grid `radial-gradient(oklch(0.45 0.03 70 / 0.05) 1px, transparent 1px)` + faint warm glow; remove old bluish radial layers.
+- **T1.6** Retint scrollbar thumb to warm `oklch(0.4 0.02 70 / 0.2)`; keep `::selection` signal-tinted.
+- **T1.7** Delete `.glass`, `.glass-elevated`, `.glass-intense`, `.dark .glass-intense` utilities.
+- **T1.8** Delete `.text-gradient` and `.gradient-border`.
+- **T1.9** Add `.surface` utility (bg var(--surface), radius var(--r), padding).
+- **T1.10** Add `.scan-tick` (1px animated pulse line, keyframe `scan`).
+- **T1.11** Add `.ticker`, `.pill`, `.mono` utilities.
+- **T1.12** Add keyframes `scan`, `eq`, `fade-up`, `spin-disc` (keep used existing ones if still referenced).
+- **T1.13** Add `@media (prefers-reduced-motion: reduce)` kill switch for scan/eq/spin-disc/pulse-ring/shimmer.
+- **T1.14** Remove `@import "shadcn/tailwind.css";` (line 3); verify nothing else depends on shadcn CSS vars.
+- **T1.15** Verify `grep -c "0.52 0.17 215\|0.55 0.2 280" src/app/globals.css` → `0`.
+- **T1.16** `pnpm biome check src/app/globals.css` → no errors.
+
+### PHASE 2 — Root layout + fonts
+- **T2.1** In `layout.tsx` add `Bricolage_Grotesque` (`variable: "--font-display"`, subsets `["latin"]`, `display: "swap"`).
+- **T2.2** Apply `inter.variable`, `jetbrainsMono.variable`, `bricolage.variable` to `<html>`.
+- **T2.3** Remove `import { Toaster } from "@/components/ui/sonner"`.
+- **T2.4** Comment out `<Toaster />` temporarily (re-enabled after T3.10).
+- **T2.5** Keep `suppressHydrationWarning`, `ThemeProvider` (defaultTheme dark, enableSystem false).
+- **T2.6** `npx tsc --noEmit` (fonts only; rest may still error until primitives exist).
+
+### PHASE 3 — Custom primitives (replace 50 shadcn ui)
+- **T3.1** `primitives/Button.tsx`: `motion.button`, variants `primary`/`ghost`/`danger`, `cn()` merge, `cursor-pointer`, `focus-visible:ring-2 ring-signal`, `whileTap` scale 0.97 gated by `useReducedMotion()`.
+- **T3.2** `primitives/Input.tsx`: native `<input>`, `bg-surface`, `rounded-[var(--r-control)]`, `mono` prop.
+- **T3.3** `primitives/Select.tsx`: native `<select>` styled, `bg-surface`.
+- **T3.4** `primitives/Dialog.tsx`: native `<dialog>` + `showModal()`, warm `::backdrop`, `AnimatePresence`, `onClose`.
+- **T3.5** `primitives/Tooltip.tsx`: CSS group-hover popover.
+- **T3.6** `primitives/Badge.tsx`: tonal pill, `variant` → `bg-{tone}/15 text-{tone}` (signal/amber/vermilion/neutral).
+- **T3.7** `primitives/Progress.tsx`: SVG track + `motion` fill, `value`/`max`, signal color.
+- **T3.8** `primitives/Avatar.tsx`: `<img>` + initials fallback, signal bg, size prop.
+- **T3.9** `primitives/Skeleton.tsx`: shimmer block (signal-tinted), `aria-hidden`.
+- **T3.10** `primitives/Toast.tsx`: `ToastProvider` context + portal, `useToast()`, motion slide-in, auto-dismiss.
+- **T3.11** `primitives/Sheet.tsx`: mobile drawer (`translate-x` spring), overlay, `open`/`onClose`.
+- **T3.12** `primitives/index.ts` re-export all 11.
+- **T3.13** Re-enable `<Toaster />` in `layout.tsx` (T2.4).
+- **T3.14** Verify `npx tsc --noEmit` on primitives; `grep -rl "@/components/ui/" src/components/primitives` → empty.
+
+### PHASE 4 — Motion foundation
+- **T4.1** `motion/variants.ts`: export `spring`, `ease`, `fadeUp`, `stagger` (per §0.1).
+- **T4.2** `motion/Stagger.tsx`: `StaggerGroup` + `StaggerItem` (`"use client"`).
+- **T4.3** `motion/RouteTransition.tsx`: `"use client"`, `usePathname`, `AnimatePresence mode="popLayout"`, reduced-motion fallback to plain `<div>`.
+- **T4.4** Verify `npx tsc --noEmit` on motion; `motion/react` import resolves.
+
+### PHASE 5 — Custom SVG charts (replace recharts)
+- **T5.1** `charts/Sparkline.tsx`: `<svg>` polyline from `points:number[]`, signal stroke, no axes.
+- **T5.2** `charts/AreaActivity.tsx`: filled `<path>` area, low-opacity signal gradient, `pathLength` draw gated by reduced-motion.
+- **T5.3** `charts/RadialGauge.tsx`: `<circle>` arc `stroke-dasharray`, center mono label.
+- **T5.4** `charts/SessionRibbon.tsx`: horizontal segments per speaker duration.
+- **T5.5** `charts/Waveform.tsx`: bars from deterministic seed, spring scaleY on hover.
+- **T5.6** Verify `npx tsc --noEmit` on charts; no `recharts` import.
+
+### PHASE 6 — Three.js foundation (lazy, guarded)
+- **T6.1** `three/WebGLGuard.tsx`: `"use client"`, detect webgl2/webgl, render `children` or `fallback`.
+- **T6.2** `three/useThreeScene.ts`: shared hook — renderer init (`dpr:[1,1.75]`, `powerPreference`), RAF with `document.hidden` pause, `dispose()` on unmount, resize observer.
+- **T6.3** `three/SignalField.tsx`: `Points` BufferGeometry (~min(900, w*h/2000)), additive blend, signal-lime, fog, idle rotation + sine drift, `activity` prop, pointer parallax. Uses `useThreeScene`.
+- **T6.4** `three/OrbField.tsx`: per-speaker `Sphere`, y-scale + ring lerp to speaking, tones signal/idle/vermilion.
+- **T6.5** `three/StaticFallback.tsx`: 2D SVG/CSS silhouette for both scenes.
+- **T6.6** Verify `grep -rl "from \"three\"" src | grep -v "components/three"` → empty; `npx tsc --noEmit` on three.
+
+### PHASE 7 — Layout shell
+- **T7.1** `layout/Spine.tsx`: `"use client"`, vertical rail from `navItems`, icon node + hairline, active signal dot + label reveal (motion spring), `max-md:` bottom tab-bar.
+- **T7.2** `layout/StatusBar.tsx`: `"use client"`, page title + WS status dot (motion pulse) + `GuildSelector` + live clock (mono) + `ThemeToggle`.
+- **T7.3** `layout/ThemeToggle.tsx`: restyle, keep `next-themes` logic, motion icon swap.
+- **T7.4** Rewrite `(dashboard)/layout.tsx`: keep SWRConfig/WsProvider/MediaPlayerProvider/ChatbotProvider + sync functions verbatim; swap `AppSidebar`→`Spine`, header→`StatusBar`, wrap children in `RouteTransition`; remove `SidebarInset`/`SidebarTrigger`/`Separator`; keep MiniPlayer+ChatbotContainer.
+- **T7.5** Delete `layout/app-sidebar.tsx`.
+- **T7.6** Verify `grep -rl "components/ui/sidebar\|app-sidebar" src` → empty; `npx tsc --noEmit`.
+
+### PHASE 8 — Dashboard page + components
+- **T8.1** Rewrite `dashboard/page.tsx`: default async `getDashboardStats`+`getActivity` → `<DashboardView>`; named `"use client"` view with useStats/useActivity, 3D hero + tickers + tabs.
+- **T8.2** Add `WebGLGuard`+`SignalField` hero with `activity` ratio; overlay headline (Bricolage) + `<RadialGauge>`.
+- **T8.3** Build asymmetric ticker row with `StaggerGroup` + 4 `.surface` blocks (mono number + label + `<Sparkline>`); inline (replaces stat-card).
+- **T8.4** Delete `dashboard/stat-card.tsx`.
+- **T8.5** Reskin `dashboard/activity-chart.tsx` → `charts/AreaActivity` (daily).
+- **T8.6** Reskin `dashboard/hourly-activity-chart.tsx` → `charts/AreaActivity` (hourly).
+- **T8.7** Reskin `dashboard/top-channels-chart.tsx` → `charts/` + `.surface`.
+- **T8.8** Reskin `dashboard/moderation-donut.tsx` → `charts/RadialGauge`.
+- **T8.9** Reskin `dashboard/users-section.tsx` → `.surface`.
+- **T8.10** Reskin `dashboard/channels-section.tsx` → `.surface`.
+- **T8.11** Reskin `dashboard/reactions-section.tsx` → `.surface`.
+- **T8.12** Verify `grep -rl "components/ui/card" src/app/\(dashboard\)/dashboard src/components/dashboard` → empty; `npx tsc --noEmit`.
+
+### PHASE 9 — Messages page + components
+- **T9.1** Rewrite `messages/page.tsx`: default `getMessages(guildId)`(+channels) → `<MessagesView>`; client spine + entries.
+- **T9.2** Delete `messages/message-card.tsx`.
+- **T9.3** Rewrite `messages/message-list.tsx`: left timeline spine + right severity-tick entries (`surface` + `border-l-2` lime/amber/vermilion, motion spring tick), `layout` reflow.
+- **T9.4** Rewrite `messages/message-detail.tsx` → `.surface`.
+- **T9.5** Rewrite `messages/message-detail-view.tsx` → `.surface` pane.
+- **T9.6** Rewrite `messages/ai-status-badge.tsx` → `primitives/Badge`.
+- **T9.7** Rewrite `messages/ai-analysis-panel.tsx` → `.surface`.
+- **T9.8** Rewrite `messages/attachments-grid.tsx` → `.surface` grid.
+- **T9.9** Rewrite `messages/lightbox.tsx` → `primitives/Dialog`.
+- **T9.10** Rewrite `messages/search-overlay.tsx` → console palette, type-in animation, `primitives/Dialog`.
+- **T9.11** Verify no `components/ui/card` in messages tree; `npx tsc --noEmit`.
+
+### PHASE 10 — Voice page + components
+- **T10.1** Rewrite `voice/page.tsx`: default `getVoiceStatus()` → `<VoiceView>`; client `WebGLGuard`+`OrbField` hero + ribbon + tabs.
+- **T10.2** Delete `voice/voice-connection-card.tsx`, `connection-card.tsx`, `microphone-card.tsx`.
+- **T10.3** Rewrite `voice/speaker-waveform.tsx` → SVG ring / eq bars.
+- **T10.4** Rewrite `voice/active-speakers-panel.tsx` → `.surface`.
+- **T10.5** Rewrite `voice/activity-timeline.tsx` → `charts/SessionRibbon`.
+- **T10.6** Rewrite `voice/mic-control.tsx` → `primitives/Button`.
+- **T10.7** Rewrite `voice/listen-control.tsx` → `primitives/Button`.
+- **T10.8** Verify `npx tsc --noEmit`; no `components/ui/card` in voice tree.
+
+### PHASE 11 — Media page + components
+- **T11.1** Rewrite `media/page.tsx`: default `getMediaStatus()` → `<MediaView>`; client turntable disc + transport + queue.
+- **T11.2** Rewrite `media/music-player.tsx`: CSS-3D disc (spin-disc, pause when not playing, spring on play/pause), mono meta, `primitives/Button` transport, `.surface` queue rows with `layout`.
+- **T11.3** Rewrite `media/mini-player.tsx` → compact `.surface`.
+- **T11.4** Verify `npx tsc --noEmit`; no `components/ui/card` in media tree.
+
+### PHASE 12 — Recordings page + components
+- **T12.1** Rewrite `recordings/page.tsx`: default `getRecordings(50)` → `<RecordingsView>`; client rows `AnimatePresence`+`layout`, live `voice_recording_uploaded` prepend.
+- **T12.2** Delete `recordings/recording-card.tsx`.
+- **T12.3** Rewrite `recordings/recording-player.tsx` → `.surface` row + `charts/Waveform` + `primitives/Button`/`Dialog` play/delete.
+- **T12.4** Verify `npx tsc --noEmit`.
+
+### PHASE 13 — Moderation + Analysis pages
+- **T13.1** Rewrite `moderation/page.tsx`: default `getModerationStats/Actions` → `<ModerationView>`; client vertical event-flow, live actions pulse-in.
+- **T13.2** Rewrite `moderation/moderation-section.tsx` → event-flow, no Card/table.
+- **T13.3** Rewrite `analysis/page.tsx`: client `<AnalysisView/>` terminal console (`primitives/Input` mono + blinking caret, `.surface` results staggered).
+- **T13.4** Rewrite `analysis/search-panel.tsx` → terminal style.
+- **T13.5** Verify `npx tsc --noEmit`.
+
+### PHASE 14 — Chatbot + shared + final cleanup
+- **T14.1** Rewrite `chatbot/chatbot-container.tsx` → `.surface`, keep drag/minimize.
+- **T14.2** Rewrite `chatbot/chat-panel.tsx` → bubbles via `AnimatePresence`, `primitives/*`.
+- **T14.3** Keep `chatbot/chatbot-context.tsx` + `index.ts`.
+- **T14.4** Rewrite `shared/empty-state.tsx` → tonal.
+- **T14.5** Rewrite `shared/error-state.tsx`.
+- **T14.6** Rewrite `shared/loading-skeleton.tsx` → `primitives/Skeleton`.
+- **T14.7** Rewrite `shared/error-boundary.tsx`.
+- **T14.8** Rewrite `shared/guild-selector.tsx` → `primitives/Select`.
+- **T14.9** `rm -rf src/components/ui && rm -f components.json`.
+- **T14.10** `grep -rn "components/ui/\|@shadcn\|@base-ui\|recharts" src` → MUST be empty.
+- **T14.11** `grep -rl "from \"recharts\"\|@base-ui\|@shadcn" src` → empty (double-check).
+- **T14.12** Verify `npx tsc --noEmit` across whole `src`.
+
+### PHASE 15 — Build + lint gate
+- **T15.1** `cd services/frontend && npx tsc --noEmit` → 0 errors.
+- **T15.2** `pnpm biome check` → fix all issues (no `any` in new files).
+- **T15.3** `pnpm build` (standalone) → success, emits `.next/standalone/server.js`.
+- **T15.4** Inspect `.next/static/chunks/` for three-heavy chunk loaded only on dashboard/voice; confirm NOT in `/dashboard/` initial SSR HTML.
+- **T15.5** Confirm `pnpm-lock.yaml` present (reproducible flake install).
+- **T15.6** `grep -c "0.52 0.17 215\|0.55 0.2 280" .next/static/css/*.css` → 0.
+
+### PHASE 16 — Local runtime smoke test (no prod)
+- **T16.1** Start local standalone: `GMW_BACKEND_URL=http://127.0.0.1:4001 PORT=4017 node .next/standalone/server.js &`.
+- **T16.2** `curl -s -o /dev/null -w "%{http_code}"` for all 7 routes → 200.
+- **T16.3** `curl /dashboard/ | grep -o "Bricolage\|signal\|surface"` → present.
+- **T16.4** `curl /_next/static/css/*.css | grep "0.52 0.17 215\|0.55 0.2 280"` → empty.
+- **T16.5** Headless browser `/dashboard/`+`/voice/` WebGL on: no console errors, `<canvas>` present, `<StaticFallback/>` NOT rendered.
+- **T16.6** Same pages WebGL off: `<StaticFallback/>` renders, no crash.
+- **T16.7** Kill local server. Do NOT touch prod unit.
+- **T16.8** Confirm 7 routes 200 + no console errors in T16.5/16.6.
+
+### PHASE 17 — Flake + staging deploy
+- **T17.1** Inspect `flake.nix` frontend drv: `filterSource` ignores `out/.next/node_modules`; `pnpm-lock.yaml` included.
+- **T17.2** `nix build .#gmw-frontend --impure --sandbox-off` → succeeds.
+- **T17.3** `nix copy` frontend drv to VPS into staging profile (test port e.g. 4217).
+- **T17.4** Create/adjust staging systemd unit with `PORT=4217` exported BEFORE `node server.js` (LIDM PORT bug).
+- **T17.5** `sudo systemctl restart gmw-frontend-staging`; `curl` staging → 200.
+- **T17.6** Browser-check staging `/dashboard/`+`/voice/` (3D visible, fallback test).
+- **T17.7** Verify staging CSS has no old teal/purple; new design renders.
+
+### PHASE 18 — Production swap (CONFIRM WITH USER FIRST)
+- **T18.1** STOP — send staging screenshots/URL; await explicit approval before touching prod.
+- **T18.2** On approval: `nix-env --profile /nix/var/nix/profiles/gmw-frontend --set <new-drv>`.
+- **T18.3** Confirm `gmw-frontend.service` exports `PORT=4017` before exec.
+- **T18.4** `sudo systemctl restart gmw-frontend`.
+- **T18.5** `curl` all 7 routes on `https://imphnen.asepharyana.my.id` → 200.
+- **T18.6** Browser verify prod: new design, old teal gone, 3D scenes render.
+- **T18.7** `journalctl -u gmw-frontend -f` 5 min; confirm WS reconnect + live features.
+- **T18.8** Notify user with before/after notes; keep rollback plan (`nix-env --set <previous>; systemctl restart`).
+
+---
+
+## Risks / Trade-offs
+- **Scope:** 7 pages + charts + primitives + motion + 2 three scenes + layout. Big but mechanical; each task is isolated (~90 atomic tasks).
+- **Bundle weight:** `three` adds ~150KB gz but ONLY on dashboard/voice routes (lazy chunk, `ssr:false`). `motion` ~35KB gz app-wide — acceptable.
+- **WebGL compatibility:** covered by `WebGLGuard` + static fallback. Old devices / strict privacy browsers never blank.
+- **Motion excess:** risk of "AI-generated" scattered animation. Guard: one signature moment per page, shared variants, reduced-motion gates.
+- **Feature regressions:** Voice PCM playback, media transport, chatbot drag — logic preserved, only skin changes. Smoke test (T16) catches SSR breaks; live WS/3D needs real backend (staging T17).
+- **Removed deps:** dropping `recharts`/`sonner`/`cmdk` means rewriting charts + toasts + search palette — accounted for in Phases 3/5/9.
+- **Next standalone PORT bug:** `server.js` may not read `PORT` — ensure unit exports `PORT=4017` before exec (T17.4/T18.3).
+- **three + React 19:** raw three avoids R3F compat surface; lifecycle (dispose + RAF) handled in T6.2.
+- **next-themes:** keep (light/dark toggle); default dark.
+
+## Open questions (answer before T18)
+- Q1: Deploy to prod now or staging-only first? (Recommend staging + screenshot review.)
+- Q2: Keep `react-day-picker`/`embla` if any page still needs them? (Plan assumes no — verify in T14.10 grep.)
+- Q3: Any brand name/wordmark change from "Discord Automod"? (Keep "Bete" identity unless told.)
+- Q4: 3D depth — full 3D scenes on dashboard+voice as specced, or also a 3D accent on media (disc)? (Default: dashboard+voice only; media disc stays CSS 3D.)

.hermes/plans/2026-08-18_gmw-explainability-semantic-search.md

@@ -0,0 +1,500 @@
+# GMW — Moderation Explainability (#1) + Semantic Search (#3) Implementation Plan
+
+> **For Hermes:** Use subagent-driven-development to implement task-by-task.
+> Hard constraint from user (2026-08-18): web is PUBLIC, read-only, for USERS not admins. Moderation MUST stay FULLY AUTOMATIC. Rules stay in CODE (no per-channel config UI).
+
+**Goal:** Make GMW transparent (users see why a message was moderated) and searchable (users can semantic-search the message corpus), via two fully-automatic, code-driven, read-only-public features.
+
+**Architecture:**
+- **#1 Explainability:** Persist the structured moderation verdict that already exists in `AnalysisResult` (`flags[]`, `categories[]`, `severity`, `confidence`, `evidence[]`) into new columns on `moderation_actions`, surface them through the existing public moderation oRPC + the existing public `moderation` dashboard view. No new behavior — only new *data* + new *read* paths.
+- **#3 Semantic Search:** Add a SECOND persistent Qdrant collection (`gmw_message_archive`) keyed by message id (NOT the TTL cache). Embed each captured text message at capture time (reuse `embedText`) and upsert. Add a public `messages.semanticSearch` oRPC + a read-only search UI on the public `messages` view. Best-effort / non-blocking — embed failures never affect moderation or capture.
+
+**Tech Stack:** TypeScript (discord-gateway + backend + frontend monorepo), Drizzle ORM + Postgres (PgBouncer on imrnes), Qdrant (100.121.180.82:6333), Next.js 16 App Router + shadcn/ui, oRPC over `/trpc`. pnpm. Deploy via GitHub Actions Nix build + `systemctl restart`.
+
+**Critical existing facts (verified in repo):**
+- `AnalysisResult` shape (`src/modules/ai-moderation/ai-analysis-worker.ts:55`): `messageId, status, flags[], categories[], severity, confidence, recommendedAction, score, analysis, correctedFlags?`. The shared `AnalysisResult` (`src/shared/moderation-types.ts:142`) ALSO has `evidence?: string[]` and `policyVersion?: string`. **THESE ARE ALREADY COMPUTED but only logged, never persisted to `moderation_actions`.**
+- `moderation_actions` schema is DEFINED TWICE with a divergence:
+  - `src/shared/database/schema.ts:638` → `pgModerationActionsTable` (authoritative, has `reset_nickname` in `action_type` enum).
+  - `src/shared/database/schema/messages.ts:25` → another `pgModerationActionsTable` (NO `reset_nickname`; gateway-local copy).
+  - The gateway's `ModerationActionsDb` (`src/modules/message-capture/moderationActionsDb.ts`) imports from `schema.ts` (the authoritative one). The `messages.ts` copy appears UNUSED for DB ops — but WE MUST ADD NEW COLUMNS TO BOTH to avoid type drift, OR confirm the `messages.ts` copy is dead and delete it. **Decision: add columns to `schema.ts` (authoritative) AND the `messages.ts` copy to keep `$inferInsert`/`$inferSelect` in sync (the gateway `ModerationAction` type flows from shared).** Verify with grep that `messages.ts` `pgModerationActionsTable` is not used by any `.insert()`/`.select()` at runtime before relying on it; if only re-exported, we still patch it for type-safety.
+- Migration mechanism: Drizzle-managed via `drizzle/migrations/*.sql` (journal `_journal.json`) applied by `runMigrations()` → `migratePostgres`. **New tables/columns must be added with `drizzle-kit generate` to produce a numbered `.sql` + journal entry**, OR (simpler, matches `0013_rename_*.sql` manual style) write a raw idempotent `.sql` under `drizzle/migrations/` AND register it in `_journal.json`. **Preferred here: use `pnpm drizzle-kit generate` so the journal stays consistent.** The legacy `src/shared/database/migrations/001_drop_unused_ai_columns.sql` is a PRE-drizzle manual script — do NOT follow that pattern.
+- **Historical lesson (MUST respect):** a prior migration (`0004_drop_unused_ai_columns.sql` = old `001_drop`) DELETED `ai_evidence`, `ai_policy_version`, `ai_moderation_raw` from `messages` with the note "written but never read". → Our new `moderation_actions` columns MUST be read (serializer + FE render). No write-only columns.
+- Embedding client: `embedText(text)` / `embedTexts(texts[])` in `src/modules/ai-moderation/embeddingClient.ts`. Returns `null` if `AI_LLM_EMBEDDING_MODEL` not configured. Reuses `config.AI_LLM_BASE_URL` + `config.AI_LLM_API_KEY`. OpenAI SDK v6 → `encoding_format: "float"` REQUIRED (Nvidia rejects base64).
+- Qdrant client: `src/modules/ai-moderation/qdrantClient.ts`. Has `ensureQdrantCollection(vectorSize)`, `upsertQdrantPoint(cacheKey, vector, payload)`, `searchQdrant(vector, limit, scoreThreshold)`. These are hardcoded to the cache collection name `config.QDRANT_COLLECTION ?? "gmw_text_moderation"`. **#3 needs a second collection** → generalize the client to accept a collection name param (add `ensureQdrantCollectionV2(name, size)` / `upsertQdrantPointV2(name, id, vector, payload)` / `searchQdrantV2(name, vector, limit, scoreThreshold)` OR refactor `collectionName()` to take an arg). Keep the cache path unchanged.
+- Capture hook: `captureMessage()` (`src/modules/message-capture/messageCapture.ts:201`) calls `messageStore.upsertMessageForCapture(messageRecord)` then (if not backlog) `queueMessageAnalysis`. **#3 embed must happen here**, async + fire-and-forget, after successful insert.
+- Public moderation view: `services/frontend/src/app/(dashboard)/moderation/view.tsx` renders `ActionRow` per action. The `ModerationAction` FE type is in `services/frontend/src/lib/types/moderation.ts` (NO new fields yet). The backend `moderationService.listActions` SQL is in `services/backend/src/modules/moderation/moderation.repository.ts:68` (raw SQL, selects fixed columns, joins `messages`).
+- oRPC wiring: `services/backend/src/orpc/router.ts` → `moderationRouter` (stats, actions) and `messagesRouter` (list, byChannel, getById, review, attachments). New procedures added here.
+
+---
+
+## TASK 1 — Schema: add explainability columns to `moderation_actions`
+
+**Objective:** Persist structured verdict on moderation actions so it can be surfaced (read) later.
+
+**Files:**
+- Modify: `services/discord-gateway/src/shared/database/schema.ts` (authoritative `pgModerationActionsTable`, ~line 638)
+- Modify: `services/discord-gateway/src/shared/database/schema/messages.ts` (`pgModerationActionsTable` copy, ~line 25) to keep type in sync
+- Create: `services/discord-gateway/drizzle/migrations/0015_add_moderation_explainability.sql`
+- Update: `services/discord-gateway/drizzle/migrations/meta/_journal.json` (add new entry)
+
+**Step 1: Add columns to both schema definitions**
+Add after `executed_at` in BOTH `pgModerationActionsTable` definitions:
+```ts
+    // ── Explainability (structured verdict, surfaced read-only to public web) ──
+    flags: pgText("flags"),            // JSON array of string flags, e.g. ["sara_agama","vulgar"]
+    categories: pgText("categories"), // JSON array of category strings
+    severity: pgText("severity", {
+      enum: ["none", "low", "medium", "high", "critical"],
+    }),
+    confidence: pgReal("confidence"),  // 0..1
+    score: pgReal("score"),            // 0..1 raw model score
+    evidence: pgText("evidence"),      // JSON array of short quoted snippets
+    policy_version: pgText("policy_version"), // rules.ts policy version string
+```
+Note: `flags`/`categories`/`evidence` stored as JSON-stringified TEXT (consistent with how `messages.ai_moderation_flags`/`ai_categories` are stored as TEXT elsewhere — confirm storage format in `updateMessageAIAnalysis`). Keep nullable.
+
+**Step 2: Generate/author the migration SQL**
+`0015_add_moderation_explainability.sql` (idempotent):
+```sql
+-- Add structured explainability columns to moderation_actions (read-only surfaced to public web).
+ALTER TABLE IF EXISTS "moderation_actions"
+  ADD COLUMN IF NOT EXISTS "flags" text,
+  ADD COLUMN IF NOT EXISTS "categories" text,
+  ADD COLUMN IF NOT EXISTS "severity" text
+    CHECK ("severity" IS NULL OR "severity" IN ('none','low','medium','high','critical')),
+  ADD COLUMN IF NOT EXISTS "confidence" real,
+  ADD COLUMN IF NOT EXISTS "score" real,
+  ADD COLUMN IF NOT EXISTS "evidence" text,
+  ADD COLUMN IF NOT EXISTS "policy_version" text;
+```
+Register in `_journal.json`: append an entry with `idx: 15`, a new unique `tag` (hash), `version`, `when` = Date.now(), `tag` short, `breakpoints: false`. Use `pnpm drizzle-kit generate` if possible to get a correct tag; otherwise hand-edit the journal carefully (copy an existing entry's shape).
+
+**Step 3: Type-check gateway**
+Run: `cd services/discord-gateway && pnpm typecheck`
+Expected: PASS (no new compile errors).
+
+**Step 4: Commit**
+```bash
+git add services/discord-gateway/src/shared/database/schema.ts \
+        services/discord-gateway/src/shared/database/schema/messages.ts \
+        services/discord-gateway/drizzle/migrations/0015_add_moderation_explainability.sql \
+        services/discord-gateway/drizzle/migrations/meta/_journal.json
+git commit -m "feat(db): add explainability columns to moderation_actions"
+```
+
+---
+
+## TASK 2 — Persist verdict at the auto-delete + command-handler call sites
+
+**Objective:** Populate the new columns from the already-computed `AnalysisResult` when a moderation action is logged. Fully automatic, no new behavior.
+
+**Files:**
+- Modify: `services/discord-gateway/src/modules/ai-moderation/autoDeleteManager.ts` (`logAutoDeleteAttempt` ~line 166, and the second `createModerationAction` call ~line 234 for nickname/mute paths)
+- Modify: `services/discord-gateway/src/modules/command-handler/moderation.handler.ts` (`createModerationAction` ~line 95)
+- Helper (create): `services/discord-gateway/src/modules/ai-moderation/verdictToActionFields.ts` — shared mapper so all 3 call sites stay DRY.
+
+**Step 1: Create the mapper helper**
+`verdictToActionFields.ts`:
+```ts
+import type { AnalysisResult } from "@/modules/ai-moderation/ai-analysis-worker";
+import type { ModerationActionInsert } from "@/shared/index"; // or inline shape
+
+/**
+ * Map a computed AI verdict into the explainability columns of a moderation
+ * action. Null-safe: missing fields stay null (e.g. manual admin actions have
+ * no AnalysisResult). This is read-only structured data — it does NOT change
+ * any enforcement decision.
+ */
+export function verdictToActionFields(result?: {
+  flags?: string[];
+  categories?: string[];
+  severity?: string;
+  confidence?: number;
+  score?: number;
+  evidence?: string[];
+  policyVersion?: string;
+}): {
+  flags: string | null;
+  categories: string | null;
+  severity: string | null;
+  confidence: number | null;
+  score: number | null;
+  evidence: string | null;
+  policy_version: string | null;
+} {
+  if (!result) {
+    return { flags: null, categories: null, severity: null, confidence: null,
+             score: null, evidence: null, policy_version: null };
+  }
+  const j = (v: unknown) => (v == null ? null : JSON.stringify(v));
+  return {
+    flags: j(result.flags),
+    categories: j(result.categories),
+    severity: result.severity ?? null,
+    confidence: result.confidence ?? null,
+    score: result.score ?? null,
+    evidence: j(result.evidence),
+    policy_version: result.policyVersion ?? null,
+  };
+}
+```
+
+**Step 2: Wire `logAutoDeleteAttempt`**
+Find the `createModerationAction({...})` in `logAutoDeleteAttempt` and spread the verdict fields:
+```ts
+await messageStore.createModerationAction({
+  message_id: message.id,
+  user_id: message.user_id,
+  guild_id: message.guild_id,
+  action_type: "delete_message",
+  reason: result.reason,
+  ...verdictToActionFields(result.analysisResult), // <-- pass the AnalysisResult through
+  executed_by: "auto-delete-manager",
+  status: ...,
+});
+```
+**IMPORTANT:** `result` here is `AutoDeleteResult` — verify it carries the `AnalysisResult` (or the verdict). If `AutoDeleteResult` does NOT carry the full `AnalysisResult`, trace where `attemptAutoDeleteFlaggedMessage` is called from and pass the `AnalysisResult` down (it is available in the analysis worker that triggered the delete). Confirm by reading `AutoDeleteResult` type + its producer. If the verdict is only available at the orchestrator level, add an optional `verdict?: AnalysisResult` field to `AutoDeleteResult` and populate it at the call site.
+
+**Step 3: Wire the second call site in `autoDeleteManager.ts`** (the mute/nickname path ~line 234) similarly, if it has an `AnalysisResult` available; otherwise leave fields null (manual-style action).
+
+**Step 4: Wire `moderation.handler.ts`** command path (~line 95) — pass `verdictToActionFields(verdict)` if the command handler has the `AnalysisResult` for the target message; otherwise nulls. Confirm what the handler receives.
+
+**Step 5: Type-check + lint**
+Run: `cd services/discord-gateway && pnpm typecheck && pnpm lint`
+Expected: PASS.
+
+**Step 6: Commit**
+```bash
+git add services/discord-gateway/src/modules/ai-moderation/verdictToActionFields.ts \
+        services/discord-gateway/src/modules/ai-moderation/autoDeleteManager.ts \
+        services/discord-gateway/src/modules/command-handler/moderation.handler.ts
+git commit -m "feat(mods): persist structured verdict into moderation_actions"
+```
+
+---
+
+## TASK 3 — Backend: surface explainability in `moderation.actions`
+
+**Objective:** Read the new columns in the public oRPC so the frontend can render them. (Read path — satisfies the "never write-only" rule.)
+
+**Files:**
+- Modify: `services/backend/src/modules/moderation/moderation.repository.ts` (`listActions` raw SQL ~line 68) — add new columns to SELECT + map.
+- Modify: `services/frontend/src/lib/types/moderation.ts` (`ModerationAction` interface) — add new fields.
+- Modify: `services/frontend/src/app/(dashboard)/moderation/view.tsx` (`ActionRow`) — render flags/categories badges + severity + confidence + evidence snippet.
+
+**Step 1: Extend backend SELECT**
+In `listActions`, add to the SELECT list: `a.flags, a.categories, a.severity, a.confidence, a.score, a.evidence, a.policy_version`. In the `.map(...)` add:
+```ts
+flags: r.flags ? safeJsonArray(String(r.flags)) : null,
+categories: r.categories ? safeJsonArray(String(r.categories)) : null,
+severity: r.severity ? String(r.severity) : null,
+confidence: r.confidence != null ? Number(r.confidence) : null,
+score: r.score != null ? Number(r.score) : null,
+evidence: r.evidence ? safeJsonArray(String(r.evidence)) : null,
+policy_version: r.policy_version ? String(r.policy_version) : null,
+```
+where `safeJsonArray(s)` = `JSON.parse(s)` wrapped in try/catch returning `[]` on failure (define a tiny local helper in the repository file).
+
+**Step 2: Extend FE type**
+In `services/frontend/src/lib/types/moderation.ts` `ModerationAction`:
+```ts
+  flags: string[] | null;
+  categories: string[] | null;
+  severity: "none" | "low" | "medium" | "high" | "critical" | null;
+  confidence: number | null;
+  score: number | null;
+  evidence: string[] | null;
+  policy_version: string | null;
+```
+
+**Step 3: Render in `ActionRow`**
+After the existing reason block, add (using existing `Badge` + `aiTone` from `@/lib/ai-status`):
+```tsx
+{a.severity && (
+  <Badge tone={aiTone(a.severity === "none" ? "clean" : a.severity)}>
+    {a.severity}
+  </Badge>
+)}
+{a.flags?.length ? (
+  <div className="mt-1 flex flex-wrap gap-1">
+    {a.flags.map((f) => <Badge key={f} tone="amber">{f}</Badge>)}
+  </div>
+) : null}
+{a.evidence?.length ? (
+  <div className="mt-1 text-xs text-ink-faint border-l-2 border-hairline pl-2">
+    “{a.evidence[0]}”
+  </div>
+) : null}
+{a.confidence != null && (
+  <div className="mono mt-0.5 text-[0.6rem] text-ink-faint">
+    conf {(a.confidence * 100).toFixed(0)}%
+  </div>
+)}
+```
+Keep `ActionRow` read-only. No admin controls.
+
+**Step 4: Type-check both services**
+Run: `cd services/backend && pnpm typecheck && pnpm lint` and `cd services/frontend && pnpm typecheck && pnpm lint`
+Expected: PASS.
+
+**Step 5: Commit**
+```bash
+git add services/backend/src/modules/moderation/moderation.repository.ts \
+        services/frontend/src/lib/types/moderation.ts \
+        services/frontend/src/app/\(dashboard\)/moderation/view.tsx
+git commit -m "feat(web): surface moderation explainability (flags/severity/evidence)"
+```
+
+---
+
+## TASK 4 — Qdrant client: support a second persistent collection
+
+**Objective:** Generalize the Qdrant client so #3 can use a dedicated archive collection without disturbing the automod cache.
+
+**Files:**
+- Modify: `services/discord-gateway/src/modules/ai-moderation/qdrantClient.ts`
+
+**Step 1: Add collection-aware variants**
+Refactor `collectionName()` to accept an optional name, and add V2 functions that take an explicit collection:
+```ts
+function collectionName(fallback = config.QDRANT_COLLECTION ?? "gmw_text_moderation"): string {
+  return fallback;
+}
+export const ARCHIVE_COLLECTION = config.QDRANT_ARCHIVE_COLLECTION ?? "gmw_message_archive";
+
+export async function ensureQdrantCollectionV2(name: string, vectorSize: number): Promise<boolean> {
+  // same body as ensureQdrantCollection but uses `name` instead of collectionName()
+}
+export async function upsertQdrantPointV2(
+  name: string, pointId: number, vector: number[], payload: QdrantVerdictPayload,
+): Promise<boolean> { /* PUT /collections/{name}/points with wait:true */ }
+export async function searchQdrantV2(
+  name: string, vector: number[], limit: number, scoreThreshold: number,
+): Promise<QdrantSearchHit[]> { /* POST /collections/{name}/points/search */ }
+```
+Keep all existing `ensureQdrantCollection` / `upsertQdrantPoint` / `searchQdrant` UNCHANGED (cache path). V2 functions mirror them with the `name` param. Reuse `request()` and the existing payload/score types.
+
+**Step 2: Type-check**
+Run: `cd services/discord-gateway && pnpm typecheck`
+Expected: PASS.
+
+**Step 3: Commit**
+```bash
+git add services/discord-gateway/src/modules/ai-moderation/qdrantClient.ts
+git commit -m "feat(qdrant): add collection-aware V2 upsert/search for archive"
+```
+
+---
+
+## TASK 5 — Capture-time embed + archive upsert
+
+**Objective:** Make every (non-backlog, text) captured message searchable in the persistent archive. Non-blocking / best-effort.
+
+**Files:**
+- Modify: `services/discord-gateway/src/modules/message-capture/messageCapture.ts` (`captureMessage` ~line 201)
+- Create: `services/discord-gateway/src/modules/message-capture/archiveEmbedder.ts` — wraps embed + upsert with fire-and-forget + rate-limit guard.
+
+**Step 1: Create `archiveEmbedder.ts`**
+```ts
+import { createChildLogger } from "@/shared/logger/index";
+import { embedText } from "@/modules/ai-moderation/embeddingClient";
+import { ARCHIVE_COLLECTION, ensureQdrantCollectionV2, upsertQdrantPointV2, qdrantPointId } from "@/modules/ai-moderation/qdrantClient";
+import { config } from "@/shared/config/config";
+
+const log = createChildLogger("archive-embedder");
+
+/**
+ * Fire-and-forget: embed a captured message and upsert into the persistent
+ * archive collection. Failures are swallowed — searching is a nice-to-have,
+ * never a precondition for capture or moderation.
+ */
+export function archiveMessageEmbedded(message: {
+  id: string; content: string; username: string; channel_id: string; guild_id: string; created_at: number;
+}): void {
+  if (!config.AI_LLM_EMBEDDING_MODEL) return; // embeddings disabled → skip
+  if (!message.content || message.content.trim().length < 3) return;
+  void (async () => {
+    try {
+      const vector = await embedText(message.content);
+      if (!vector) return;
+      const ok = await ensureQdrantCollectionV2(ARCHIVE_COLLECTION, vector.length);
+      if (!ok) return;
+      await upsertQdrantPointV2(ARCHIVE_COLLECTION, qdrantPointId(`archive:${message.id}`), vector, {
+        text: message.content.slice(0, 4000),
+        flags: "", // not a verdict payload; keep shape compatible
+        analyzed_at: Date.now(),
+        expires_at: Date.now() + 1000 * 60 * 60 * 24 * 365 * 5, // 5y persistent
+        content_hash: undefined,
+      });
+    } catch (err) {
+      log.debug({ messageId: message.id, error: err instanceof Error ? err.message : String(err) }, "archive embed skipped");
+    }
+  })();
+}
+```
+Payload type reuse: `QdrantVerdictPayload` has `text`, `flags`, `analyzed_at`, `expires_at`, `content_hash?`. For the archive we only need `text` + timestamps; set `flags: ""` (empty, ignored by search filter which keys on `expires_at`). **Acceptable:** the search path filters `expires_at >= now` — 5y window satisfies that.
+
+**Step 2: Call from `captureMessage`**
+In `captureMessage`, after `const inserted = await messageStore.upsertMessageForCapture(messageRecord); if (!inserted) return;` and BEFORE the backlog branch, add:
+```ts
+if (!isBacklog && messageRecord.content) {
+  archiveMessageEmbedded(messageRecord);
+}
+```
+(`messageRecord` is the `MessageRecord` from `buildMessageRecord`; confirm it carries `content`, `channel_id`, `guild_id`, `created_at`. It does — see `messagesCrud`/`types`.)
+
+**Step 3: Type-check + lint**
+Run: `cd services/discord-gateway && pnpm typecheck && pnpm lint`
+Expected: PASS.
+
+**Step 4: Commit**
+```bash
+git add services/discord-gateway/src/modules/message-capture/archiveEmbedder.ts \
+        services/discord-gateway/src/modules/message-capture/messageCapture.ts
+git commit -m "feat(archive): embed captured messages into persistent Qdrant archive"
+```
+
+---
+
+## TASK 6 — Backend: `messages.semanticSearch` oRPC
+
+**Objective:** Public, read-only semantic search over the message archive.
+
+**Files:**
+- Modify: `services/backend/src/modules/messages/messages.repository.ts` — add `semanticSearch(query, limit, guildId?)`.
+- Modify: `services/backend/src/modules/messages/messages.service.ts` — expose `semanticSearch`.
+- Modify: `services/backend/src/orpc/router.ts` — add `messages.semanticSearch` procedure.
+- Create (or reuse): an embedding call from the backend. The backend does NOT import the gateway's `embeddingClient`. **Decision:** add a minimal backend embed helper `services/backend/src/modules/messages/embed.ts` that calls the same OpenAI-compatible endpoint via `config` (reuse `config.AI_LLM_BASE_URL`/`AI_LLM_API_KEY`/`AI_LLM_EMBEDDING_MODEL` if present on the backend; if not configured, return a clear "search unavailable" error). Mirror `encoding_format: "float"`.
+- Modify: `services/backend/src/modules/messages/messages.schema.ts` — add `semanticSearchQuery` zod schema (limit, guildId?, query).
+
+**Step 1: Backend embed helper** (`embed.ts`)
+```ts
+import OpenAI from "openai";
+import { config } from "@/shared/config/index";
+import { createChildLogger } from "@/shared/logger/index";
+const log = createChildLogger("messages-embed");
+let client: OpenAI | null = null;
+function getClient() {
+  if (!config.AI_LLM_API_KEY || !config.AI_LLM_EMBEDDING_MODEL) return null;
+  if (!client) client = new OpenAI({ apiKey: config.AI_LLM_API_KEY, baseURL: config.AI_LLM_BASE_URL, maxRetries: 0, timeout: 30_000 });
+  return client;
+}
+export async function embedQuery(text: string): Promise<number[] | null> {
+  const c = getClient(); if (!c) return null;
+  try {
+    const r = await c.embeddings.create({ model: config.AI_LLM_EMBEDDING_MODEL as string, input: text, encoding_format: "float" });
+    return r.data[0].embedding;
+  } catch (e) { log.warn({ error: e instanceof Error ? e.message : String(e) }, "query embed failed"); return null; }
+}
+```
+
+**Step 2: Repository `semanticSearch`**
+```ts
+async semanticSearch(queryVector: number[], limit: number, guildId?: string) {
+  // Search archive collection, then join messages for text + channel.
+  const hits = await searchQdrantV2(ARCHIVE_COLLECTION, queryVector, limit, 0.6);
+  const ids = hits.map(h => h.cacheKey.replace("qdrant:", "")); // point id → we stored archive:<messageId>
+  // decode: qdrantPointId is a uint64; we need the original message id.
+  // SIMPLER: store message_id inside the payload too. → update archiveEmbedder payload to include `message_id`.
+  ...
+}
+```
+**REFINEMENT (important):** `qdrantPointId` is a hash, not reversible. So the archive payload MUST carry `message_id` (and `channel_id`, `guild_id`, `username`, `created_at`) so the backend can return full results without a reverse lookup. **Update `archiveEmbedder.ts` payload** to include those fields, and relax `QdrantVerdictPayload` (or create `QdrantArchivePayload`) to allow them. Then `semanticSearch` returns the payloads directly (already contain text + metadata) — no DB join needed, and it works even for deleted messages (archive keeps the text). Apply `guildId` filter client-side on the returned payloads.
+
+**Step 3: Service + router**
+`messages.service.ts`: `async semanticSearch(query: string, limit: number, guildId?: string)` → embed → `repository.semanticSearch`.
+`orpc/router.ts` under `messagesRouter`:
+```ts
+semanticSearch: os
+  .input(z.object({ query: z.string().min(1), limit: z.coerce.number().int().positive().max(50).default(10), guildId: z.string().optional() }))
+  .handler(async ({ input }) => {
+    const results = await messagesService.semanticSearch(input.query, input.limit, input.guildId);
+    return { results, nextCursor: null };
+  }),
+```
+
+**Step 4: Type-check + lint (backend)**
+Run: `cd services/backend && pnpm typecheck && pnpm lint`
+Expected: PASS.
+
+**Step 5: Commit**
+```bash
+git add services/backend/src/modules/messages/embed.ts \
+        services/backend/src/modules/messages/messages.repository.ts \
+        services/backend/src/modules/messages/messages.service.ts \
+        services/backend/src/modules/messages/messages.schema.ts \
+        services/backend/src/orpc/router.ts
+git commit -m "feat(api): public semantic message search over archive"
+```
+
+---
+
+## TASK 7 — Frontend: semantic search UI on `messages` view
+
+**Objective:** Public, read-only search box + results on the existing messages dashboard.
+
+**Files:**
+- Modify: `services/frontend/src/app/(dashboard)/messages/page.tsx` + `view.tsx` — add a search input (debounced) that calls a new `useMessagesSemanticSearch` hook → `messages.semanticSearch` oRPC, renders results as message cards (reuse `GlassPanel`/`Badge`/existing message row components).
+- Modify: `services/frontend/src/lib/types/message.ts` — add `SemanticSearchResult` + `SemanticSearchResponse` types.
+- Modify: `services/frontend/src/lib/api/client.ts` (or `server.ts`) — add `semanticSearch` fetcher/routers export if using oRPC client; if the FE uses raw fetch through the proxy, add a `POST /api/messages/semantic-search` or an oRPC client call consistent with existing `messages.*` calls (follow the EXISTING pattern in `src/lib/api/` — inspect how `messages.list` is called and replicate).
+
+**Step 1: Add FE types**
+```ts
+export interface SemanticSearchResult {
+  message_id: string;
+  content: string;
+  username: string;
+  channel_id: string;
+  guild_id: string;
+  created_at: number;
+  score: number;
+}
+export interface SemanticSearchResponse { results: SemanticSearchResult[]; nextCursor: string | null; }
+```
+
+**Step 2: Add hook + wire view**
+Follow the existing `use-moderation.ts` SWR pattern. Add `useMessagesSemanticSearch(query, guildId?)` returning `{ data, isLoading, error }`. In `messages/view.tsx`, add a search `Input` (from `@/components/primitives`) at the top, debounce ~300ms, and render results below the live list when a query is present. Reuse the message-row rendering already in that view (do not invent a new component).
+
+**Step 3: Type-check + lint (frontend)**
+Run: `cd services/frontend && pnpm typecheck && pnpm lint`
+Expected: PASS.
+
+**Step 4: Commit**
+```bash
+git add services/frontend/src/app/\(dashboard\)/messages/ \
+        services/frontend/src/lib/types/message.ts \
+        services/frontend/src/lib/api/ \
+        services/frontend/src/hooks/
+git commit -m "feat(web): public semantic message search UI"
+```
+
+---
+
+## TASK 8 — Build all services + deploy + verify
+
+1. `cd services/discord-gateway && pnpm typecheck && pnpm build && pnpm lint`
+2. `cd services/backend && pnpm typecheck && pnpm build && pnpm lint`
+3. `cd services/frontend && pnpm typecheck && pnpm build && pnpm lint`
+4. Commit any formatting fixes (biome `--unsafe` if import order), author `asepharyana`, NO Co-Authored-By.
+5. `git push origin main` → watch `gh run watch` on "Build & Deploy (Nix)".
+6. After deploy: verify `systemctl show gmw-discord-gateway.service --property=ActiveEnterTimestamp,SubState` reflects new timestamp; same for backend + frontend.
+7. Smoke: `curl -s http://127.0.0.1:4001/trpc/messages.semanticSearch?input=<urlencoded json>` OR via the public web `imphnen.asepharyana.my.id` messages page → type a query → expect results (after some messages have been embedded; embeddings only run on NEW captures post-deploy, so seed a few test messages or backfill).
+8. Moderation explainability: trigger/observe a flagged message → confirm `moderation_actions.flags` is populated (SQL `SELECT flags, severity FROM moderation_actions ORDER BY created_at DESC LIMIT 5;`) and the public moderation view shows badges.
+
+---
+
+## RISKS / TRADEOFFS / OPEN QUESTIONS
+- **Embedding cost:** #3 embeds EVERY captured message → more embedding API calls. Mitigated: only text ≥3 chars, fire-and-forget, skip if model unconfigured. If cost is a concern, batch embed (reuse `embedTexts`) per capture burst — but start simple (per-message) and observe.
+- **Backfill:** post-deploy, the archive is empty until new messages arrive. Optional follow-up: a one-off backfill script over existing `messages` (out of scope for this plan unless user asks).
+- **Schema duplication:** the `pgModerationActionsTable` double-definition must stay in sync (Task 1 patches both). If `messages.ts` copy is provably dead, a follow-up can delete it — but NOT in this plan (avoid scope creep / risk).
+- **`AutoDeleteResult` verdict availability (Task 2):** requires confirming the `AnalysisResult` is reachable at the `createModerationAction` call sites. If not, we add an optional field to `AutoDeleteResult` at the orchestrator call site. This is the highest-risk integration point — verify before assuming.
+- **Public exposure:** semantic search returns message text + usernames. This is INTENDED (web is public for users). No auth added. If a guild wants private, that is a future config (out of scope).
+- **Qdrant payload type:** reusing `QdrantVerdictPayload` for archive is slightly awkward (carries `flags`/`expires_at` semantics). Cleaner: introduce `QdrantArchivePayload` with `message_id`, `channel_id`, `guild_id`, `username`, `content`, `created_at`, `expires_at`. **Prefer the dedicated payload type in Task 4/5** to avoid confusion.
+
+## VERIFICATION CHECKLIST
+- [ ] `moderation_actions` has 7 new columns (DB + both schema defs).
+- [ ] A real auto-delete populates `flags`/`severity`/`evidence` (verified via SQL).
+- [ ] Public moderation view renders badges + evidence (manual browser check on imphnen.asepharyana.my.id/moderation).
+- [ ] New message capture upserts a point into `gmw_message_archive` (verify via Qdrant `/collections/gmw_message_archive/points/count`).
+- [ ] `messages.semanticSearch` returns relevant results for a known phrase.
+- [ ] All three services: typecheck + build + lint green; CI "Build & Deploy (Nix)" green; systemd timestamps updated.

biome.json

@@ -35,12 +35,15 @@
       "suspicious": {
         "noUnknownAtRules": "off",
         "useIterableCallbackReturn": "off",
-        "noArrayIndexKey": "warn"
+        "noArrayIndexKey": "off",
+        "noExplicitAny": "off"
       },
       "a11y": {
         "useSemanticElements": "off",
         "useButtonType": "off",
-        "noAutofocus": "off"
+        "noAutofocus": "off",
+        "useMediaCaption": "off",
+        "noStaticElementInteractions": "off"
       },
       "performance": {
         "noImgElement": "warn"
@@ -50,7 +53,10 @@
       },
       "correctness": {
         "noInvalidUseBeforeDeclaration": "off",
-        "noUnusedFunctionParameters": "warn"
+        "noUnusedFunctionParameters": "warn",
+        "noUnusedVariables": "warn",
+        "noUnusedImports": "warn",
+        "noUnusedPrivateClassMembers": "warn"
       }
     },
     "domains": {

flake.nix

@@ -11,11 +11,6 @@
       let
         pkgs = import nixpkgs { inherit system; };
 
-        # libdatachannel for the GoLive N-API binding. nixpkgs 0.24.1 is built
-        # against this host's glibc and ships both lib + dev headers, so the
-        # binding links cleanly inside the Nix sandbox (no manual cmake build).
-        libdatachannel = pkgs.libdatachannel;
-
         # Source filter: `path:` literals do NOT respect .gitignore by default,
         # so a dirty local out/ (stale chunks from previous builds) leaks into
         # the sandbox. Filter out build artifacts explicitly.
@@ -53,8 +48,8 @@
           export GIT_SSL_CAINFO=${pkgs.cacert}/etc/ssl/certs/ca-bundle.crt
           export NIX_SSL_CERT_FILE=${pkgs.cacert}/etc/ssl/certs/ca-bundle.crt
 
-          # pnpm uses node-gyp for native addons — provide build tools
-          export npm_config_build_from_source=true
+          # pnpm uses node-gyp for native addons — provide build tools (kept for
+          # the rare case a prebuilt is unavailable and it falls back to compile).
           export CPPFLAGS="-I${pkgs.lib.getDev pkgs.openssl}/include"
           export LDFLAGS="-L${pkgs.lib.getLib pkgs.openssl}/lib"
 
@@ -73,7 +68,7 @@
         # NOTE: do NOT use `pnpm install --prod` here — it collapses the
         # public-hoist dir (.pnpm/node_modules) that runtime peer resolution
         # relies on (e.g. @lng2004/node-datachannel and @seydx/node-av-linux-x64
-        # are only reachable through it), silently breaking voice/screenshare.
+        # are only reachable through it), silently breaking voice.
         # Instead we keep the full install's symlink layout and only prune
         # orphaned package dirs + broken symlinks.
         # Must run AFTER tsc (typescript is a devDep) and after native builds.
@@ -106,31 +101,8 @@
           buildPhase = pnpmInstall + ''
             echo "=== Compiling TypeScript ==="
             npx tsc 2>&1
-            echo "=== Fixing @/ path aliases to relative paths ==="
-            node -e "
-              const fs = require('fs');
-              const path = require('path');
-              let count = 0;
-              function walk(dir) {
-                if (!fs.existsSync(dir)) return;
-                for (const e of fs.readdirSync(dir, {withFileTypes: true})) {
-                  const p = path.join(dir, e.name);
-                  if (e.isDirectory()) walk(p);
-                  else if (e.name.endsWith('.js')) {
-                    const c = fs.readFileSync(p, 'utf8');
-                    const pat = /from\s+['\"]@\/([^'\"]+)['\"]/g;
-                    const n = c.replace(pat, (m, p1) => {
-                      const target = path.join('dist', p1) + '.js';
-                      const rel = path.relative(path.dirname(p), target);
-                      return 'from \"' + (rel.startsWith('.') ? rel : './' + rel) + '\"';
-                    });
-                    if (n !== c) { fs.writeFileSync(p, n); count++; }
-                  }
-                }
-              }
-              walk('dist');
-              console.log('Fixed ' + count + ' files');
-            "
+            echo "=== Fixing @/ path aliases + extensionless relative imports for node ESM ==="
+            node scripts/fix-imports.mjs
             echo "=== Build complete ==="
           '' + pruneProd;
 
@@ -167,8 +139,7 @@ WRAPPER
             pkgs.pkg-config
             pkgs.openssl
             pkgs.openssl.dev
-            libdatachannel.dev # rtc/rtc.hpp headers for the GoLive binding
-            pkgs.git # libdatachannel FetchContent clones from GitHub
+            pkgs.git # for any FetchContent-based deps during native builds
             pkgs.cacert
           ];
 
@@ -181,65 +152,35 @@ WRAPPER
           # do NOT let stdenv run its own cmake configure phase on the source.
           dontUseCmakeConfigure = true;
 
+          # The gateway bundles native node_modules (.node addons plus .o/.a
+          # object files left in prebuilt dirs). stdenv's fixupPhase walks
+          # $out/node_modules and runs patchELF + shrinkELF over every ELF it
+          # finds, choking on the non-ET_DYN files (.o/.a) and the prebuilt
+          # .node addons — emitting hundreds of harmless "patchelf: wrong ELF
+          # type" lines per build. The real binary is node (external, already
+          # RPATH-fixed in its own derivation) and the .node addons are
+          # self-contained prebuilts loaded via dlopen, so Nix's fixup pass is
+          # neither needed nor wanted here. Skip it entirely.
+          dontFixup = true;
+
           buildPhase = pnpmInstall + ''
             echo "=== Building native voice deps ==="
             # pnpm rebuild aborts on the first failing package and runs scripts
             # from the wrong cwd — build each native dep explicitly with its own
             # install script. Each failure is tolerated (|| true); the packages
-            # that matter (opus) are verified at runtime.
-            for pkg in \
-              node_modules/.pnpm/@discordjs+opus@*/node_modules/@discordjs/opus
-            do
-              if [ -d "$pkg" ]; then
-                echo "--- native build: $pkg ---"
-                (cd "$pkg" && npm run install 2>&1 || true)
-              fi
-            done
-            echo "=== Building libdatachannel-min N-API binding ==="
-            # The GoLive screen-share stack uses a minimal N-API binding
-            # (native/libdatachannel-min) over nixpkgs libdatachannel.
-            (
-              cd native/libdatachannel-min
-              # binding.gyp resolves include/lib from env (LDC_INCLUDE = .dev
-              # include root, LDC_LIB = lib output dir, NAPI_INCLUDE =
-              # node-addon-api include root).
-              NAPI_INCLUDE=$(find ../../node_modules/.pnpm -maxdepth 3 \
-                -type d -path "*node_modules/node-addon-api" | head -1)
-              echo "NAPI_INCLUDE=$NAPI_INCLUDE"
-              LDC_INCLUDE=${libdatachannel.dev} LDC_LIB=${libdatachannel.out}/lib/libdatachannel.so.0.24.1 \
-                NAPI_INCLUDE=$NAPI_INCLUDE \
-                npx node-gyp rebuild 2>&1 || true
-              ls -la build/Release/datachannel_min.node 2>/dev/null \
-                && echo "libdatachannel-min binding OK: $(stat -c%s build/Release/datachannel_min.node) bytes" \
-                || echo "WARN: libdatachannel-min binding build FAILED (screen share disabled)"
-            )
+            # @discordjs/opus ships prebuilt binaries for Node 22 (ABI node-v127,
+            # linux-x64-glibc-2.35) — node-pre-gyp downloads the prebuilt .node
+            # instead of compiling C++ from source. With build_from_source unset
+            # (above), `pnpm rebuild` runs the package's own install script which
+            # fetches the matching prebuilt; it only falls back to a source build
+            # if the download fails. This keeps voice working without a per-build
+            # native compile.
+            echo "=== Rebuilding @discordjs/opus (prebuilt download) ==="
+            pnpm rebuild @discordjs/opus 2>&1 || true
             echo "=== Compiling TypeScript ===="
             npx tsc 2>&1
-            echo "=== Fixing @/ path aliases to relative paths ==="
-            node -e "
-              const fs = require('fs');
-              const path = require('path');
-              let count = 0;
-              function walk(dir) {
-                if (!fs.existsSync(dir)) return;
-                for (const e of fs.readdirSync(dir, {withFileTypes: true})) {
-                  const p = path.join(dir, e.name);
-                  if (e.isDirectory()) walk(p);
-                  else if (e.name.endsWith('.js')) {
-                    const c = fs.readFileSync(p, 'utf8');
-                    const pat = /from\s+['\"]@\/([^'\"]+)['\"]/g;
-                    const n = c.replace(pat, (m, p1) => {
-                      const target = path.join('dist', p1) + '.js';
-                      const rel = path.relative(path.dirname(p), target);
-                      return 'from \"' + (rel.startsWith('.') ? rel : './' + rel) + '\"';
-                    });
-                    if (n !== c) { fs.writeFileSync(p, n); count++; }
-                  }
-                }
-              }
-              walk('dist');
-              console.log('Fixed ' + count + ' files');
-            "
+            echo "=== Fixing @/ path aliases + extensionless relative imports for node ESM ==="
+            node scripts/fix-imports.mjs
             echo "=== Build complete ==="
           '' + pruneProd;
 
@@ -247,22 +188,6 @@ WRAPPER
             mkdir -p $out/lib/gmw-discord-gateway
             cp -r dist node_modules package.json tsconfig.json $out/lib/gmw-discord-gateway/
 
-            # GoLive native binding — loadNative resolves it relative to
-            # dist/goLive/native.js, i.e. <root>/native/libdatachannel-min/
-            # build/Release/datachannel_min.node; libdatachannel .so must sit
-            # next to it and be on LD_LIBRARY_PATH at runtime.
-            mkdir -p $out/lib/gmw-discord-gateway/native/libdatachannel-min/build/Release
-            cp native/libdatachannel-min/build/Release/datachannel_min.node \
-              $out/lib/gmw-discord-gateway/native/libdatachannel-min/build/Release/ 2>/dev/null || true
-            mkdir -p $out/lib/gmw-discord-gateway/native/libdatachannel-min/build/ldc
-            cp -rL native/libdatachannel-min/build/ldc/libdatachannel.so* \
-              $out/lib/gmw-discord-gateway/native/libdatachannel-min/build/ldc/ 2>/dev/null || true
-            # If the binding failed to build, screen share is simply disabled —
-            # the gateway itself must still start.
-            if [ ! -f $out/lib/gmw-discord-gateway/native/libdatachannel-min/build/Release/datachannel_min.node ]; then
-              echo "WARN: datachannel_min.node missing — GoLive screen share disabled in this build"
-            fi
-
             # Also include drizzle migrations if they exist
             cp -r drizzle $out/lib/gmw-discord-gateway/ 2>/dev/null || true
 
@@ -271,7 +196,6 @@ WRAPPER
 #!${pkgs.runtimeShell}
 cd $out/lib/gmw-discord-gateway
 export PATH=${pkgs.ffmpeg-headless}/bin:${pkgs.yt-dlp}/bin:\$PATH
-export LD_LIBRARY_PATH=${libdatachannel.out}/lib:\$LD_LIBRARY_PATH
 exec ${nodejs}/bin/node dist/index.js
 WRAPPER
             chmod +x $out/bin/gmw-discord-gateway

infra/nix/nginx.conf.template

@@ -61,6 +61,25 @@ http {
       proxy_send_timeout 86400s;
     }
 
+    # ── Backend oRPC (structured data RPCs over WebSocket + HTTP POST)
+    #     Browser reaches this via partysocket (wss://…/trpc); SSR/RSC uses
+    #     the fetch RPCLink (POST /trpc). Same path, same backend handler:
+    #     oRPC's RPCHandler (HTTP) + ORPCWebSocketServer (WS) on :4001. ──
+    location ^~ /trpc {
+      proxy_pass http://gmw_backend$uri$is_args$args;
+      proxy_http_version 1.1;
+      # Upgrade headers required for the WebSocket transport; harmless for POST.
+      proxy_set_header Upgrade              $http_upgrade;
+      proxy_set_header Connection           $connection_upgrade;
+      proxy_set_header Host                 $host;
+      proxy_set_header X-Real-IP            $remote_addr;
+      proxy_set_header X-Forwarded-For      $proxy_add_x_forwarded_for;
+      proxy_set_header X-Forwarded-Proto    $scheme;
+      proxy_buffering off;
+      proxy_read_timeout 86400s;
+      proxy_send_timeout 86400s;
+    }
+
     # ── Next.js build assets — immutable, edge/shareable ───────────
     location ^~ /_next/static/ {
       proxy_pass http://gmw_next$uri$is_args$args;

scripts/add-ai-analysis-duration.sql

@@ -0,0 +1,10 @@
+-- Migration: add ai_analysis_duration_ms to messages
+-- Tracks how long the AI moderation LLM call took, per message (ms).
+-- Idempotent: safe to re-run.
+--
+-- Run against the production GMW database, e.g.:
+--   PGPASSWORD=*** psql -h 100.121.180.82 -p 6432 -U asephs -d dcbot \
+--     -f scripts/add-ai-analysis-duration.sql
+
+ALTER TABLE "messages"
+  ADD COLUMN IF NOT EXISTS "ai_analysis_duration_ms" BIGINT;

services/backend/package.json

@@ -15,6 +15,7 @@
   },
   "dependencies": {
     "@discordjs/voice": "^0.19.2",
+    "@orpc/server": "1.15.0",
     "axios": "^1.16.1",
     "dotenv": "^17.4.2",
     "drizzle-orm": "^0.45.2",
@@ -31,10 +32,10 @@
     "@biomejs/biome": "latest",
     "@types/express": "^5.0.6",
     "@types/node": "^25.9.0",
+    "@types/pg": "^8.20.0",
     "@types/ws": "^8.18.1",
     "tsx": "^4.22.2",
     "typescript": "^5.9.3",
-    "@types/pg": "^8.20.0",
     "vitest": "latest"
   }
 }

services/backend/scripts/fix-imports.mjs

@@ -0,0 +1,49 @@
+// Rewrite import specifiers in the compiled dist/ so the output runs under
+// plain `node dist/index.js` (native ESM, no bundler / no tsx).
+//
+// Background: tsconfig uses moduleResolution:"bundler", so `tsc` emits BARE
+// relative specifiers WITHOUT extensions (e.g. `import "./router"`) and leaves
+// the `@/*` path-alias imports untouched. Node's native ESM resolver rejects
+// extensionless relative specifiers and knows nothing about the `@/` alias, so
+// the emitted dist/ crashes at startup (`ERR_MODULE_NOT_FOUND`). This script
+// fixes both:
+//   1. `@/foo`            -> relative path to dist/foo.js
+//   2. `./foo` / `../foo` -> `./foo.js` / `../foo.js` (append .js)
+// Already-extensioned relative imports (.js/.json/.node/.mjs/.cjs) and bare
+// package specifiers are left untouched (idempotent).
+import { readFileSync, writeFileSync, existsSync, readdirSync } from "node:fs";
+import { join, relative, dirname } from "node:path";
+
+let count = 0;
+function walk(dir) {
+  if (!existsSync(dir)) return;
+  for (const e of readdirSync(dir, { withFileTypes: true })) {
+    const p = join(dir, e.name);
+    if (e.isDirectory()) walk(p);
+    else if (e.name.endsWith(".js")) {
+      const c = readFileSync(p, "utf8");
+      const pat = /from\s+['"]([^'"]+)['"]/g;
+      const n = c.replace(pat, (m, spec) => {
+        if (spec.startsWith("@/")) {
+          const target = join("dist", spec.slice(2)) + ".js";
+          let rel = relative(dirname(p), target);
+          if (!rel.startsWith(".")) rel = "./" + rel;
+          return `from "${rel}"`;
+        }
+        if (
+          (spec.startsWith("./") || spec.startsWith("../")) &&
+          !/\.(js|json|node|mjs|cjs)$/.test(spec)
+        ) {
+          return `from "${spec}.js"`;
+        }
+        return m;
+      });
+      if (n !== c) {
+        writeFileSync(p, n);
+        count++;
+      }
+    }
+  }
+}
+walk("dist");
+console.log(`Fixed ${count} import specifiers in dist/`);

services/backend/src/http/app.ts

@@ -1,3 +1,5 @@
+import { onError } from "@orpc/server";
+import { RPCHandler } from "@orpc/server/node";
 import express, {
   type Express,
   type NextFunction,
@@ -6,20 +8,17 @@ import express, {
 } from "express";
 import helmet from "helmet";
 import { createChildLogger } from "@/shared/logger/index";
-import { createAnalysisRouter } from "../modules/analysis/index.js";
-import { createChatbotRouter } from "../modules/chatbot/index.js";
-import { createConfigRouter } from "../modules/config/index.js";
-import { createDashboardRouter } from "../modules/dashboard/index.js";
 import { createHealthRouter } from "../modules/health/index.js";
-import { createMediaRouter } from "../modules/media/index.js";
-import { createMessagesRouter } from "../modules/messages/index.js";
-import { createModerationRouter } from "../modules/moderation/index.js";
-import { createRecordingsRouter } from "../modules/recordings/index.js";
-import { createUiStateRouter } from "../modules/ui-state/index.js";
-import { createVoiceRouter } from "../modules/voice/index.js";
+import { appRouter } from "../orpc/router";
 import { errorHandler } from "../shared/middlewares/index.js";
 
-// Auth removed — dashboard is public
+// Auth removed — dashboard is public.
+// All data APIs (dashboard, messages, moderation, media, voice, recordings,
+// analysis, chatbot, config, ui-state) now flow over oRPC, served on TWO
+// transports sharing the /trpc path:
+//   - WebSocket (browser live RPCs)  — see orpc/ws.ts
+//   - HTTP POST   (server-side / RSC fetch) — handled below
+// Only infra endpoints (health, prometheus metrics) remain plain HTTP.
 
 const logger = createChildLogger("http.app");
 
@@ -33,7 +32,7 @@ export function createHttpApp(): Express {
     }),
   );
 
-  // Body parsing
+  // Body parsing (still needed for any JSON POST; oRPC is WS/HTTP-based)
   app.use(express.json());
   app.use(express.urlencoded({ extended: true }));
 
@@ -59,24 +58,38 @@ export function createHttpApp(): Express {
     next();
   });
 
-  // All routes are public
+  // Infra-only HTTP endpoints
   app.use("/api", createHealthRouter());
-  app.use("/api", createConfigRouter());
-  app.use("/api", createDashboardRouter());
-  app.use("/api", createMessagesRouter());
-  app.use("/api", createAnalysisRouter());
-  app.use("/api", createChatbotRouter());
-  app.use("/api", createRecordingsRouter());
-  app.use("/api", createUiStateRouter());
-  app.use("/api", createMediaRouter());
-  app.use("/api", createVoiceRouter());
-  app.use("/api", createModerationRouter());
+
+  // oRPC over HTTP (server-side / RSC fetch). The same appRouter the browser
+  // reaches over the /trpc WebSocket. oRPC's node RPCHandler writes the full
+  // response itself; if no procedure matched we fall through to the 404 below.
+  const orpcHandler = new RPCHandler(appRouter, {
+    interceptors: [onError((error) => logger.error({ error }, "oRPC error"))],
+  });
+
+  app.use((req: Request, res: Response, next: NextFunction) => {
+    if (!req.path.startsWith("/trpc")) {
+      next();
+      return;
+    }
+    orpcHandler
+      .handle(req, res, { prefix: "/trpc", context: {} })
+      .then(({ matched }) => {
+        if (!matched) next();
+      })
+      .catch((err: unknown) => {
+        logger.error({ err }, "oRPC HTTP handler failed");
+        if (!res.headersSent) res.status(500).json({ error: "INTERNAL" });
+      });
+  });
 
   // 404 handler
   app.use((_req: Request, res: Response) => {
     res.status(404).json({
       error: "NOT_FOUND",
-      message: "Endpoint not found",
+      message:
+        "Endpoint not found — data APIs are served over /trpc (WebSocket/HTTP)",
     });
   });
 

services/backend/src/http/server.ts

@@ -1,5 +1,6 @@
 import { createServer, type Server } from "node:http";
 import { createChildLogger } from "@/shared/logger/index";
+import { createORPCWebSocketServer } from "../orpc/ws.js";
 import { config } from "../shared/config/index.js";
 import { initializeDatabase } from "../shared/database/index.js";
 import { startRedisBridge } from "../ws/redis-bridge.js";
@@ -16,8 +17,9 @@ export async function startHttpServer(): Promise<Server> {
 
   const server = createServer(app);
 
-  // Attach WebSocket server to the same HTTP server
-  createWebSocketServer(server);
+  // Attach WebSocket servers to the same HTTP server
+  createWebSocketServer(server); // /ws — voice PCM + gateway events
+  createORPCWebSocketServer(server); // /trpc — structured data RPCs
 
   // Start Redis pub/sub bridge to forward discord-gateway events to WS clients
   await startRedisBridge();

services/backend/src/modules/analysis/analysis.routes.ts

@@ -1,27 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { analysisService } from "./analysis.service.js";
-
-const logger = createChildLogger("analysis.routes");
-
-export function createAnalysisRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/analysis/search
-  router.get(
-    "/analysis/search",
-    asyncHandler(async (req: Request, res: Response) => {
-      const q = (req.query.q as string) || "";
-      const channelId = (req.query.channelId as string) || undefined;
-      const limit = Number(req.query.limit) || 20;
-
-      logger.debug({ q, channelId, limit }, "Analysis search requested");
-      const result = await analysisService.search({ q, channelId, limit });
-      res.json(result);
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/analysis/index.ts

@@ -1 +0,0 @@
-export { createAnalysisRouter } from "./analysis.routes.js";

services/backend/src/modules/chatbot/chatbot.controller.ts

@@ -1,96 +0,0 @@
-import type { Request, Response } from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { chatbotService } from "./chatbot.service.js";
-
-const logger = createChildLogger("chatbot.controller");
-
-interface AuthenticatedRequest extends Request {
-  userId?: string;
-}
-
-/**
- * Resolve the actor id for a request. Frontend (no-login) sends a per-device
- * UUID via X-User-Id so chat history stays isolated per visitor; a registered
- * auth middleware userId takes precedence when present.
- */
-function resolveUserId(req: Request): string {
-  const authId = (req as AuthenticatedRequest).userId;
-  if (authId) return authId;
-  const header = (req.headers["x-user-id"] as string | undefined)?.trim();
-  return header || "anonymous";
-}
-
-export const handleChatbotChat = asyncHandler(
-  async (req: Request, res: Response) => {
-    const { message, context } = req.body as {
-      message: string;
-      context?: Record<string, unknown>;
-    };
-
-    // Validate required fields
-    if (!message || typeof message !== "string") {
-      return res.status(400).json({
-        error: "INVALID_INPUT",
-        message: "Message is required and must be a string",
-      });
-    }
-
-    // Get user ID from X-User-Id header (no-login device uuid) or auth
-    const userId = resolveUserId(req);
-
-    logger.debug(
-      { userId, messageLength: message.length, context },
-      "Received chatbot chat message",
-    );
-
-    // Process message & generate response
-    const response = await chatbotService.processMessage(
-      message,
-      context,
-      userId,
-    );
-
-    // Save conversation to database
-    await chatbotService.saveConversation({
-      userId,
-      userMessage: message,
-      botResponse: response,
-      context,
-      timestamp: new Date(),
-    });
-
-    logger.info({ userId }, "Chatbot chat processed successfully");
-
-    res.status(200).json({
-      response,
-      timestamp: new Date().toISOString(),
-    });
-  },
-);
-
-export const getChatbotHistory = asyncHandler(
-  async (req: Request, res: Response) => {
-    const userId = resolveUserId(req);
-    const limit = Math.min(parseInt(req.query.limit as string, 10) || 50, 100);
-
-    const history = await chatbotService.getChatHistory(userId, limit);
-
-    res.status(200).json({
-      history,
-      total: history.length,
-    });
-  },
-);
-
-export const clearChatbotHistory = asyncHandler(
-  async (req: Request, res: Response) => {
-    const userId = resolveUserId(req);
-
-    await chatbotService.clearChatHistory(userId);
-
-    res.status(200).json({
-      message: "Chat history cleared successfully",
-    });
-  },
-);

services/backend/src/modules/chatbot/chatbot.repository.ts

@@ -1,6 +1,6 @@
-import { and, desc, eq, type SQL, sql } from "drizzle-orm";
+import { desc, eq } from "drizzle-orm";
 import { getDatabase } from "../../shared/database/index.js";
-import { pgChatbotMessagesTable, pgMessagesTable } from "../../shared/index.js";
+import { pgChatbotMessagesTable } from "../../shared/index.js";
 import { createChildLogger } from "../../shared/logger/index.js";
 
 const logger = createChildLogger("chatbot.repository");
@@ -31,13 +31,6 @@ export interface ChatbotHistoryRow {
   created_at: string;
 }
 
-export interface ServerInsights {
-  total_messages: number;
-  active_users: number;
-  flagged: number;
-  warned: number;
-}
-
 export class ChatbotRepository {
   async saveConversation(input: SaveConversationInput): Promise<void> {
     const db = getDatabase();
@@ -83,56 +76,6 @@ export class ChatbotRepository {
       "Chat history cleared",
     );
   }
-
-  async getServerInsights(
-    guildId?: string,
-    channelId?: string,
-  ): Promise<ServerInsights> {
-    try {
-      const db = getDatabase();
-      const conditions: SQL[] = [];
-
-      if (guildId) {
-        conditions.push(eq(pgMessagesTable.guild_id, guildId));
-      }
-      if (channelId) {
-        conditions.push(eq(pgMessagesTable.channel_id, channelId));
-      }
-
-      const where = conditions.length > 0 ? and(...conditions) : undefined;
-
-      const [result] = await db
-        .select({
-          total_messages: sql<number>`COUNT(*)::int`,
-          active_users: sql<number>`COUNT(DISTINCT ${pgMessagesTable.user_id})::int`,
-          flagged: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'flagged')::int`,
-          warned: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'warn')::int`,
-        })
-        .from(pgMessagesTable)
-        .where(where);
-
-      const insights = result ?? {
-        total_messages: 0,
-        active_users: 0,
-        flagged: 0,
-        warned: 0,
-      };
-
-      logger.debug({ guildId, channelId, insights }, "Server insights fetched");
-      return insights;
-    } catch (error) {
-      logger.warn(
-        { error, guildId, channelId },
-        "Failed to load server insights",
-      );
-      return {
-        total_messages: 0,
-        active_users: 0,
-        flagged: 0,
-        warned: 0,
-      };
-    }
-  }
 }
 
 export const chatbotRepository = new ChatbotRepository();

services/backend/src/modules/chatbot/chatbot.routes.ts

@@ -1,18 +0,0 @@
-import express, { type Router } from "express";
-import { validateBody } from "../../shared/middlewares/index.js";
-import {
-  clearChatbotHistory,
-  getChatbotHistory,
-  handleChatbotChat,
-} from "./chatbot.controller.js";
-import { chatRequestSchema } from "./chatbot.schema.js";
-
-export function createChatbotRouter(): Router {
-  const router = express.Router();
-
-  router.post("/chat", validateBody(chatRequestSchema), handleChatbotChat);
-  router.get("/chat/history", getChatbotHistory);
-  router.delete("/chat/history", clearChatbotHistory);
-
-  return router;
-}

services/backend/src/modules/chatbot/chatbot.service.ts

@@ -6,7 +6,8 @@ import type {
   SaveConversationInput,
 } from "./chatbot.repository.js";
 import { chatbotRepository } from "./chatbot.repository.js";
-import { executeTool, tools } from "./chatbot.tools.js";
+import { tools } from "./chatbot.toolDefs.js";
+import { executeTool } from "./chatbot.tools.js";
 
 const logger = createChildLogger("chatbot.service");
 
@@ -17,22 +18,26 @@ class ChatbotService {
     userId: string,
   ): Promise<string> {
     logger.info(
-      { userId, messageLength: message.length },
+      { userId, messageLength: message.length, context },
       "processMessage called",
     );
     const recentContext = await this.getRecentConversationContext(userId);
-    const serverInsights = await chatbotRepository.getServerInsights(
-      context?.guildId,
-      context?.channelId,
-    );
+    // Scope the agent to the server/channel the user is chatting in. We no
+    // longer bake server stats into the prompt — the model must pull current
+    // data via tools (see buildSystemPrompt), so it always answers from live
+    // numbers instead of a stale snapshot.
+    const scope = {
+      guildId: context?.guildId,
+      channelId: context?.channelId,
+    };
 
-    // Build LLM messages
-    const systemPrompt = this.buildSystemPrompt(serverInsights);
+    const systemPrompt = this.buildSystemPrompt(scope);
     const conversationHistory = this.buildHistoryMessages(recentContext);
     const llmResponse = await this.callLLM(
       systemPrompt,
       conversationHistory,
       message,
+      scope,
     );
 
     return llmResponse;
@@ -66,27 +71,29 @@ class ChatbotService {
     ]);
   }
 
-  private buildSystemPrompt(insights: {
-    total_messages: number;
-    active_users: number;
-    flagged: number;
-    warned: number;
+  private buildSystemPrompt(scope: {
+    guildId?: string;
+    channelId?: string;
   }): string {
-    return `Kamu lagi ngobrol sama chatbot Discord Watcher — temen ngobrol yang tau keadaan server.
+    const scopeLine = scope.guildId
+      ? `- Scope: kamu menjawab soal server/guild id="${scope.guildId}"${scope.channelId ? `, channel id="${scope.channelId}"` : ""}.`
+      : "- Scope: tidak ada guild spesifik — jawab umum soal server ini.";
+    return `Kamu adalah chatbot Discord Watcher — temen ngobrol yang tau keadaan server, dan kamu PUNYA AKSES ke data server lewat tools.
 
-Data server saat ini:
-- Pesan: ${insights.total_messages}
-- User aktif: ${insights.active_users}
-- Flagged: ${insights.flagged}
-- Warning: ${insights.warned}
+${scopeLine}
+
+ATURAN PENTING — JANGAN PAKAI KONTEKS STATIS:
+- Kamu TIDAK punya hafalan soal angka server (jumlah pesan, user aktif, flagged, dll). JANGAN tebak atau karang angka.
+- Untuk SEMUA pertanyaan soal data server (jumlah pesan, user aktif, channel ramai, aktivitas terbaru, pesan di-flag), WAJIB panggil tool yang sesuai (get_server_stats, get_top_channels, get_recent_activity, get_top_flagged). Jawab HANYA dari hasil tool.
+- Tool otomatis di-scope ke guild/channel di atas — kalau argumen guildId/channelId kosong, biarkan kosong (sudah otomatis ter-isi). Jangan isi ID yang kamu tebak.
+- Kalau tool balas error atau kosong, bilang aja data lagi ga ketemu, jangan karang.
 
 Gaya ngobrol:
 - Santai, hangat, kayak ngobrol sama temen
 - Pake Bahasa Indonesia sehari-hari, ga perlu kaku
 - Sesekali pake emoji wajar aja, ga berlebihan
-- Kalo ditanya sesuatu yang kamu tau dari data server, jawab pake data itu
-- Kalo ga tau atau ga nyambung, bilang aja terus tanya balik biar ngobrolnya jalan
-- Jangan sebut "rule", "instruksi", "prompt" atau apapun soal cara kamu berpikir
+- Kalo ditanya di luar data server dan kamu ga tau, bilang aja terus tanya balik biar ngobrolnya jalan
+- Jangan sebut "rule", "instruksi", "prompt", "tool", atau apapun soal cara kamu berpikir
 - Biasa aja, ga usaha lucu-lucu amat — natural`;
   }
 
@@ -106,6 +113,7 @@ Gaya ngobrol:
     systemPrompt: string,
     history: Array<{ role: "user" | "assistant"; content: string }>,
     userMessage: string,
+    scope: { guildId?: string; channelId?: string },
   ): Promise<string> {
     const apiKey = config.AI_LLM_API_KEY;
     const baseUrl = config.AI_LLM_BASE_URL;
@@ -150,7 +158,13 @@ Gaya ngobrol:
             tool_choice: "auto",
             max_tokens: 600,
             temperature: 0.4,
-            stream: true,
+            // Non-streaming: request a single complete response. 9router may
+            // still emit SSE even with stream:false, so the parser below
+            // handle both raw-JSON and SSE bodies.
+            stream: false,
+            // Disable extended thinking / reasoning tokens so the bot answers
+            // directly (ignored by non-reasoning models).
+            reasoning_effort: "none",
           },
           {
             headers: {
@@ -158,14 +172,16 @@ Gaya ngobrol:
               "Content-Type": "application/json",
             },
             timeout: 45_000,
-            // 9router returns SSE even without stream:true; force stream:true
-            // in the body and read the raw SSE text.
             responseType: "text",
           },
         );
 
-        // Parse SSE `data:` lines → content + tool_calls.
-        const { content, toolCalls } = this.parseSse(response.data as string);
+        // Parse the body into content + tool_calls. 9router may return either
+        // a single JSON object (stream:false honored) or SSE text (stream
+        // implied) — parseResponse handles both.
+        const { content, toolCalls } = this.parseResponse(
+          response.data as string,
+        );
 
         logger.debug(
           {
@@ -190,9 +206,19 @@ Gaya ngobrol:
                 },
               ],
             });
+            // Auto-scope: if the model omitted guildId/channelId, fill them
+            // from the request scope so tools query the right server without
+            // the model having to guess IDs.
+            const scopedArgs = { ...tc.args };
+            if (scope.guildId && scopedArgs.guildId == null) {
+              scopedArgs.guildId = scope.guildId;
+            }
+            if (scope.channelId && scopedArgs.channelId == null) {
+              scopedArgs.channelId = scope.channelId;
+            }
             let result = "";
             try {
-              result = await executeTool(tc.name, tc.args);
+              result = await executeTool(tc.name, scopedArgs);
             } catch (e) {
               result = `Tool error: ${(e as Error).message}`;
             }
@@ -224,6 +250,60 @@ Gaya ngobrol:
     }
   }
 
+  /**
+   * Parse an LLM HTTP body into content + tool_calls. Handles both shapes
+   * 9router can return: a single JSON object (stream:false honored) or SSE
+   * text (stream implied). For SSE we delegate to parseSse.
+   */
+  private parseResponse(body: string): {
+    content: string;
+    toolCalls: Array<{
+      id: string;
+      name: string;
+      arguments: string;
+      args: Record<string, unknown>;
+    }>;
+  } {
+    const trimmed = body.trim();
+    // Non-streaming response: a single JSON object.
+    if (trimmed.startsWith("{")) {
+      try {
+        const json = JSON.parse(trimmed) as {
+          choices?: Array<{
+            message?: {
+              content?: string | null;
+              tool_calls?: Array<{
+                id?: string;
+                type?: string;
+                function?: { name?: string; arguments?: string };
+              }>;
+            };
+            delta?: unknown;
+          }>;
+        };
+        const msg = json.choices?.[0]?.message;
+        // If the router returned SSE-style shape under `choices[].delta`
+        // (rare), fall through to the SSE parser.
+        if (msg) {
+          const content = msg.content ?? "";
+          const toolCalls = (msg.tool_calls ?? []).map((tc, i) => {
+            const id = tc.id || `tool_${i}_${Date.now()}`;
+            return {
+              id,
+              name: tc.function?.name ?? "",
+              arguments: tc.function?.arguments ?? "",
+              args: this.safeJsonParse(tc.function?.arguments ?? ""),
+            };
+          });
+          return { content: content.trim(), toolCalls };
+        }
+      } catch {
+        // Not valid JSON after all — treat as SSE below.
+      }
+    }
+    return this.parseSse(body);
+  }
+
   /**
    * Parse an SSE stream body into accumulated content + any tool_calls.
    * 9router (and most OpenAI-compatible routers) emit `data: {json}` lines

services/backend/src/modules/chatbot/chatbot.toolDefs.ts

@@ -0,0 +1,270 @@
+/**
+ * Static tool *definitions* for the chatbot LLM (OpenAI function-calling
+ * format). Kept separate from the executor (chatbot.tools.ts) so the schema
+ * the model depends on can be imported without pulling in the database /
+ * config layer.
+ *
+ * The chatbot is a server-watcher agent: it can answer about ANY server
+ * situation — activity, moderation queue, specific users, channels, voice
+ * recordings, AI correction history, and trends over time — by calling these
+ * tools, which the executor implements against real tables.
+ */
+
+export interface ToolDef {
+  type: "function";
+  function: {
+    name: string;
+    description: string;
+    parameters: {
+      type: "object";
+      properties: Record<string, unknown>;
+      required?: string[];
+    };
+  };
+}
+
+export const tools: ToolDef[] = [
+  {
+    type: "function",
+    function: {
+      name: "get_server_stats",
+      description:
+        "Ambil statistik ringkas server/guild: total pesan, user aktif, jumlah pesan flagged, warn, dan clean. Panggil untuk jawab pertanyaan umum soal kondisi server. guildId/channelId otomatis ter-isi dari scope; kosongkan untuk semua data.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_top_channels",
+      description:
+        "Ambil daftar channel paling aktif (jumlah pesan terbanyak). Panggil untuk 'channel mana paling ramai' atau aktivitas per-channel.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          limit: {
+            type: "number",
+            description: "Jumlah channel teratas (default 5, max 10).",
+          },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_recent_activity",
+      description:
+        "Ambil pesan terbaru di server: siapa, di channel mana, jam berapa, isinya. Panggil untuk 'lagi ngapain' / aktivitas terbaru.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+          limit: {
+            type: "number",
+            description: "Jumlah pesan terakhir (default 5, max 20).",
+          },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_top_flagged",
+      description:
+        "Ambil pesan dengan ai_status flagged (beserta alasan, severity, analysis). Panggil untuk bahas pesan bermasalah / kerjaan moderator.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+          limit: { type: "number", description: "Jumlah pesan (default 5)." },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "search_messages",
+      description:
+        "Cari pesan berdasarkan kata kunci di isi pesan (case-insensitive, LIKE). Untuk 'ada yang bahas X gak?' / temukan topik tertentu. Hindari kata terlalu umum.",
+      parameters: {
+        type: "object",
+        properties: {
+          query: {
+            type: "string",
+            description: "Kata kunci pencarian (wajib).",
+          },
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+          limit: { type: "number", description: "Jumlah hasil (default 5)." },
+        },
+        required: ["query"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_user_messages",
+      description:
+        "Ambil pesan terbaru dari satu user tertentu (user_id), opsional di-scope ke guild/channel. Untuk 'chat si A gimana akhir-akhir ini?' — butuh user_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          userId: { type: "string", description: "ID user (wajib)." },
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+          limit: { type: "number", description: "Jumlah pesan (default 10)." },
+        },
+        required: ["userId"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_user_profile",
+      description:
+        "Ambil ringkasan profil AI dari seorang user (pola perilaku, gaya bicara) dari tabel user_profiles. Untuk 'siapa si A?' / konteks perilaku. Butuh user_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          userId: { type: "string", description: "ID user (wajib)." },
+          guildId: { type: "string", description: "ID server (opsional)." },
+        },
+        required: ["userId"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_user_reputation",
+      description:
+        "Ambil skor trust, jumlah infraction, dan streak pesan bersih seorang user dari user_reputations. Untuk 'berapa trust score si A?' / riwayat pelanggaran. Butuh user_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          userId: { type: "string", description: "ID user (wajib)." },
+          guildId: { type: "string", description: "ID server (opsional)." },
+        },
+        required: ["userId"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_channel_culture",
+      description:
+        "Ambil ringkasan norma/slang channel dari tabel channel_cultures (AI-generated). Untuk 'norma channel ini gimana?' / konteks sebelum nge-flag. Butuh channel_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          channelId: { type: "string", description: "ID channel (wajib)." },
+        },
+        required: ["channelId"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_message_detail",
+      description:
+        "Ambil 1 pesan lengkap beserta hasil analisis AI-nya (status, flags, score, severity, kategori, analysis, recommended action). Untuk jelasin keputusan moderasi pada pesan tertentu. Butuh message_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          messageId: { type: "string", description: "ID pesan (wajib)." },
+        },
+        required: ["messageId"],
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_message_reviews",
+      description:
+        "Ambil antrean review moderasi manual (message_reviews) berdasarkan status: pending/approved/rejected/escalated. Untuk 'ada review moderasi pending?' / cek kerjaan human moderator. guildId otomatis ter-isi.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          status: {
+            type: "string",
+            description:
+              "Status review: pending / approved / rejected / escalated (opsional, default semua).",
+          },
+          limit: { type: "number", description: "Jumlah (default 10)." },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_voice_recordings",
+      description:
+        "Ambil rekaman suara terbaru (voice_recordings): user, channel, transkripsi, status upload. Untuk 'ada rekaman suara terbaru?' / cek transkripsi. Bisa di-scope ke user_id atau channel_id.",
+      parameters: {
+        type: "object",
+        properties: {
+          userId: { type: "string", description: "Filter user (opsional)." },
+          channelId: {
+            type: "string",
+            description: "Filter channel (opsional).",
+          },
+          guildId: { type: "string", description: "ID server (opsional)." },
+          limit: { type: "number", description: "Jumlah (default 10)." },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_moderation_timeline",
+      description:
+        "Ambil tren harian: per hari, jumlah total pesan vs flagged vs warn vs clean. Untuk 'minggu ini pelanggaran naik?' / lihat tren moderasi. guildId otomatis ter-isi.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          channelId: { type: "string", description: "ID channel (opsional)." },
+          days: {
+            type: "number",
+            description: "Jumlah hari ke belakang (default 14, max 60).",
+          },
+        },
+      },
+    },
+  },
+  {
+    type: "function",
+    function: {
+      name: "get_corrections",
+      description:
+        "Ambil riwayat koreksi false-positive AI (corrected_moderations): pesan yang awalnya di-flag tapi dikoreksi manusia, beserta alasannya. Untuk 'AI pernah salah nge-flag apa aja?' / audit akurasi moderasi.",
+      parameters: {
+        type: "object",
+        properties: {
+          guildId: { type: "string", description: "ID server (opsional)." },
+          limit: { type: "number", description: "Jumlah (default 10)." },
+        },
+      },
+    },
+  },
+];

services/backend/src/modules/chatbot/chatbot.tools.ts

@@ -1,116 +1,25 @@
-import { sql } from "drizzle-orm";
+import { and, desc, eq, like, sql } from "drizzle-orm";
 import { getDatabase } from "../../shared/database/index.js";
+import {
+  pgChannelCulturesTable,
+  pgCorrectedModerationsTable,
+  pgMessageReviewsTable,
+  pgMessagesTable,
+  pgUserProfilesTable,
+  pgUserReputationsTable,
+  pgVoiceRecordingsTable,
+} from "../../shared/index.js";
 
 /**
- * Tools the chatbot LLM can call. Definitions describe the schema to the
- * model; the executor implements each one against the real database.
- * This turns the chatbot from "blind stats guesser" into an agent that
- * pulls real, current server data on demand.
+ * Executor for the chatbot's server-watcher tools. The tool *definitions*
+ * live in chatbot.toolDefs.ts (no DB import); this file implements each one
+ * against the real database.
+ *
+ * All queries use parameterized drizzle operators (eq/like/and) — never string
+ * interpolation into raw SQL — so model-supplied arguments cannot inject SQL.
  */
 
 export type ToolResult = string;
-
-/** JSON schema for a tool definition (OpenAI function-calling format). */
-export interface ToolDef {
-  type: "function";
-  function: {
-    name: string;
-    description: string;
-    parameters: {
-      type: "object";
-      properties: Record<string, unknown>;
-      required?: string[];
-    };
-  };
-}
-
-export const tools: ToolDef[] = [
-  {
-    type: "function",
-    function: {
-      name: "get_server_stats",
-      description:
-        "Ambil statistik ringkas server/guild saat ini: total pesan, user aktif, jumlah pesan flagged, dan jumlah warning. Panggil ini untuk menjawab pertanyaan umum tentang kondisi server. Opsional fill guild_id untuk scope ke guild tertentu, channel_id untuk scope ke channel.",
-      parameters: {
-        type: "object",
-        properties: {
-          guildId: {
-            type: "string",
-            description: "ID guild/server (opsional). Kosongkan = semua data.",
-          },
-          channelId: {
-            type: "string",
-            description: "ID channel (opsional).",
-          },
-        },
-      },
-    },
-  },
-  {
-    type: "function",
-    function: {
-      name: "get_top_channels",
-      description:
-        "Ambil daftar channel paling aktif (jumlah pesan terbanyak) di server. Panggil buat jawab 'channel mana paling ramai' atau aktivitas per-channel.",
-      parameters: {
-        type: "object",
-        properties: {
-          guildId: {
-            type: "string",
-            description: "ID server (opsional).",
-          },
-          limit: {
-            type: "number",
-            description: "Jumlah channel teratas (default 5, max 10).",
-          },
-        },
-      },
-    },
-  },
-  {
-    type: "function",
-    function: {
-      name: "get_recent_activity",
-      description:
-        "Ambil aktivitas/pesan terbaru di server: siapa yang baru ngomong, di channel mana, jam berapa. Panggil buat jawaban soal 'lagi ngapain' / aktivitas terbaru di server.",
-      parameters: {
-        type: "object",
-        properties: {
-          guildId: {
-            type: "string",
-            description: "ID server (opsional).",
-          },
-          limit: {
-            type: "number",
-            description: "Jumlah pesan terakhir (default 5).",
-          },
-        },
-      },
-    },
-  },
-  {
-    type: "function",
-    function: {
-      name: "get_top_flagged",
-      description:
-        "Ambil pesan yang paling sering di-flag atau kena warning. Panggil buat jawab soal pesan bermasalah / moderator.",
-      parameters: {
-        type: "object",
-        properties: {
-          guildId: {
-            type: "string",
-            description: "ID server (opsional).",
-          },
-          limit: {
-            type: "number",
-            description: "Jumlah pesan (default 5).",
-          },
-        },
-      },
-    },
-  },
-];
-
 /** Executes a tool call against the real DB and returns a readable result. */
 export async function executeTool(
   name: string,
@@ -122,9 +31,11 @@ export async function executeTool(
     typeof args.channelId === "string" && args.channelId
       ? args.channelId
       : undefined;
+  const userId =
+    typeof args.userId === "string" && args.userId ? args.userId : undefined;
   const limitRaw =
     typeof args.limit === "number" ? args.limit : Number(args.limit) || 5;
-  const limit = Math.min(Math.max(1, Math.round(limitRaw)), 10);
+  const limit = Math.min(Math.max(1, Math.round(limitRaw)), 20);
 
   try {
     switch (name) {
@@ -133,9 +44,48 @@ export async function executeTool(
       case "get_top_channels":
         return await topChannels(guildId, limit);
       case "get_recent_activity":
-        return await recentActivity(guildId, limit);
+        return await recentActivity(guildId, channelId, limit);
       case "get_top_flagged":
-        return await topFlagged(guildId, limit);
+        return await topFlagged(guildId, channelId, limit);
+      case "search_messages":
+        return await searchMessages(
+          String(args.query ?? ""),
+          guildId,
+          channelId,
+          limit,
+        );
+      case "get_user_messages":
+        return await userMessages(userId, guildId, channelId, limit);
+      case "get_user_profile":
+        return await userProfile(userId, guildId);
+      case "get_user_reputation":
+        return await userReputation(userId, guildId);
+      case "get_channel_culture":
+        return await channelCulture(
+          typeof args.channelId === "string" ? args.channelId : undefined,
+        );
+      case "get_message_detail":
+        return await messageDetail(
+          typeof args.messageId === "string" ? args.messageId : undefined,
+        );
+      case "get_message_reviews":
+        return await messageReviews(
+          guildId,
+          typeof args.status === "string" ? args.status : undefined,
+          limit,
+        );
+      case "get_voice_recordings":
+        return await voiceRecordings(userId, channelId, guildId, limit);
+      case "get_moderation_timeline":
+        return await moderationTimeline(
+          guildId,
+          channelId,
+          typeof args.days === "number"
+            ? Math.min(Math.max(1, args.days), 60)
+            : 14,
+        );
+      case "get_corrections":
+        return await corrections(guildId, limit);
       default:
         return `Unknown tool: ${name}`;
     }
@@ -145,6 +95,23 @@ export async function executeTool(
   }
 }
 
+// ── Query helpers ──────────────────────────────────────────
+
+function scopeMessages(
+  guildId?: string,
+  channelId?: string,
+): ReturnType<typeof and> | undefined {
+  const conds = [];
+  if (guildId) conds.push(eq(pgMessagesTable.guild_id, guildId));
+  if (channelId) conds.push(eq(pgMessagesTable.channel_id, channelId));
+  return conds.length ? and(...conds) : undefined;
+}
+
+/** Escape LIKE wildcards so user input can't break the pattern. */
+function likePattern(q: string): string {
+  return q.replace(/[\\%_]/g, (c) => `\\${c}`);
+}
+
 // ── Tool executors ──────────────────────────────────────────
 
 async function serverStats(
@@ -152,81 +119,330 @@ async function serverStats(
   channelId?: string,
 ): Promise<string> {
   const db = getDatabase();
-  const conditions: string[] = [];
-  if (guildId) conditions.push(`guild_id = '${guildId}'`);
-  if (channelId) conditions.push(`channel_id = '${channelId}'`);
-  const cond = conditions.length ? `WHERE ${conditions.join(" AND ")}` : "";
+  const [result] = await db
+    .select({
+      total_messages: sql<number>`COUNT(*)::int`,
+      active_users: sql<number>`COUNT(DISTINCT ${pgMessagesTable.user_id})::int`,
+      flagged: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'flagged')::int`,
+      warned: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'warn')::int`,
+      clean: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'clean')::int`,
+    })
+    .from(pgMessagesTable)
+    .where(scopeMessages(guildId, channelId));
 
-  const result = await db.execute(
-    sql.raw(
-      `SELECT COUNT(*)::int AS total_messages,
-              COUNT(DISTINCT user_id)::int AS active_users,
-              COUNT(*) FILTER (WHERE ai_status = 'flagged')::int AS flagged,
-              COUNT(*) FILTER (WHERE ai_status = 'warn')::int AS warned
-       FROM messages ${cond}`,
-    ),
-  );
-  const rows =
-    (result as unknown as { rows: Record<string, unknown>[] }).rows ?? [];
-  const r = rows[0] ?? {};
-  return JSON.stringify({
-    total_messages: r.total_messages ?? 0,
-    active_users: r.active_users ?? 0,
-    flagged: r.flagged ?? 0,
-    warned: r.warned ?? 0,
-  });
+  const r = result ?? {
+    total_messages: 0,
+    active_users: 0,
+    flagged: 0,
+    warned: 0,
+    clean: 0,
+  };
+  return JSON.stringify(r);
 }
 
 async function topChannels(guildId?: string, limit = 5): Promise<string> {
   const db = getDatabase();
-  const conditions: string[] = [];
-  if (guildId) conditions.push(`guild_id = '${guildId}'`);
-  const cond = conditions.length ? `WHERE ${conditions.join(" AND ")}` : "";
-
-  const result = await db.execute(
-    sql.raw(
-      `SELECT channel_id,
-              COUNT(*)::int AS count
-       FROM messages ${cond}
-       GROUP BY channel_id
-       ORDER BY count DESC
-       LIMIT ${limit}`,
-    ),
-  );
-  const rows = (result as unknown as { rows: unknown[] }).rows ?? [];
-  return JSON.stringify(rows.slice(0, limit));
+  const rows = await db
+    .select({
+      channel_id: pgMessagesTable.channel_id,
+      count: sql<number>`COUNT(*)::int`,
+    })
+    .from(pgMessagesTable)
+    .where(scopeMessages(guildId))
+    .groupBy(pgMessagesTable.channel_id)
+    .orderBy(desc(sql`COUNT(*)`))
+    .limit(limit);
+  return JSON.stringify(rows);
 }
 
-async function recentActivity(guildId?: string, limit = 5): Promise<string> {
+async function recentActivity(
+  guildId?: string,
+  channelId?: string,
+  limit = 5,
+): Promise<string> {
   const db = getDatabase();
-  const conditions: string[] = [];
-  if (guildId) conditions.push(`guild_id = '${guildId}'`);
-  const cond = conditions.length ? `WHERE ${conditions.join(" AND ")}` : "";
-
-  const result = await db.execute(
-    sql.raw(
-      `SELECT username, content, channel_id, created_at
-       FROM messages ${cond}
-       ORDER BY created_at DESC
-       LIMIT ${limit}`,
-    ),
-  );
-  return JSON.stringify((result as unknown as { rows: unknown[] }).rows ?? []);
+  const rows = await db
+    .select({
+      id: pgMessagesTable.id,
+      username: pgMessagesTable.username,
+      user_id: pgMessagesTable.user_id,
+      channel_id: pgMessagesTable.channel_id,
+      content: pgMessagesTable.content,
+      created_at: pgMessagesTable.created_at,
+      ai_status: pgMessagesTable.ai_status,
+    })
+    .from(pgMessagesTable)
+    .where(scopeMessages(guildId, channelId))
+    .orderBy(desc(pgMessagesTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
 }
 
-async function topFlagged(guildId?: string, limit = 5): Promise<string> {
+async function topFlagged(
+  guildId?: string,
+  channelId?: string,
+  limit = 5,
+): Promise<string> {
   const db = getDatabase();
-  const conditions = ["ai_status IN ('flagged', 'warn')"];
-  if (guildId) conditions.push(`guild_id = '${guildId}'`);
-  const cond = `WHERE ${conditions.join(" AND ")}`;
-
-  const result = await db.execute(
-    sql.raw(
-      `SELECT username, content, channel_id, ai_status, created_at
-       FROM messages ${cond}
-       ORDER BY created_at DESC
-       LIMIT ${limit}`,
-    ),
-  );
-  return JSON.stringify((result as unknown as { rows: unknown[] }).rows ?? []);
+  const rows = await db
+    .select({
+      id: pgMessagesTable.id,
+      username: pgMessagesTable.username,
+      channel_id: pgMessagesTable.channel_id,
+      content: pgMessagesTable.content,
+      ai_status: pgMessagesTable.ai_status,
+      ai_severity: pgMessagesTable.ai_severity,
+      ai_moderation_flags: pgMessagesTable.ai_moderation_flags,
+      ai_analysis: pgMessagesTable.ai_analysis,
+      created_at: pgMessagesTable.created_at,
+    })
+    .from(pgMessagesTable)
+    .where(
+      and(
+        scopeMessages(guildId, channelId),
+        eq(pgMessagesTable.ai_status, "flagged"),
+      ),
+    )
+    .orderBy(desc(pgMessagesTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
+}
+
+async function searchMessages(
+  query: string,
+  guildId?: string,
+  channelId?: string,
+  limit = 5,
+): Promise<string> {
+  const db = getDatabase();
+  if (!query.trim()) return JSON.stringify({ error: "query kosong" });
+  const rows = await db
+    .select({
+      id: pgMessagesTable.id,
+      username: pgMessagesTable.username,
+      channel_id: pgMessagesTable.channel_id,
+      content: pgMessagesTable.content,
+      created_at: pgMessagesTable.created_at,
+      ai_status: pgMessagesTable.ai_status,
+    })
+    .from(pgMessagesTable)
+    .where(
+      and(
+        scopeMessages(guildId, channelId),
+        like(pgMessagesTable.content, `%${likePattern(query)}%`),
+      ),
+    )
+    .orderBy(desc(pgMessagesTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
+}
+
+async function userMessages(
+  userId?: string,
+  guildId?: string,
+  channelId?: string,
+  limit = 10,
+): Promise<string> {
+  const db = getDatabase();
+  if (!userId) return JSON.stringify({ error: "userId wajib" });
+  const conds = [eq(pgMessagesTable.user_id, userId)];
+  if (guildId) conds.push(eq(pgMessagesTable.guild_id, guildId));
+  if (channelId) conds.push(eq(pgMessagesTable.channel_id, channelId));
+  const rows = await db
+    .select({
+      id: pgMessagesTable.id,
+      channel_id: pgMessagesTable.channel_id,
+      content: pgMessagesTable.content,
+      created_at: pgMessagesTable.created_at,
+      ai_status: pgMessagesTable.ai_status,
+    })
+    .from(pgMessagesTable)
+    .where(and(...conds))
+    .orderBy(desc(pgMessagesTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
+}
+
+async function userProfile(userId?: string, guildId?: string): Promise<string> {
+  const db = getDatabase();
+  if (!userId) return JSON.stringify({ error: "userId wajib" });
+  const conds = [eq(pgUserProfilesTable.user_id, userId)];
+  if (guildId) conds.push(eq(pgUserProfilesTable.guild_id, guildId));
+  const rows = await db
+    .select({
+      user_id: pgUserProfilesTable.user_id,
+      guild_id: pgUserProfilesTable.guild_id,
+      profile_summary: pgUserProfilesTable.profile_summary,
+      last_analyzed_at: pgUserProfilesTable.last_analyzed_at,
+    })
+    .from(pgUserProfilesTable)
+    .where(and(...conds))
+    .limit(1);
+  return JSON.stringify(rows[0] ?? { error: "profil tidak ditemukan" });
+}
+
+async function userReputation(
+  userId?: string,
+  guildId?: string,
+): Promise<string> {
+  const db = getDatabase();
+  if (!userId) return JSON.stringify({ error: "userId wajib" });
+  const conds = [eq(pgUserReputationsTable.user_id, userId)];
+  if (guildId) conds.push(eq(pgUserReputationsTable.guild_id, guildId));
+  const rows = await db
+    .select({
+      user_id: pgUserReputationsTable.user_id,
+      guild_id: pgUserReputationsTable.guild_id,
+      trust_score: pgUserReputationsTable.trust_score,
+      clean_message_streak: pgUserReputationsTable.clean_message_streak,
+      total_infractions: pgUserReputationsTable.total_infractions,
+      last_infraction_at: pgUserReputationsTable.last_infraction_at,
+    })
+    .from(pgUserReputationsTable)
+    .where(and(...conds))
+    .limit(1);
+  return JSON.stringify(rows[0] ?? { error: "reputasi tidak ditemukan" });
+}
+
+async function channelCulture(channelId?: string): Promise<string> {
+  const db = getDatabase();
+  if (!channelId) return JSON.stringify({ error: "channelId wajib" });
+  const rows = await db
+    .select({
+      channel_id: pgChannelCulturesTable.channel_id,
+      culture_summary: pgChannelCulturesTable.culture_summary,
+      last_analyzed_at: pgChannelCulturesTable.last_analyzed_at,
+    })
+    .from(pgChannelCulturesTable)
+    .where(eq(pgChannelCulturesTable.channel_id, channelId))
+    .limit(1);
+  return JSON.stringify(rows[0] ?? { error: "culture tidak ditemukan" });
+}
+
+async function messageDetail(messageId?: string): Promise<string> {
+  const db = getDatabase();
+  if (!messageId) return JSON.stringify({ error: "messageId wajib" });
+  const rows = await db
+    .select({
+      id: pgMessagesTable.id,
+      guild_id: pgMessagesTable.guild_id,
+      channel_id: pgMessagesTable.channel_id,
+      user_id: pgMessagesTable.user_id,
+      username: pgMessagesTable.username,
+      content: pgMessagesTable.content,
+      created_at: pgMessagesTable.created_at,
+      ai_status: pgMessagesTable.ai_status,
+      ai_moderation_flags: pgMessagesTable.ai_moderation_flags,
+      ai_moderation_score: pgMessagesTable.ai_moderation_score,
+      ai_severity: pgMessagesTable.ai_severity,
+      ai_categories: pgMessagesTable.ai_categories,
+      ai_analysis: pgMessagesTable.ai_analysis,
+      ai_recommended_action: pgMessagesTable.ai_recommended_action,
+      ai_confidence: pgMessagesTable.ai_confidence,
+    })
+    .from(pgMessagesTable)
+    .where(eq(pgMessagesTable.id, messageId))
+    .limit(1);
+  return JSON.stringify(rows[0] ?? { error: "pesan tidak ditemukan" });
+}
+
+async function messageReviews(
+  guildId?: string,
+  status?: string,
+  limit = 10,
+): Promise<string> {
+  const db = getDatabase();
+  const conds = [];
+  if (guildId) conds.push(eq(pgMessageReviewsTable.guild_id, guildId));
+  if (status) conds.push(eq(pgMessageReviewsTable.status, status as never));
+  const rows = await db
+    .select({
+      id: pgMessageReviewsTable.id,
+      message_id: pgMessageReviewsTable.message_id,
+      reviewer_id: pgMessageReviewsTable.reviewer_id,
+      status: pgMessageReviewsTable.status,
+      notes: pgMessageReviewsTable.notes,
+      created_at: pgMessageReviewsTable.created_at,
+      reviewed_at: pgMessageReviewsTable.reviewed_at,
+    })
+    .from(pgMessageReviewsTable)
+    .where(conds.length ? and(...conds) : undefined)
+    .orderBy(desc(pgMessageReviewsTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
+}
+
+async function voiceRecordings(
+  userId?: string,
+  channelId?: string,
+  guildId?: string,
+  limit = 10,
+): Promise<string> {
+  const db = getDatabase();
+  const conds = [];
+  if (userId) conds.push(eq(pgVoiceRecordingsTable.user_id, userId));
+  if (channelId) conds.push(eq(pgVoiceRecordingsTable.channel_id, channelId));
+  if (guildId) conds.push(eq(pgVoiceRecordingsTable.guild_id, guildId));
+  const rows = await db
+    .select({
+      id: pgVoiceRecordingsTable.id,
+      username: pgVoiceRecordingsTable.username,
+      channel_name: pgVoiceRecordingsTable.channel_name,
+      filename: pgVoiceRecordingsTable.filename,
+      size_bytes: pgVoiceRecordingsTable.size_bytes,
+      upload_status: pgVoiceRecordingsTable.upload_status,
+      transcription: pgVoiceRecordingsTable.transcription,
+      created_at: pgVoiceRecordingsTable.created_at,
+    })
+    .from(pgVoiceRecordingsTable)
+    .where(conds.length ? and(...conds) : undefined)
+    .orderBy(desc(pgVoiceRecordingsTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
+}
+
+async function moderationTimeline(
+  guildId?: string,
+  channelId?: string,
+  days = 14,
+): Promise<string> {
+  const db = getDatabase();
+  const day = sql<string>`to_char(to_timestamp(${pgMessagesTable.created_at} / 1000), 'YYYY-MM-DD')`;
+  const rows = await db
+    .select({
+      day,
+      total: sql<number>`COUNT(*)::int`,
+      flagged: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'flagged')::int`,
+      warned: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'warn')::int`,
+      clean: sql<number>`COUNT(*) FILTER (WHERE ${pgMessagesTable.ai_status} = 'clean')::int`,
+    })
+    .from(pgMessagesTable)
+    .where(
+      and(
+        scopeMessages(guildId, channelId),
+        // only the last N days
+        sql`${pgMessagesTable.created_at} >= extract(epoch FROM now() - (${days} || ' days')::interval) * 1000`,
+      ),
+    )
+    .groupBy(day)
+    .orderBy(day);
+  return JSON.stringify(rows);
+}
+
+async function corrections(_guildId?: string, limit = 10): Promise<string> {
+  const db = getDatabase();
+  const rows = await db
+    .select({
+      id: pgCorrectedModerationsTable.id,
+      message_id: pgCorrectedModerationsTable.message_id,
+      original_flags: pgCorrectedModerationsTable.original_flags,
+      corrected_flags: pgCorrectedModerationsTable.corrected_flags,
+      correction_notes: pgCorrectedModerationsTable.correction_notes,
+      content_snippet: pgCorrectedModerationsTable.content_snippet,
+      created_at: pgCorrectedModerationsTable.created_at,
+    })
+    .from(pgCorrectedModerationsTable)
+    .orderBy(desc(pgCorrectedModerationsTable.created_at))
+    .limit(limit);
+  return JSON.stringify(rows);
 }

services/backend/src/modules/chatbot/index.ts

@@ -1 +0,0 @@
-export { createChatbotRouter } from "./chatbot.routes.js";

services/backend/src/modules/config/config.routes.ts

@@ -1,28 +0,0 @@
-import type { Router } from "express";
-import express from "express";
-import { config } from "../../shared/config/index.js";
-
-export function createConfigRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/config
-  router.get("/config", (_req, res) => {
-    res.json({
-      monitorGuildId: config.MONITOR_GUILD_ID || null,
-      webserverPort: config.WEBSERVER_PORT,
-      nodeEnv: config.NODE_ENV,
-      backlogSyncHours: config.BACKLOG_SYNC_HOURS,
-      backlogSyncBatchSize: config.BACKLOG_SYNC_BATCH_SIZE,
-      retentionMessagesDays: config.RETENTION_MESSAGES_DAYS,
-      retentionAttachmentsDays: config.RETENTION_ATTACHMENTS_DAYS,
-      retentionVoiceDays: config.RETENTION_VOICE_DAYS,
-      autoDeleteFlaggedEnabled: config.AUTO_DELETE_FLAGGED_ENABLED,
-      aiAnalysisEnabled: config.AI_ANALYSIS_ENABLED,
-      voiceGuildId: config.VOICE_GUILD_ID || null,
-      voiceChannelId: config.VOICE_CHANNEL_ID || null,
-      logLevel: config.LOG_LEVEL,
-    });
-  });
-
-  return router;
-}

services/backend/src/modules/config/index.ts

@@ -1 +0,0 @@
-export { createConfigRouter } from "./config.routes.js";

services/backend/src/modules/dashboard/dashboard.routes.ts

@@ -1,111 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { dashboardService } from "./dashboard.service.js";
-
-const logger = createChildLogger("dashboard.routes");
-
-export function createDashboardRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/dashboard/stats — aggregated server statistics
-  router.get(
-    "/dashboard/stats",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Fetching dashboard stats");
-      const stats = await dashboardService.getStats();
-      res.json(stats);
-    }),
-  );
-
-  // GET /api/dashboard/activity?days=14 — message volume over time
-  router.get(
-    "/dashboard/activity",
-    asyncHandler(async (req: Request, res: Response) => {
-      const days = Math.min(Math.max(Number(req.query.days) || 14, 1), 90);
-      const activity = await dashboardService.getActivity(days);
-      res.json(activity);
-    }),
-  );
-
-  // GET /api/dashboard/users — paginated user list with profiles
-  router.get(
-    "/dashboard/users",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 20;
-      const cursor =
-        typeof req.query.cursor === "string" ? req.query.cursor : undefined;
-      const search =
-        typeof req.query.search === "string" ? req.query.search : undefined;
-
-      const result = await dashboardService.listUsers({
-        limit,
-        cursor,
-        search,
-      });
-      res.json(result);
-    }),
-  );
-
-  // GET /api/dashboard/users/:userId — single user detail
-  router.get(
-    "/dashboard/users/:userId",
-    asyncHandler(async (req: Request, res: Response) => {
-      const userId = String(req.params.userId);
-      const detail = await dashboardService.getUserDetail(userId);
-      res.json(detail);
-    }),
-  );
-
-  // GET /api/dashboard/channels — paginated channel list with culture summaries
-  router.get(
-    "/dashboard/channels",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 20;
-      const search =
-        typeof req.query.search === "string" ? req.query.search : undefined;
-      const guildId =
-        typeof req.query.guild_id === "string" ? req.query.guild_id : undefined;
-
-      const result = await dashboardService.listChannels({
-        limit,
-        search,
-        guildId,
-      });
-      res.json(result);
-    }),
-  );
-
-  // GET /api/dashboard/channels/:channelId — single channel detail
-  router.get(
-    "/dashboard/channels/:channelId",
-    asyncHandler(async (req: Request, res: Response) => {
-      const channelId = String(req.params.channelId);
-      const detail = await dashboardService.getChannelDetail(channelId);
-      res.json(detail);
-    }),
-  );
-
-  // GET /api/dashboard/reactions — top reacted messages
-  router.get(
-    "/dashboard/reactions",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 20;
-      const reactions = await dashboardService.getTopReactions(limit);
-      res.json(reactions);
-    }),
-  );
-
-  // GET /api/dashboard/reactors — top users by reactions given
-  router.get(
-    "/dashboard/reactors",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 20;
-      const reactors = await dashboardService.getTopReactors(limit);
-      res.json(reactors);
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/dashboard/index.ts

@@ -1 +0,0 @@
-export { createDashboardRouter } from "./dashboard.routes.js";

services/backend/src/modules/health/moderationMetrics.ts

@@ -67,9 +67,9 @@ export const moderationErrors = new Counter({
   labelNames: ["type"] as const,
 });
 
-export const searxngCalls = new Counter({
-  name: "moderation_searxng_calls_total",
-  help: "SearXNG search calls",
+export const webSearchCalls = new Counter({
+  name: "moderation_websearch_calls_total",
+  help: "Wikipedia web-search calls",
   labelNames: ["status"] as const,
 });
 

services/backend/src/modules/media/index.ts

@@ -1 +0,0 @@
-export { createMediaRouter } from "./media.routes.js";

services/backend/src/modules/media/media.routes.ts

@@ -1,71 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler, validateBody } from "../../shared/middlewares/index.js";
-import { mediaLoopSchema, mediaQueueSchema } from "./media.schema.js";
-import { getStatus, queue, setLoop, skip, stop } from "./media.service.js";
-
-const logger = createChildLogger("media.routes");
-
-export function createMediaRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/media/status
-  router.get(
-    "/media/status",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Media status requested");
-      const status = await getStatus();
-      res.json(status);
-    }),
-  );
-
-  // POST /api/media/queue
-  router.post(
-    "/media/queue",
-    validateBody(mediaQueueSchema),
-    asyncHandler(async (req: Request, res: Response) => {
-      const { source, mode } = req.body as {
-        source: string;
-        mode: "music" | "screen";
-      };
-      logger.debug({ source, mode }, "Media queue requested");
-      const state = await queue(source, mode);
-      res.json(state);
-    }),
-  );
-
-  // POST /api/media/skip
-  router.post(
-    "/media/skip",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Media skip requested");
-      const state = await skip();
-      res.json(state);
-    }),
-  );
-
-  // POST /api/media/stop
-  router.post(
-    "/media/stop",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Media stop requested");
-      const state = await stop();
-      res.json(state);
-    }),
-  );
-
-  // POST /api/media/loop
-  router.post(
-    "/media/loop",
-    validateBody(mediaLoopSchema),
-    asyncHandler(async (req: Request, res: Response) => {
-      const { loop } = req.body as { loop: boolean };
-      logger.debug({ loop }, "Media loop requested");
-      const state = await setLoop(loop);
-      res.json(state);
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/messages/embed.ts

@@ -0,0 +1,43 @@
+import { config } from "@/shared/config/index.js";
+import { createChildLogger } from "@/shared/logger/index.js";
+
+const logger = createChildLogger("messages-embed");
+
+/**
+ * Embed a search query with the configured OpenAI-compatible embedding model.
+ * Uses raw fetch (the backend has no openai SDK dependency) and returns null
+ * when embeddings are not configured (search unavailable).
+ *
+ * encoding_format: "float" is REQUIRED — Nvidia-backed models reject base64.
+ */
+export async function embedQuery(text: string): Promise<number[] | null> {
+  if (!config.AI_LLM_API_KEY || !config.AI_LLM_EMBEDDING_MODEL) return null;
+  try {
+    const res = await fetch(`${config.AI_LLM_BASE_URL}/embeddings`, {
+      method: "POST",
+      headers: {
+        "Content-Type": "application/json",
+        Authorization: `Bearer ${config.AI_LLM_API_KEY}`,
+      },
+      body: JSON.stringify({
+        model: config.AI_LLM_EMBEDDING_MODEL,
+        input: text,
+        encoding_format: "float",
+      }),
+    });
+    if (!res.ok) {
+      logger.warn({ status: res.status }, "query embed HTTP error");
+      return null;
+    }
+    const json = (await res.json()) as {
+      data?: Array<{ embedding?: number[] }>;
+    };
+    return json.data?.[0]?.embedding ?? null;
+  } catch (error) {
+    logger.warn(
+      { error: error instanceof Error ? error.message : String(error) },
+      "query embed failed",
+    );
+    return null;
+  }
+}

services/backend/src/modules/messages/index.ts

@@ -1 +0,0 @@
-export { createMessagesRouter } from "./messages.routes.js";

services/backend/src/modules/messages/messages.controller.ts

@@ -1,74 +0,0 @@
-import type { Request, Response } from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { messageQuerySchema } from "./messages.schema.js";
-import { messagesService } from "./messages.service.js";
-
-const logger = createChildLogger("messages.controller");
-
-export const handleListMessages = asyncHandler(
-  async (req: Request, res: Response) => {
-    const query = messageQuerySchema.parse(req.query);
-    logger.debug({ query }, "Handling list messages request");
-    const result = await messagesService.listMessages(query);
-    res.json(result);
-  },
-);
-
-export const handleGetMessagesByChannel = asyncHandler(
-  async (req: Request, res: Response) => {
-    if (!req.params.channelId) {
-      res.status(400).json({ error: "Missing route parameter: channelId" });
-      return;
-    }
-    const channelId = req.params.channelId as string;
-    const query = messageQuerySchema.parse(req.query);
-    logger.debug({ channelId, query }, "Handling get messages by channel");
-    const result = await messagesService.getMessagesByChannel(channelId, query);
-    res.json(result);
-  },
-);
-
-export const handleGetMessageById = asyncHandler(
-  async (req: Request, res: Response) => {
-    if (!req.params.id) {
-      res.status(400).json({ error: "Missing route parameter: id" });
-      return;
-    }
-    const id = req.params.id as string;
-    logger.debug({ id }, "Handling get message by ID");
-    const result = await messagesService.getMessageById(id);
-    res.json(result);
-  },
-);
-
-export const handleGetImageMessages = asyncHandler(
-  async (req: Request, res: Response) => {
-    const guildId = req.query.guildId as string | undefined;
-    if (!guildId) {
-      res.status(400).json({ error: "Missing query parameter: guildId" });
-      return;
-    }
-    const limit = Number(req.query.limit) || 50;
-    logger.debug({ guildId, limit }, "Handling get image messages");
-    const result = await messagesService.getImageMessages(guildId, limit);
-    res.json(result);
-  },
-);
-
-export const handleGetAttachmentsByChannel = asyncHandler(
-  async (req: Request, res: Response) => {
-    if (!req.params.channelId) {
-      res.status(400).json({ error: "Missing route parameter: channelId" });
-      return;
-    }
-    const channelId = req.params.channelId as string;
-    const query = messageQuerySchema.parse(req.query);
-    logger.debug({ channelId, query }, "Handling get attachments by channel");
-    const result = await messagesService.getAttachmentsByChannel(
-      channelId,
-      query,
-    );
-    res.json(result);
-  },
-);

services/backend/src/modules/messages/messages.repository.ts

@@ -77,12 +77,11 @@ export class MessagesRepository {
 
     // Exclude spam threads (NULL-safe: non-thread messages are kept)
     if (EXCLUDED_THREAD_IDS.length > 0) {
-      conditions.push(
-        or(
-          isNull(pgMessagesTable.thread_id),
-          notInArray(pgMessagesTable.thread_id, EXCLUDED_THREAD_IDS),
-        )!,
+      const excludeThreads = or(
+        isNull(pgMessagesTable.thread_id),
+        notInArray(pgMessagesTable.thread_id, EXCLUDED_THREAD_IDS),
       );
+      if (excludeThreads) conditions.push(excludeThreads);
     }
 
     const where = conditions.length > 0 ? and(...conditions) : undefined;
@@ -150,12 +149,11 @@ export class MessagesRepository {
 
     // Exclude spam threads (NULL-safe)
     if (EXCLUDED_THREAD_IDS.length > 0) {
-      conditions.push(
-        or(
-          isNull(pgMessagesTable.thread_id),
-          notInArray(pgMessagesTable.thread_id, EXCLUDED_THREAD_IDS),
-        )!,
+      const excludeThreads = or(
+        isNull(pgMessagesTable.thread_id),
+        notInArray(pgMessagesTable.thread_id, EXCLUDED_THREAD_IDS),
       );
+      if (excludeThreads) conditions.push(excludeThreads);
     }
 
     const rows = await db
@@ -174,6 +172,71 @@ export class MessagesRepository {
     return { data, nextCursor };
   }
 
+  /**
+   * Async generator that yields messages ONE AT A TIME for WS streaming.
+   * Each `.next()` runs its own bounded DB query (limit+1) advancing on the
+   * `created_at` cursor, so memory stays flat and the caller can emit one WS
+   * frame per message (no 50-row batch). Stops when a page returns < limit.
+   */
+  async *streamMany(
+    query: MessageQuery,
+    pageSize = 50,
+  ): AsyncGenerator<ReturnType<typeof mapMessageRow>, void, unknown> {
+    const conditions: SQL[] = [];
+
+    if (query.guildId) {
+      conditions.push(eq(pgMessagesTable.guild_id, query.guildId));
+    }
+    if (query.channelId) {
+      conditions.push(eq(pgMessagesTable.channel_id, query.channelId));
+    }
+    if (query.userId) {
+      conditions.push(eq(pgMessagesTable.user_id, query.userId));
+    }
+    if (query.status) {
+      conditions.push(eq(pgMessagesTable.ai_status, query.status));
+    }
+    if (EXCLUDED_THREAD_IDS.length > 0) {
+      const excludeThreads = or(
+        isNull(pgMessagesTable.thread_id),
+        notInArray(pgMessagesTable.thread_id, EXCLUDED_THREAD_IDS),
+      );
+      if (excludeThreads) conditions.push(excludeThreads);
+    }
+
+    const where = conditions.length > 0 ? and(...conditions) : undefined;
+    let cursor: string | undefined = query.cursor;
+
+    while (true) {
+      const pageConditions = where ? [where] : [];
+      if (cursor) {
+        pageConditions.push(lt(pgMessagesTable.created_at, Number(cursor)));
+      }
+      const pageWhere =
+        pageConditions.length > 0 ? and(...pageConditions) : undefined;
+
+      const db = getDatabase();
+      const rows = await db
+        .select()
+        .from(pgMessagesTable)
+        .where(pageWhere)
+        .orderBy(desc(pgMessagesTable.created_at))
+        .limit(pageSize + 1);
+
+      if (rows.length === 0) return;
+
+      const hasMore = rows.length > pageSize;
+      const pageRows = hasMore ? rows.slice(0, pageSize) : rows;
+
+      for (const r of pageRows) {
+        yield mapMessageRow(r as Record<string, unknown>);
+      }
+
+      if (!hasMore) return;
+      cursor = String(rows[pageSize - 1].created_at);
+    }
+  }
+
   async create(data: MessageCreate) {
     const db = getDatabase();
     const id = crypto.randomUUID();
@@ -316,12 +379,13 @@ export class MessagesRepository {
           like(pgAttachmentsTable.type, "image/%"),
           // Exclude spam threads (NULL-safe for non-thread messages)
           ...(EXCLUDED_THREAD_IDS.length > 0
-            ? [
-                or(
+            ? (() => {
+                const excludeThreads = or(
                   isNull(pgAttachmentsTable.thread_id),
                   notInArray(pgAttachmentsTable.thread_id, EXCLUDED_THREAD_IDS),
-                )!,
-              ]
+                );
+                return excludeThreads ? [excludeThreads] : [];
+              })()
             : []),
         ),
       )

services/backend/src/modules/messages/messages.routes.ts

@@ -1,51 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import {
-  handleGetAttachmentsByChannel,
-  handleGetImageMessages,
-  handleGetMessageById,
-  handleGetMessagesByChannel,
-  handleListMessages,
-} from "./messages.controller.js";
-import { messagesService } from "./messages.service.js";
-
-const logger = createChildLogger("messages.routes");
-
-export function createMessagesRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/messages/images - Get messages with image attachments
-  // MUST be registered BEFORE /messages/:channelId so "images" is not
-  // captured as a channelId param.
-  router.get("/messages/images", handleGetImageMessages);
-
-  // GET /api/messages - List messages
-  router.get("/messages", handleListMessages);
-
-  // GET /api/messages/:channelId - Get messages by channel
-  router.get("/messages/:channelId", handleGetMessagesByChannel);
-
-  // GET /api/messages/:channelId/attachments - Get attachments by channel
-  router.get("/messages/:channelId/attachments", handleGetAttachmentsByChannel);
-
-  // GET /api/messages/detail/:id - Get single message by ID
-  // (uses /detail/ prefix to avoid collision with :channelId route above)
-  router.get("/messages/detail/:id", handleGetMessageById);
-
-  // GET /api/review - Get flagged/warned messages for review
-  router.get(
-    "/review",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 20;
-      const channelId = (req.query.channelId as string) || undefined;
-
-      const rows = await messagesService.getReviewMessages(channelId, limit);
-      logger.debug({ limit, channelId }, "Review query executed");
-      res.json({ results: rows, limit, cursor: null });
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/messages/messages.schema.ts

@@ -41,3 +41,11 @@ export const messageUpdateSchema = z.object({
 export type MessageQuery = z.infer<typeof messageQuerySchema>;
 export type MessageCreate = z.infer<typeof messageCreateSchema>;
 export type MessageUpdate = z.infer<typeof messageUpdateSchema>;
+
+export const semanticSearchSchema = z.object({
+  query: z.string().min(1).max(500),
+  limit: z.coerce.number().int().positive().max(50).default(10),
+  guildId: z.string().optional(),
+});
+
+export type SemanticSearchQuery = z.infer<typeof semanticSearchSchema>;

services/backend/src/modules/messages/messages.service.ts

@@ -1,7 +1,9 @@
 import { NotFoundError, ValidationError } from "@/shared/errors/index";
 import { createChildLogger } from "@/shared/logger/index";
+import { embedQuery } from "./embed.js";
 import { messagesRepository } from "./messages.repository.js";
-import type { MessageQuery } from "./messages.schema.js";
+import type { MessageQuery, SemanticSearchQuery } from "./messages.schema.js";
+import { searchArchive } from "./qdrant.js";
 
 const logger = createChildLogger("messages.service");
 
@@ -15,6 +17,14 @@ export class MessagesService {
     return messagesRepository.findMany(query);
   }
 
+  /**
+   * Stream messages one at a time (no 50-row batch). The WS handler iterates
+   * this generator and emits one `message_snapshot` frame per message.
+   */
+  streamMessages(query: MessageQuery, pageSize = 50) {
+    return messagesRepository.streamMany(query, pageSize);
+  }
+
   async getMessagesByChannel(channelId: string, query: MessageQuery) {
     if (!channelId) {
       throw new ValidationError("channelId is required");
@@ -70,6 +80,40 @@ export class MessagesService {
     logger.debug({ channelId, limit }, "Getting review messages");
     return messagesRepository.getReviewMessages(channelId, limit);
   }
+
+  /**
+   * Public, read-only semantic search over the persistent message archive.
+   * Embeds the query, searches Qdrant, returns text + metadata. Best-effort:
+   * if embeddings/Qdrant are unavailable, returns an empty result set.
+   */
+  async semanticSearch(
+    input: SemanticSearchQuery,
+  ): Promise<{ results: ReturnType<typeof mapSearchHit>[]; nextCursor: null }> {
+    const vector = await embedQuery(input.query);
+    if (!vector) {
+      logger.debug(
+        { query: input.query },
+        "semantic search skipped: no embedder",
+      );
+      return { results: [], nextCursor: null };
+    }
+    const hits = await searchArchive(vector, input.limit, 0.6);
+    const results = hits.map((h) => mapSearchHit(h));
+    return { results, nextCursor: null };
+  }
+}
+
+/** Shape returned to the frontend (text + metadata from the archive payload). */
+function mapSearchHit(hit: {
+  score: number;
+  payload: { text: string; content_hash?: string; analyzed_at: number };
+}) {
+  return {
+    message_id: hit.payload.content_hash ?? null,
+    content: hit.payload.text,
+    score: hit.score,
+    created_at: hit.payload.analyzed_at,
+  };
 }
 
 export const messagesService = new MessagesService();

services/backend/src/modules/messages/qdrant.ts

@@ -0,0 +1,95 @@
+import { config } from "@/shared/config/index.js";
+import { createChildLogger } from "@/shared/logger/index.js";
+
+const logger = createChildLogger("messages-qdrant");
+
+export interface ArchiveHit {
+  score: number;
+  payload: {
+    text: string;
+    content_hash?: string;
+    analyzed_at: number;
+    expires_at: number;
+  };
+}
+
+function baseUrl(): string {
+  return (config.QDRANT_URL ?? "http://100.121.180.82:6333").replace(
+    /\/+$/,
+    "",
+  );
+}
+
+function headers(): Record<string, string> {
+  const h: Record<string, string> = { "Content-Type": "application/json" };
+  if (config.QDRANT_API_KEY) h["api-key"] = config.QDRANT_API_KEY;
+  return h;
+}
+
+export const ARCHIVE_COLLECTION =
+  config.QDRANT_ARCHIVE_COLLECTION ?? "gmw_message_archive";
+
+async function request(
+  method: string,
+  path: string,
+  body?: unknown,
+  timeoutMs = 10_000,
+): Promise<unknown> {
+  const controller = new AbortController();
+  const timer = setTimeout(() => controller.abort(), timeoutMs);
+  try {
+    const res = await fetch(`${baseUrl()}${path}`, {
+      method,
+      headers: headers(),
+      body: body === undefined ? undefined : JSON.stringify(body),
+      signal: controller.signal,
+    });
+    const text = await res.text();
+    if (!res.ok) {
+      throw new Error(
+        `Qdrant ${method} ${path} -> ${res.status}: ${text.slice(0, 200)}`,
+      );
+    }
+    return text ? JSON.parse(text) : null;
+  } finally {
+    clearTimeout(timer);
+  }
+}
+
+/** Search the archive collection for the nearest vectors to `vector`. */
+export async function searchArchive(
+  vector: number[],
+  limit: number,
+  scoreThreshold: number,
+): Promise<ArchiveHit[]> {
+  if (!config.QDRANT_URL) return [];
+  try {
+    const json = (await request(
+      "POST",
+      `/collections/${ARCHIVE_COLLECTION}/points/search`,
+      {
+        vector,
+        limit,
+        score_threshold: scoreThreshold,
+        with_payload: true,
+      },
+    )) as {
+      result?: Array<{
+        score?: number;
+        payload?: ArchiveHit["payload"];
+      }>;
+    };
+    return (json.result ?? [])
+      .filter((h) => h.payload?.text)
+      .map((h) => ({
+        score: h.score ?? 0,
+        payload: h.payload as ArchiveHit["payload"],
+      }));
+  } catch (error) {
+    logger.warn(
+      { error: error instanceof Error ? error.message : String(error) },
+      "archive search failed",
+    );
+    return [];
+  }
+}

services/backend/src/modules/moderation/index.ts

@@ -1 +0,0 @@
-export { createModerationRouter } from "./moderation.routes.js";

services/backend/src/modules/moderation/moderation.repository.ts

@@ -17,6 +17,20 @@ const ACTION_TYPES = [
 ] as const;
 const STATUSES = ["pending", "executed", "failed"] as const;
 
+/** Parse a JSON-stringified array column (e.g. flags/categories/evidence).
+ *  Returns null on empty/malformed input so the FE can treat it as "no data". */
+function parseJsonArray(value: unknown): string[] | null {
+  if (value == null) return null;
+  const str = typeof value === "string" ? value : String(value);
+  if (str.length === 0) return null;
+  try {
+    const parsed = JSON.parse(str);
+    return Array.isArray(parsed) ? (parsed as string[]) : null;
+  } catch {
+    return null;
+  }
+}
+
 export class ModerationRepository {
   async getStats() {
     const db = getDatabase();
@@ -103,6 +117,13 @@ export class ModerationRepository {
         a.error,
         a.created_at,
         a.executed_at,
+        a.flags,
+        a.categories,
+        a.severity,
+        a.confidence,
+        a.score,
+        a.evidence,
+        a.policy_version,
         m.username,
         LEFT(m.content, 300) AS content
       FROM moderation_actions a
@@ -126,6 +147,13 @@ export class ModerationRepository {
       error: r.error ? String(r.error) : null,
       created_at: r.created_at ? Number(r.created_at) : null,
       executed_at: r.executed_at ? Number(r.executed_at) : null,
+      flags: parseJsonArray(r.flags),
+      categories: parseJsonArray(r.categories),
+      severity: r.severity ? String(r.severity) : null,
+      confidence: r.confidence != null ? Number(r.confidence) : null,
+      score: r.score != null ? Number(r.score) : null,
+      evidence: parseJsonArray(r.evidence),
+      policy_version: r.policy_version ? String(r.policy_version) : null,
       username: r.username ? String(r.username) : null,
       content: r.content ? String(r.content) : null,
     }));

services/backend/src/modules/moderation/moderation.routes.ts

@@ -1,43 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "../../shared/logger/index.js";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { moderationService } from "./moderation.service.js";
-
-const logger = createChildLogger("moderation.routes");
-
-export function createModerationRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/moderation/stats — moderation action summary
-  router.get(
-    "/moderation/stats",
-    asyncHandler(async (_req: Request, res: Response) => {
-      const stats = await moderationService.getStats();
-      res.json(stats);
-    }),
-  );
-
-  // GET /api/moderation/actions — paginated moderation action log
-  router.get(
-    "/moderation/actions",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 50;
-      const status = req.query.status as string | undefined;
-      const actionType = req.query.actionType as string | undefined;
-      const cursor = req.query.cursor as string | undefined;
-
-      const result = await moderationService.listActions({
-        limit,
-        status,
-        actionType,
-        cursor: cursor ? Number(cursor) : undefined,
-      });
-
-      logger.debug({ count: result.data.length }, "Moderation actions listed");
-      res.json(result);
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/recordings/index.ts

@@ -1 +0,0 @@
-export { createRecordingsRouter } from "./recordings.routes.js";

services/backend/src/modules/recordings/recordings.routes.ts

@@ -1,41 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { recordingsService } from "./recordings.service.js";
-
-const logger = createChildLogger("recordings.routes");
-
-export function createRecordingsRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/recordings
-  router.get(
-    "/recordings",
-    asyncHandler(async (req: Request, res: Response) => {
-      const limit = Number(req.query.limit) || 50;
-      const channelId = req.query.channelId as string | undefined;
-      const userId = req.query.userId as string | undefined;
-      const cursor = req.query.cursor as string | undefined;
-      logger.debug({ limit, channelId, userId, cursor }, "Fetching recordings");
-      const result = await recordingsService.getRecent(limit, {
-        channelId,
-        userId,
-        cursor,
-      });
-      res.json(result);
-    }),
-  );
-
-  // DELETE /api/recordings/:id
-  router.delete(
-    "/recordings/:id",
-    asyncHandler(async (req: Request, res: Response) => {
-      const id = req.params.id as string;
-      await recordingsService.deleteById(id);
-      res.json({ ok: true });
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/ui-state/index.ts

@@ -1 +0,0 @@
-export { createUiStateRouter } from "./ui-state.routes.js";

services/backend/src/modules/ui-state/ui-state.routes.ts

@@ -1,34 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { uiStateService } from "./ui-state.service.js";
-
-const logger = createChildLogger("ui-state.routes");
-
-export function createUiStateRouter(): Router {
-  const router = express.Router();
-
-  // GET /api/ui-state
-  router.get(
-    "/ui-state",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Fetching UI state");
-      const state = await uiStateService.getState();
-      res.json(state);
-    }),
-  );
-
-  // POST /api/ui-state
-  router.post(
-    "/ui-state",
-    asyncHandler(async (req: Request, res: Response) => {
-      const updates = req.body as Record<string, unknown>;
-      logger.debug({ keys: Object.keys(updates) }, "Updating UI state");
-      const result = await uiStateService.updateState(updates);
-      res.json(result);
-    }),
-  );
-
-  return router;
-}

services/backend/src/modules/voice/index.ts

@@ -1 +0,0 @@
-export { createVoiceRouter } from "./voice.routes.js";

services/backend/src/modules/voice/voice.controller.ts

@@ -1,45 +0,0 @@
-import type { Request, Response } from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler } from "../../shared/middlewares/index.js";
-import { publishCommandNoReply } from "../../shared/redis/index.js";
-import type { ConnectVoiceInput, VoiceCommandInput } from "./voice.schema.js";
-import {
-  connectVoice,
-  disconnectVoice,
-  getVoiceStatus,
-} from "./voice.service.js";
-
-const logger = createChildLogger("voice.controller");
-
-export const handleGetVoiceStatus = asyncHandler(
-  async (_req: Request, res: Response) => {
-    const status = await getVoiceStatus();
-    res.json(status);
-  },
-);
-
-export const handleConnectVoice = asyncHandler(
-  async (req: Request, res: Response) => {
-    const { guildId, channelId } = req.body as ConnectVoiceInput;
-    logger.debug({ guildId, channelId }, "Connecting to voice channel");
-    const status = await connectVoice(guildId, channelId);
-    res.json(status);
-  },
-);
-
-export const handleDisconnectVoice = asyncHandler(
-  async (_req: Request, res: Response) => {
-    logger.debug("Disconnecting from voice");
-    const status = await disconnectVoice();
-    res.json(status);
-  },
-);
-
-export const handleVoiceCommand = asyncHandler(
-  async (req: Request, res: Response) => {
-    const { command } = req.body as VoiceCommandInput;
-    logger.debug({ command }, "Publishing voice command");
-    await publishCommandNoReply(command);
-    res.json({ success: true, command });
-  },
-);

services/backend/src/modules/voice/voice.routes.ts

@@ -1,80 +0,0 @@
-import type { Request, Response, Router } from "express";
-import express from "express";
-import { createChildLogger } from "@/shared/logger/index";
-import { asyncHandler, validateBody } from "../../shared/middlewares/index.js";
-import {
-  handleConnectVoice,
-  handleDisconnectVoice,
-  handleGetVoiceStatus,
-  handleVoiceCommand,
-} from "./voice.controller.js";
-import { connectVoiceSchema, voiceCommandSchema } from "./voice.schema.js";
-import {
-  getGuilds,
-  getTextChannels,
-  getVoiceChannels,
-} from "./voice.service.js";
-
-const logger = createChildLogger("voice.routes");
-
-export function createVoiceRouter(): Router {
-  const router = express.Router();
-
-  // ── Guilds ──────────────────────────────────────────────────────────────
-
-  // GET /api/guilds
-  router.get(
-    "/guilds",
-    asyncHandler(async (_req: Request, res: Response) => {
-      logger.debug("Fetching guilds");
-      const guilds = await getGuilds();
-      res.json(guilds);
-    }),
-  );
-
-  // GET /api/guilds/:guildId/channels
-  router.get(
-    "/guilds/:guildId/channels",
-    asyncHandler(async (req: Request, res: Response) => {
-      const guildId = req.params.guildId as string;
-      logger.debug({ guildId }, "Fetching text channels");
-      const channels = await getTextChannels(guildId);
-      res.json(channels);
-    }),
-  );
-
-  // GET /api/guilds/:guildId/voice-channels
-  router.get(
-    "/guilds/:guildId/voice-channels",
-    asyncHandler(async (req: Request, res: Response) => {
-      const guildId = req.params.guildId as string;
-      logger.debug({ guildId }, "Fetching voice channels");
-      const channels = await getVoiceChannels(guildId);
-      res.json(channels);
-    }),
-  );
-
-  // ── Voice connection ────────────────────────────────────────────────────
-
-  // GET /api/voice/status
-  router.get("/voice/status", handleGetVoiceStatus);
-
-  // POST /api/voice/connect
-  router.post(
-    "/voice/connect",
-    validateBody(connectVoiceSchema),
-    handleConnectVoice,
-  );
-
-  // POST /api/voice/disconnect
-  router.post("/voice/disconnect", handleDisconnectVoice);
-
-  // POST /api/voice/command — send arbitrary voice command (transmit start/stop)
-  router.post(
-    "/voice/command",
-    validateBody(voiceCommandSchema),
-    handleVoiceCommand,
-  );
-
-  return router;
-}

services/backend/src/orpc/router.ts

@@ -0,0 +1,350 @@
+import { os } from "@orpc/server";
+import { z } from "zod";
+import { analysisService } from "../modules/analysis/analysis.service";
+import { chatRequestSchema } from "../modules/chatbot/chatbot.schema";
+import { chatbotService } from "../modules/chatbot/chatbot.service";
+// ── Service imports ──────────────────────────────────────────────
+import { dashboardService } from "../modules/dashboard/dashboard.service";
+import {
+  mediaLoopSchema,
+  mediaQueueSchema,
+} from "../modules/media/media.schema";
+import {
+  getStatus,
+  queue,
+  setLoop,
+  skip,
+  stop,
+} from "../modules/media/media.service";
+import {
+  messageQuerySchema,
+  semanticSearchSchema,
+} from "../modules/messages/messages.schema";
+import { messagesService } from "../modules/messages/messages.service";
+import { moderationService } from "../modules/moderation/moderation.service";
+import { recordingsService } from "../modules/recordings/recordings.service";
+import { uiStateService } from "../modules/ui-state/ui-state.service";
+import {
+  connectVoice,
+  disconnectVoice,
+  getGuilds,
+  getTextChannels,
+  getVoiceChannels,
+  getVoiceStatus,
+} from "../modules/voice/voice.service";
+import { config } from "../shared/config/index";
+import { publishCommandNoReply } from "../shared/redis/index";
+
+// ── Dashboard ────────────────────────────────────────────────────
+const dashboardRouter = {
+  stats: os.handler(() => dashboardService.getStats()),
+  activity: os
+    .input(
+      z.object({ days: z.coerce.number().int().min(1).max(90).default(14) }),
+    )
+    .handler(({ input }) => dashboardService.getActivity(input.days)),
+  users: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().default(20),
+        cursor: z.string().optional(),
+        search: z.string().optional(),
+      }),
+    )
+    .handler(({ input }) =>
+      dashboardService.listUsers({
+        limit: input.limit,
+        cursor: input.cursor,
+        search: input.search,
+      }),
+    ),
+  userDetail: os
+    .input(z.object({ userId: z.string() }))
+    .handler(({ input }) => dashboardService.getUserDetail(input.userId)),
+  channels: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().default(20),
+        search: z.string().optional(),
+        guildId: z.string().optional(),
+      }),
+    )
+    .handler(({ input }) =>
+      dashboardService.listChannels({
+        limit: input.limit,
+        search: input.search,
+        guildId: input.guildId,
+      }),
+    ),
+  channelDetail: os
+    .input(z.object({ channelId: z.string() }))
+    .handler(({ input }) => dashboardService.getChannelDetail(input.channelId)),
+  reactions: os
+    .input(z.object({ limit: z.coerce.number().int().positive().default(20) }))
+    .handler(({ input }) => dashboardService.getTopReactions(input.limit)),
+  reactors: os
+    .input(z.object({ limit: z.coerce.number().int().positive().default(20) }))
+    .handler(({ input }) => dashboardService.getTopReactors(input.limit)),
+};
+
+// ── Messages ─────────────────────────────────────────────────────
+const messagesRouter = {
+  list: os
+    .input(messageQuerySchema)
+    .handler(({ input }) => messagesService.listMessages(input)),
+  byChannel: os
+    .input(
+      z.object({
+        channelId: z.string(),
+        query: messageQuerySchema,
+      }),
+    )
+    .handler(({ input }) =>
+      messagesService.getMessagesByChannel(input.channelId, input.query),
+    ),
+  detail: os
+    .input(z.object({ id: z.string() }))
+    .handler(({ input }) => messagesService.getMessageById(input.id)),
+  images: os
+    .input(
+      z.object({
+        guildId: z.string(),
+        limit: z.coerce.number().int().positive().default(50),
+      }),
+    )
+    .handler(({ input }) =>
+      messagesService.getImageMessages(input.guildId, input.limit),
+    ),
+  attachmentsByChannel: os
+    .input(
+      z.object({
+        channelId: z.string(),
+        query: messageQuerySchema,
+      }),
+    )
+    .handler(({ input }) =>
+      messagesService.getAttachmentsByChannel(input.channelId, input.query),
+    ),
+  review: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().default(20),
+        channelId: z.string().optional(),
+      }),
+    )
+    .handler(async ({ input }) => {
+      const rows = await messagesService.getReviewMessages(
+        input.channelId,
+        input.limit,
+      );
+      return { results: rows, limit: input.limit, cursor: null };
+    }),
+  // Public, read-only semantic search over the message archive.
+  semanticSearch: os
+    .input(semanticSearchSchema)
+    .handler(({ input }) => messagesService.semanticSearch(input)),
+};
+
+// ── Moderation ───────────────────────────────────────────────────
+const moderationRouter = {
+  stats: os.handler(() => moderationService.getStats()),
+  actions: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().default(50),
+        status: z.string().optional(),
+        actionType: z.string().optional(),
+        cursor: z.coerce.number().int().optional(),
+      }),
+    )
+    .handler(({ input }) =>
+      moderationService.listActions({
+        limit: input.limit,
+        status: input.status,
+        actionType: input.actionType,
+        cursor: input.cursor,
+      }),
+    ),
+};
+
+// ── Media ────────────────────────────────────────────────────────
+const mediaRouter = {
+  status: os.handler(() => getStatus()),
+  queue: os.input(mediaQueueSchema).handler(async ({ input }) => {
+    await queue(input.source, input.mode);
+    return getStatus();
+  }),
+  skip: os.handler(async () => {
+    await skip();
+    return getStatus();
+  }),
+  stop: os.handler(async () => {
+    await stop();
+    return getStatus();
+  }),
+  loop: os.input(mediaLoopSchema).handler(async ({ input }) => {
+    await setLoop(input.loop);
+    return getStatus();
+  }),
+};
+
+// ── Voice ─────────────────────────────────────────────────────────
+const voiceRouter = {
+  guilds: os.handler(() => getGuilds()),
+  textChannels: os
+    .input(z.object({ guildId: z.string() }))
+    .handler(({ input }) => getTextChannels(input.guildId)),
+  voiceChannels: os
+    .input(z.object({ guildId: z.string() }))
+    .handler(({ input }) => getVoiceChannels(input.guildId)),
+  status: os.handler(() => getVoiceStatus()),
+  connect: os
+    .input(z.object({ guildId: z.string(), channelId: z.string() }))
+    .handler(async ({ input }) => {
+      await connectVoice(input.guildId, input.channelId);
+      return getVoiceStatus();
+    }),
+  disconnect: os.handler(async () => {
+    await disconnectVoice();
+    return getVoiceStatus();
+  }),
+  command: os
+    .input(z.object({ command: z.string().min(1) }))
+    .handler(async ({ input }) => {
+      await publishCommandNoReply(input.command);
+      return { success: true, command: input.command };
+    }),
+};
+
+// ── Recordings ───────────────────────────────────────────────────
+const recordingsRouter = {
+  list: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().default(50),
+        channelId: z.string().optional(),
+        userId: z.string().optional(),
+        cursor: z.string().optional(),
+      }),
+    )
+    .handler(({ input }) =>
+      recordingsService.getRecent(input.limit, {
+        channelId: input.channelId,
+        userId: input.userId,
+        cursor: input.cursor,
+      }),
+    ),
+  delete: os.input(z.object({ id: z.string() })).handler(async ({ input }) => {
+    await recordingsService.deleteById(input.id);
+    return { ok: true };
+  }),
+};
+
+// ── Analysis (search) ──────────────────────────────────────────────
+const analysisRouter = {
+  search: os
+    .input(
+      z.object({
+        q: z.string().default(""),
+        channelId: z.string().optional(),
+        limit: z.coerce.number().int().positive().default(20),
+      }),
+    )
+    .handler(({ input }) =>
+      analysisService.search({
+        q: input.q,
+        channelId: input.channelId,
+        limit: input.limit,
+      }),
+    ),
+};
+
+// ── Chatbot ───────────────────────────────────────────────────────
+const chatbotRouter = {
+  chat: os
+    .input(
+      chatRequestSchema.extend({
+        // Per-device actor id; the old REST layer used an X-User-Id header.
+        // Anonymous sessions use a stable "anonymous" id.
+        userId: z.string().optional(),
+      }),
+    )
+    .handler(async ({ input }) => {
+      const userId = input.userId ?? "anonymous";
+      const response = await chatbotService.processMessage(
+        input.message,
+        input.context,
+        userId,
+      );
+      await chatbotService.saveConversation({
+        userId,
+        userMessage: input.message,
+        botResponse: response,
+        context: input.context,
+        timestamp: new Date(),
+      });
+      return { response, timestamp: new Date().toISOString() };
+    }),
+  history: os
+    .input(
+      z.object({
+        limit: z.coerce.number().int().positive().max(100).default(50),
+        userId: z.string().optional(),
+      }),
+    )
+    .handler(async ({ input }) => {
+      const userId = input.userId ?? "anonymous";
+      const history = await chatbotService.getChatHistory(userId, input.limit);
+      return { history, total: history.length };
+    }),
+  clearHistory: os
+    .input(z.object({ userId: z.string().optional() }))
+    .handler(async ({ input }) => {
+      const userId = input.userId ?? "anonymous";
+      await chatbotService.clearChatHistory(userId);
+      return { ok: true };
+    }),
+};
+
+// ── Config (public dashboard config snapshot) ──────────────────────
+const configRouter = {
+  get: os.handler(() => ({
+    monitorGuildId: config.MONITOR_GUILD_ID || null,
+    webserverPort: config.WEBSERVER_PORT,
+    nodeEnv: config.NODE_ENV,
+    backlogSyncHours: config.BACKLOG_SYNC_HOURS,
+    backlogSyncBatchSize: config.BACKLOG_SYNC_BATCH_SIZE,
+    retentionMessagesDays: config.RETENTION_MESSAGES_DAYS,
+    retentionAttachmentsDays: config.RETENTION_ATTACHMENTS_DAYS,
+    retentionVoiceDays: config.RETENTION_VOICE_DAYS,
+    autoDeleteFlaggedEnabled: config.AUTO_DELETE_FLAGGED_ENABLED,
+    aiAnalysisEnabled: config.AI_ANALYSIS_ENABLED,
+    voiceGuildId: config.VOICE_GUILD_ID || null,
+    voiceChannelId: config.VOICE_CHANNEL_ID || null,
+    logLevel: config.LOG_LEVEL,
+  })),
+};
+
+// ── UI State ──────────────────────────────────────────────────────
+const uiStateRouter = {
+  get: os.handler(() => uiStateService.getState()),
+  update: os
+    .input(z.record(z.string(), z.unknown()))
+    .handler(({ input }) => uiStateService.updateState(input)),
+};
+
+// ── Root router ───────────────────────────────────────────────────
+export const appRouter = {
+  dashboard: dashboardRouter,
+  messages: messagesRouter,
+  moderation: moderationRouter,
+  media: mediaRouter,
+  voice: voiceRouter,
+  recordings: recordingsRouter,
+  analysis: analysisRouter,
+  chatbot: chatbotRouter,
+  config: configRouter,
+  uiState: uiStateRouter,
+};
+
+export type AppRouter = typeof appRouter;

services/backend/src/orpc/ws.ts

@@ -0,0 +1,43 @@
+import type { IncomingMessage, Server } from "node:http";
+import type { Duplex } from "node:stream";
+import { onError } from "@orpc/server";
+import { RPCHandler } from "@orpc/server/ws";
+import { WebSocketServer } from "ws";
+import { createChildLogger } from "@/shared/logger/index";
+import { appRouter } from "./router";
+
+const logger = createChildLogger("orpc.ws");
+
+/**
+ * Attach the oRPC WebSocket handler to the shared HTTP server, on a path
+ * SEPARATE from the voice/binary WebSocket (`/ws`). All structured data RPCs
+ * (dashboard, messages, moderation, media, voice control, recordings,
+ * analysis, chatbot, config, ui-state) flow over this `/trpc` socket; the
+ * `/ws` socket is left untouched for Discord PCM audio + gateway events.
+ *
+ * We use `noServer` + a manual `upgrade` router (instead of
+ * `new WebSocketServer({ server, path: "/trpc" })`) because two `ws` servers
+ * mounted with the `server` option on the SAME http.Server both register
+ * `upgrade` listeners, and `ws`'s path-guarded listener can reject (400) the
+ * other server's path. Routing the upgrade ourselves by URL keeps `/trpc`
+ * and `/ws` fully isolated.
+ */
+export function createORPCWebSocketServer(server: Server): WebSocketServer {
+  const handler = new RPCHandler(appRouter, {
+    interceptors: [
+      onError((error) => logger.error({ error }, "oRPC WS error")),
+    ],
+  });
+
+  const wss = new WebSocketServer({ noServer: true, perMessageDeflate: false });
+
+  server.on("upgrade", (req: IncomingMessage, socket: Duplex, head: Buffer) => {
+    if (!req.url?.startsWith("/trpc")) return; // let the /ws server handle it
+    wss.handleUpgrade(req, socket, head, (ws) => {
+      handler.upgrade(ws, { context: {} });
+    });
+  });
+
+  logger.info({ path: "/trpc" }, "oRPC WebSocket server attached");
+  return wss;
+}

services/backend/src/shared/config/index.ts

@@ -134,6 +134,7 @@ export const configSchema = z
       .default("https://9router.asepharyana.my.id/v1"),
     AI_LLM_MODEL: z.string().default("text"),
     AI_LLM_VISION_MODEL: z.string().optional(),
+    AI_LLM_EMBEDDING_MODEL: z.string().optional(),
     AI_LLM_MAX_CONCURRENT: z.coerce.number().int().positive().default(5),
     AI_LLM_IMAGE_MAX_DIMENSION: z.coerce
       .number()
@@ -208,6 +209,11 @@ export const configSchema = z
       .default("https://api.openai.com/v1"),
     OPENAI_MODERATION_MODEL: z.string().default("omni-moderation-latest"),
 
+    // ── Qdrant (message archive for semantic search) ──────────────────
+    QDRANT_URL: z.string().optional(),
+    QDRANT_API_KEY: z.string().optional(),
+    QDRANT_ARCHIVE_COLLECTION: z.string().default("gmw_message_archive"),
+
     // ── Auto Delete ─────────────────────────────────────────────────────
     AUTO_DELETE_FLAGGED_ENABLED: z
       .string()

services/backend/src/shared/database/schema.ts

@@ -62,6 +62,9 @@ export const pgMessagesTable = pgTable(
       enum: ["none", "monitor", "warn", "review", "delete", "escalate"],
     }),
     ai_analyzed_at: pgBigint("ai_analyzed_at", { mode: "number" }),
+    ai_analysis_duration_ms: pgBigint("ai_analysis_duration_ms", {
+      mode: "number",
+    }),
     ai_error: pgText("ai_error"),
   },
   (table) => ({

services/backend/src/shared/moderation-types.ts

@@ -80,6 +80,7 @@ export interface MessageRecord {
   ai_confidence?: number | null;
   ai_recommended_action?: AIRecommendedAction | null;
   ai_analyzed_at?: number | null;
+  ai_analysis_duration_ms?: number | null;
   ai_error?: string | null;
 }
 

services/backend/src/shared/utils/index.ts

@@ -108,5 +108,5 @@ export async function retryWithBackoff<T>(
       });
     }
   }
-  throw lastError!;
+  throw lastError ?? new Error("Request failed after all retries");
 }

services/backend/src/shared/utils/messageMapper.ts

@@ -24,6 +24,7 @@ export interface MappedMessage {
   ai_confidence: number | null;
   ai_recommended_action: string | null;
   ai_analyzed_at: number | null;
+  ai_analysis_duration_ms: number | null;
   ai_error: string | null;
   is_reply: boolean | null;
   is_forward: boolean | null;
@@ -58,6 +59,8 @@ export function mapMessageRow(row: Record<string, unknown>): MappedMessage {
     ai_confidence: (row.ai_confidence as number | null) ?? null,
     ai_recommended_action: (row.ai_recommended_action as string | null) ?? null,
     ai_analyzed_at: (row.ai_analyzed_at as number | null) ?? null,
+    ai_analysis_duration_ms:
+      (row.ai_analysis_duration_ms as number | null) ?? null,
     ai_error: (row.ai_error as string | null) ?? null,
     is_reply: row.is_reply === null ? null : Boolean(row.is_reply),
     is_forward: row.is_forward === null ? null : Boolean(row.is_forward),

services/backend/src/ws/server.ts

@@ -1,5 +1,7 @@
-import type { Server } from "node:http";
+import type { IncomingMessage, Server } from "node:http";
+import type { Duplex } from "node:stream";
 import { WebSocket, WebSocketServer } from "ws";
+import { messagesService } from "../modules/messages/messages.service.js";
 import { config } from "../shared/config/index.js";
 import { BACKEND_COMMAND, BACKEND_VOICE_TRANSMIT } from "../shared/index.js";
 import { createChildLogger } from "../shared/logger/index.js";
@@ -96,9 +98,20 @@ export function createWebSocketServer(server: Server): WebSocketServer {
   const frontendClients = new Set<WebSocket>();
   const gatewayClients = new Set<WebSocket>();
 
-  const wss = new WebSocketServer({ server, path: "/ws" });
+  const wss = new WebSocketServer({ noServer: true, perMessageDeflate: true });
   _wss = wss;
 
+  // Manual upgrade routing: without this, two `ws` servers bound to the same
+  // http.Server via the `server` option both register `upgrade` listeners and
+  // the path-guarded one destructively rejects the other's path (400). We own
+  // the upgrade event and dispatch by URL instead.
+  server.on("upgrade", (req: IncomingMessage, socket: Duplex, head: Buffer) => {
+    if (!req.url?.startsWith("/ws")) return;
+    wss.handleUpgrade(req, socket, head, (ws) => {
+      wss.emit("connection", ws, req);
+    });
+  });
+
   // Map-based dispatcher for JSON WebSocket message types
   const jsonHandlers = new Map<string, MessageHandler>();
 
@@ -128,6 +141,73 @@ export function createWebSocketServer(server: Server): WebSocketServer {
     );
   });
 
+  // Stream historical messages one-by-one over WS (no 50-row batch).
+  // The frontend requests it once per channel switch; the backend emits one
+  // `message_snapshot` frame per message so the UI renders progressively.
+  jsonHandlers.set("stream_messages", async (ws, message) => {
+    if (ws.readyState !== WebSocket.OPEN) return;
+    const payload = (message.payload ?? {}) as {
+      guildId?: string;
+      channelId?: string;
+      cursor?: string;
+      limit?: number;
+    };
+    const guildId = payload.guildId;
+    const channelId = payload.channelId;
+    if (!guildId && !channelId) {
+      logger.warn({ payload }, "stream_messages requires guildId or channelId");
+      return;
+    }
+
+    const pageSize = 50; // internal DB page size; still emitted one frame at a time
+    const maxFrames = Math.min(payload.limit ?? 200, 500);
+
+    let sent = 0;
+    let nextCursor: string | null = null;
+    try {
+      for await (const msg of messagesService.streamMessages(
+        {
+          guildId,
+          channelId,
+          cursor: payload.cursor,
+        } as never,
+        pageSize,
+      )) {
+        if (ws.readyState !== WebSocket.OPEN) break;
+        // Streamed DESC (newest first); the oldest emitted carries the smallest
+        // created_at, which is exactly the next-page cursor for "load older".
+        const createdAt = (msg as { created_at?: number }).created_at;
+        if (createdAt !== undefined) nextCursor = String(createdAt);
+        ws.send(
+          JSON.stringify({
+            type: "message_snapshot",
+            data: msg,
+          }),
+        );
+        sent++;
+        if (sent >= maxFrames) break;
+      }
+      if (ws.readyState === WebSocket.OPEN) {
+        ws.send(
+          JSON.stringify({
+            type: "message_snapshot_end",
+            data: { sent, nextCursor },
+          }),
+        );
+      }
+    } catch (err) {
+      logger.error({ err }, "stream_messages failed");
+      if (ws.readyState === WebSocket.OPEN) {
+        ws.send(
+          JSON.stringify({
+            type: "message_snapshot_end",
+            data: { sent, nextCursor, error: true },
+          }),
+        );
+      }
+    }
+  });
+
   wss.on("connection", (ws: WebSocket, req) => {
     // Parse auth token from query string
     const rawUrl = req.url ?? "/";

services/backend/tests/chatbot-tools.test.ts

@@ -0,0 +1,57 @@
+import { describe, expect, it } from "vitest";
+import { tools } from "../src/modules/chatbot/chatbot.toolDefs.js";
+
+const names = tools.map((t) => t.function.name);
+
+describe("chatbot tool definitions", () => {
+  it("exposes a stable, non-empty tool set", () => {
+    expect(tools.length).toBeGreaterThanOrEqual(10);
+    expect(new Set(names).size).toBe(names.length); // no dup names
+  });
+
+  it("every tool declares a name, description, and object parameters", () => {
+    for (const t of tools) {
+      expect(t.type).toBe("function");
+      expect(typeof t.function.name).toBe("string");
+      expect(t.function.description.length).toBeGreaterThan(10);
+      expect(t.function.parameters.type).toBe("object");
+    }
+  });
+
+  it("required-only tools declare required args", () => {
+    const byName = new Map(tools.map((t) => [t.function.name, t]));
+    for (const [name, required] of [
+      ["search_messages", "query"],
+      ["get_user_messages", "userId"],
+      ["get_user_profile", "userId"],
+      ["get_user_reputation", "userId"],
+      ["get_channel_culture", "channelId"],
+      ["get_message_detail", "messageId"],
+    ] as const) {
+      const tool = byName.get(name);
+      expect(tool, `missing tool ${name}`).toBeDefined();
+      expect(tool?.function.parameters.required).toContain(required);
+    }
+  });
+
+  it("covers the core server-watcher situations", () => {
+    for (const required of [
+      "get_server_stats",
+      "get_top_channels",
+      "get_recent_activity",
+      "get_top_flagged",
+      "search_messages",
+      "get_user_messages",
+      "get_user_profile",
+      "get_user_reputation",
+      "get_channel_culture",
+      "get_message_detail",
+      "get_message_reviews",
+      "get_voice_recordings",
+      "get_moderation_timeline",
+      "get_corrections",
+    ]) {
+      expect(names, `missing ${required}`).toContain(required);
+    }
+  });
+});

services/backend/tests/stream-many.test.ts

@@ -0,0 +1,114 @@
+import { describe, expect, it } from "vitest";
+
+/**
+ * Lock the contract that the WS `stream_messages` handler + frontend
+ * `useMessagesStream` depend on.
+ *
+ * Real behavior (src/modules/messages/messages.repository.ts → streamMany, and
+ * src/ws/server.ts stream_messages handler):
+ *  - ONE `stream_messages` request streams the WHOLE history for the scope,
+ *    internally paging `limit+1` at a time (cursor = oldest created_at of the
+ *    page) until exhausted or maxFrames is hit.
+ *  - Messages are emitted ONE AT A TIME, DESC (newest first).
+ *  - The final `message_snapshot_end` carries `nextCursor` = the OLDEST emitted
+ *    row's `created_at`, so the FE's next "load older" request pages forward.
+ *
+ * We replicate streamMany's pagination algorithm over an in-memory array so the
+ * test needs no DB.
+ */
+
+type Row = { id: string; created_at: number; guild_id: string };
+
+function makeStream(
+  rows: Row[],
+  query: { guildId?: string; channelId?: string; cursor?: string },
+  pageSize = 50,
+): () => Generator<Row, void, unknown> {
+  return function* () {
+    let cursor = query.cursor;
+    while (true) {
+      const page = rows
+        .filter((r) => (query.guildId ? r.guild_id === query.guildId : true))
+        .filter((r) => (cursor ? r.created_at < Number(cursor) : true))
+        .sort((a, b) => b.created_at - a.created_at)
+        .slice(0, pageSize + 1);
+
+      if (page.length === 0) return;
+      const hasMore = page.length > pageSize;
+      const pageRows = hasMore ? page.slice(0, pageSize) : page;
+      for (const r of pageRows) yield r;
+      if (!hasMore) return;
+      cursor = String(page[pageSize - 1].created_at);
+    }
+  };
+}
+
+function streamAll(
+  rows: Row[],
+  query: { guildId?: string; channelId?: string; cursor?: string },
+  pageSize = 50,
+  maxFrames = Infinity,
+): { data: Row[]; nextCursor: string | null } {
+  const data: Row[] = [];
+  let nextCursor: string | null = null;
+  for (const r of makeStream(rows, query, pageSize)()) {
+    nextCursor = String(r.created_at);
+    data.push(r);
+    if (data.length >= maxFrames) break;
+  }
+  return { data, nextCursor };
+}
+
+const mk = (id: string, created_at: number, guild_id = "g1"): Row => ({
+  id,
+  created_at,
+  guild_id,
+});
+
+describe("messages.streamMany contract", () => {
+  it("emits newest-first and sets nextCursor to oldest created_at", () => {
+    const rows = [mk("a", 300), mk("b", 200), mk("c", 100)];
+    const { data, nextCursor } = streamAll(rows, { guildId: "g1" });
+    expect(data.map((r) => r.id)).toEqual(["a", "b", "c"]);
+    expect(nextCursor).toBe("100"); // oldest emitted
+  });
+
+  it("streams the entire history in one request, one frame at a time", () => {
+    // 120 rows; one request must yield all 120 (no 50-row batch boundary).
+    const rows = Array.from({ length: 120 }, (_, i) => mk(`m${i}`, 1000 - i));
+    const { data, nextCursor } = streamAll(rows, { guildId: "g1" }, 50);
+    expect(data).toHaveLength(120);
+    expect(data[0].id).toBe("m0"); // newest first
+    expect(nextCursor).toBe("881"); // oldest = m119 (1000-119)
+  });
+
+  it("honors a frame cap and leaves nextCursor mid-history", () => {
+    const rows = Array.from({ length: 120 }, (_, i) => mk(`m${i}`, 1000 - i));
+    const { data, nextCursor } = streamAll(rows, { guildId: "g1" }, 50, 60);
+    expect(data).toHaveLength(60);
+    // nextCursor = 60th oldest = m59 (1000-59=941)
+    expect(nextCursor).toBe("941");
+  });
+
+  it("paginates correctly across subsequent load-older requests", () => {
+    const rows = Array.from({ length: 120 }, (_, i) => mk(`m${i}`, 1000 - i));
+    const first = streamAll(rows, { guildId: "g1" }, 50, 50);
+    expect(first.data).toHaveLength(50);
+    expect(first.nextCursor).toBe("951"); // 50th oldest = m49
+
+    const older = streamAll(
+      rows,
+      { guildId: "g1", cursor: first.nextCursor ?? undefined },
+      50,
+      50,
+    );
+    expect(older.data[0].id).toBe("m50"); // continues right after m49
+    expect(older.nextCursor).toBe("901"); // 100th oldest
+  });
+
+  it("filters by guild", () => {
+    const rows = [mk("x", 500, "g1"), mk("y", 400, "g2")];
+    const { data } = streamAll(rows, { guildId: "g2" });
+    expect(data.map((r) => r.id)).toEqual(["y"]);
+  });
+});

services/discord-gateway/ARCHITECTURE.md

@@ -1,172 +1,143 @@
+# Discord Gateway — Architecture
+
+Pure event-driven microservice (no HTTP server). Captures Discord
+messages/voice/attachments/reactions/threads/presence, runs LLM-based AI
+moderation, and publishes everything to Redis pub/sub for the backend to
+consume. The backend serves the HTTP/WS API to the frontend.
+
+> NOTE: this doc is the source of truth for the module layout. The older
+> `MODULE_STRUCTURE.md` was stale (referenced `winston`, `mock-crc.ts`,
+> `indonesianTextNormalizer.ts`, and `aiAnalysisWorker.ts`/`llmModerationClient.ts`
+> which were renamed/merged). If they disagree, this file wins.
+
+## Top-level layout
+
+```
 services/discord-gateway/
 ├── src/
+│   ├── index.ts                     # Entry point → initializeDiscordGateway()
 │   ├── app/
-│   │   ├── bootstrap.ts          # Discord Gateway initialization (no HTTP server)
-│   │   └── shutdown.ts           # Graceful shutdown handler
+│   │   ├── bootstrap.ts             # Wires client, DB, Redis, workers, schedulers
+│   │   ├── shutdown.ts              # Graceful shutdown (SIGINT/SIGTERM + transient errors)
+│   │   └── retention.ts             # Expired-record cleanup scheduler
 │   ├── shared/
-│   │   ├── config/
-│   │   │   └── config.ts         # Environment configuration (Zod validated)
-│   │   ├── database/
-│   │   │   ├── schema.ts         # Drizzle ORM schema
-│   │   │   ├── drizzle.ts        # Database connection
-│   │   │   ├── migrate.ts        # Migration runner
-│   │   │   └── voiceRecordingRepo.ts
-│   │   ├── errors/
-│   │   │   └── errors.ts         # Custom error classes
-│   │   ├── logger/
-│   │   │   ├── logger.ts         # Winston logger wrapper
-│   │   │   └── serialization.ts  # Log value serialization
-│   │   ├── utils/
-│   │   │   └── retry.ts          # Retry with backoff utility
-│   │   └── discord/
-│   │       └── clientOptions.ts  # Discord.js client configuration
-│   ├── modules/
-│   │   ├── message-capture/      # Modular MVC: Message capture & storage
-│   │   │   ├── messageCapture.ts # Controller: Discord event listeners
-│   │   │   ├── messageStore.ts   # Repository: Database operations
-│   │   │   ├── messageMetadata.ts # Service: Message metadata extraction
-│   │   │   ├── types.ts          # Domain types
-│   │   │   └── index.ts          # Module exports
-│   │   ├── ai-moderation/        # Modular MVC: AI analysis & moderation
-│   │   │   ├── aiAnalyzer.ts     # Controller: Analysis orchestration
-│   │   │   ├── llmModerationClient.ts # Service: LLM API client
-│   │   │   ├── aiAnalysisWorker.ts # Service: Worker pool management
-│   │   │   ├── indonesianTextNormalizer.ts # Service: Text normalization
-│   │   │   ├── moderationPrompt.ts # Service: Prompt generation
-│   │   │   └── index.ts          # Module exports
-│   │   ├── voice-recording/      # Modular MVC: Voice recording & streaming
-│   │   │   ├── voiceController.ts # Controller: Voice connection management
-│   │   │   ├── recorder.ts       # Service: Recording orchestration
-│   │   │   ├── recorder/
-│   │   │   │   ├── audioStream.ts # Service: Audio stream subscription
-│   │   │   │   ├── decoder.ts    # Service: Opus decoding
-│   │   │   │   ├── segment.ts    # Service: OGG segment rotation
-│   │   │   │   ├── metadata.ts   # Service: Segment metadata
-│   │   │   │   ├── sessionRecording.ts # Service: Session management
-│   │   │   │   └── uploader.ts   # Service: Segment upload
-│   │   │   └── index.ts          # Module exports
-│   │   ├── attachment-upload/    # Modular MVC: Attachment handling
-│   │   │   ├── attachmentUploader.ts # Service: Upload orchestration
-│   │   │   ├── imageResizer.ts   # Service: Image resizing
-│   │   │   └── index.ts          # Module exports
-│   │   └── event-broadcaster/    # Event-driven: Redis pub/sub
-│   │       ├── eventBroadcaster.ts # Service: Event publishing
-│   │       ├── eventTypes.ts     # Domain: Event type definitions
-│   │       └── index.ts          # Module exports
-│   ├── mock-crc.ts               # CRC polyfill for discord.js
-│   └── index.ts                  # Service entry point
-├── package.json                  # Service dependencies
-└── tsconfig.json                 # TypeScript configuration
+│   │   ├── config/                  # Zod-validated env (index.ts = schema+loader)
+│   │   ├── database/                # Drizzle ORM + pg Pool + migrations
+│   │   │   ├── init.ts drizzle.ts pool.ts migrate.ts migrateCli.ts
+│   │   │   └── schema/              # messages, cache, voice, analytics, meta
+│   │   ├── logger/                  # pino wrapper + createChildLogger()
+│   │   ├── errors/                  # AppError / ConfigError / AudioError ...
+│   │   ├── utils/                   # retry, pagination
+│   │   ├── discord/clientOptions.ts # discord.js-selfbot-v13 client options
+│   │   ├── uploader.ts              # Shared attachment upload helper
+│   │   ├── redis-channels.ts        # Redis channel-name constants
+│   │   └── moderation-types.ts      # Shared AI analysis domain types
+│   └── modules/
+│       ├── message-capture/         # Discord event listeners + DB store
+│       ├── ai-moderation/           # LLM moderation pipeline (see below)
+│       ├── voice-recording/         # Voice connect + Opus→OGG recording
+│       │   └── recorder/            # decoder, segment, session, uploader, oggCrc
+│       ├── voice-pcm-ws/            # Real-time PCM → backend WebSocket (bypasses Redis)
+│       ├── attachment-upload/       # Download + (sharp) resize + upload
+│       ├── event-broadcaster/        # RedisEventPublisher + EventBroadcaster
+│       ├── command-handler/         # Redis-subscribed backend→gateway commands
+│       ├── reaction-tracking/ thread-tracking/ user-presence/
+│       ├── channel-topic/ guild-member-events/
+│       └── gateway-metrics/         # Prometheus /metrics endpoint (port 4016)
+```
 
-## Architecture Patterns
+## AI moderation pipeline (`ai-moderation/`)
 
-### Modular MVC Structure
-Each module follows Controller-Service-Repository pattern:
-- **Controller**: Discord event listeners (messageCapture, aiAnalyzer, voiceController)
-- **Service**: Business logic (messageStore, llmModerationClient, recorder)
-- **Repository**: Data access (messageStore, voiceRecordingRepo)
+LLM-only judge — no regex/heuristic classification. One orchestrator call
+handles a whole batch (text + media split internally, parallel paths).
 
-### Event-Driven Design
-- **Redis Pub/Sub**: All events published to Redis channels
-- **Event Channels**:
-  - `discord:message:created` — New message captured
-  - `discord:message:updated` — Message edited
-  - `discord:message:deleted` — Message deleted
-  - `discord:message:analyzed` — AI analysis complete
-  - `discord:attachment:created` — Attachment detected
-  - `discord:attachment:uploaded` — Attachment uploaded to storage
-  - `discord:voice:started` — Voice recording started
-  - `discord:voice:stopped` — Voice recording stopped
-  - `discord:voice:uploaded` — Voice segment uploaded
-  - `discord:analysis:queue_status` — Analysis queue status update
+- `aiAnalyzer.ts` — public API: `queueMessageAnalysis`, `getAnalysisQueueStatus`,
+  `startPendingAIAnalysisWorker` (recovery worker + cache-prune).
+- `batchScheduler.ts` — per-conversation debounce → `processBatch`.
+- `batchProcessor.ts` — batch lock/circuit-breaker, fans failed targets to
+  individual fallback.
+- `individualFallbackProcessor.ts` — one-message-at-a-time retry path, own CB.
+- `conversationState.ts` / `circuitBreaker.ts` — per-conversation state,
+  Piscina `workerPool`, `getConversationKey`.
+- `ai-analysis-worker.ts` — Piscina entry point (`batch` / `individual` jobs).
+  Runs `runModerationAnalysis` off the main thread.
+- `moderationOrchestrator.ts` — exact-hash cache → batched semantic (Qdrant)
+  cache → LLM. Text and media paths run in parallel.
+- `textBatchProcessor.ts` / `mediaBatchProcessor.ts` — actual LLM calls
+  (one call per sub-batch, not per message).
+- `llmClient.ts` — central OpenAI-compatible chat client (streaming, retries,
+  thinking-disable injection). `visionAnalyzer.ts` / `mediaAnalysisClient.ts`
+  share the same router/base URL (different model alias for vision).
+- `embeddingClient.ts` + `qdrantClient.ts` — semantic cache (one embed call +
+  one batched Qdrant search for all uncached targets).
+- `textCacheStore.ts` / `channelCultureStore.ts` / `userProfileStore.ts` /
+  `userReputationStore.ts` — caches & learned per-channel/user state.
 
-### Shared Infrastructure
-- **Config**: Zod-validated environment variables
-- **Logger**: Winston logger with context support
-- **Database**: Drizzle ORM with PostgreSQL
-- **Errors**: Custom error classes with codes and status codes
-- **Utils**: Retry logic with exponential backoff
+### Concurrency model
 
-### No HTTP Server
-- Discord Gateway service is **event-driven only**
-- No Express, WebSocket, or HTTP routes
-- All communication via Redis pub/sub
-- Backend service consumes events and serves HTTP API
+- Main thread owns the LLM semaphore (`AI_LLM_MAX_CONCURRENT`, default 5) via
+  `llmClient.withLlmConcurrency`.
+- Piscina pool (`PISCINA_MAX_THREADS`, default 4) runs the heavy LLM work off
+  the event loop; **each worker thread initializes its own pg Pool** (min 0,
+  grows to `POSTGRES_POOL_MAX`). See "Memory & connections" below.
 
-## Initialization Flow
+## Memory & DB connections
 
-1. Load environment config (Zod validation)
-2. Initialize database connection
-3. Run pending migrations
-4. Create Discord client with optimized cache settings
-5. Initialize Redis event broadcaster
-6. Register Discord event listeners (messageCapture, aiAnalyzer)
-7. Login to Discord
-8. Listen for graceful shutdown signals (SIGINT, SIGTERM)
+`MemoryMax=1G` (raised from 512M — live RSS sits at ~500 MiB, peak 508 MiB,
+so 512M left ~2% headroom and risked an OOM-kill restart). Host has 8 GB free.
 
-## Graceful Shutdown
+`POSTGRES_POOL_MIN=0` (default). The gateway = main process + up to 4 Piscina
+worker threads, each with its own pg Pool. With min:0 the pools stay empty
+until a query runs and drop idle clients afterward, instead of holding
+`(1 main + 4 workers) × 2 = 10` permanently-open idle connections against
+PgBouncer. The pool still grows on demand up to `POSTGRES_POOL_MAX`.
 
-On shutdown signal:
-1. Close database connection
-2. Disconnect from voice channels
-3. Close Redis connection
-4. Destroy Discord client
-5. Exit process
+## Event channels (Redis pub/sub)
 
-## Dependencies
+`discord:message:{created,updated,deleted,analyzed}`,
+`discord:attachment:{created,uploaded}`,
+`discord:voice:{started,stopped,uploaded,active_user,pcm,analyzed}`,
+`discord:analysis:queue_status`,
+`discord:reaction:{added,removed}`,
+`discord:thread:{created,deleted,updated}`,
+`discord:channel_topic:updated`,
+`discord:presence:updated`,
+`discord:guild_member:{added,removed}`.
+See `src/shared/redis-channels.ts` for the canonical names.
 
-**Core Discord**:
-- discord.js-selfbot-v13
-- @discordjs/voice
-- @discordjs/opus
+## Initialization flow
 
-**Audio Processing**:
-- prism-media (Opus encoding/decoding)
-- opusscript (Opus fallback)
-- sharp (Image resizing)
+1. Validate env (Zod). Refuse to start if `AI_ANALYSIS_ENABLED` but no key.
+2. `AUTO_MIGRATE_ON_STARTUP` → run pending Drizzle migrations.
+3. `initializeDatabase()` (pg Pool, min 0).
+4. Create discord.js-selfbot-v13 client; register listeners on `ready`.
+5. Start `gmw-discord-gateway` metrics server (port `METRICS_PORT`, default 4016).
+6. `client.login(token)`.
 
-**Data & Config**:
-- drizzle-orm (ORM)
-- pg (PostgreSQL driver)
-- zod (Config validation)
-- ioredis (Redis client)
+## Graceful shutdown
 
-**Logging & Utilities**:
-- winston (Structured logging)
-- p-retry (Retry logic)
-- p-limit (Concurrency limiting)
-- piscina (Worker pool)
+`SIGINT`/`SIGTERM` (and uncaught transient stream errors: EPIPE / ECONNRESET /
+ERR_STREAM_DESTROYED / ERR_STREAM_WRITE_AFTER_END are treated as non-fatal):
+stop metrics → stop muxer → disconnect voice → close PCM WS → close Redis →
+close command handler → close DB → destroy client → exit.
 
-## Event Flow Example
+## Observability
 
-### Message Capture Flow
-1. Discord emits `messageCreate` event
-2. `messageCapture.ts` listener receives event
-3. Extract metadata (user, channel, content, timestamp)
-4. `messageStore.ts` inserts into database
-5. `eventBroadcaster.messageCreated()` publishes to Redis
-6. Backend service subscribes to `discord:message:created` channel
-7. Backend processes and stores in its own database
+Prometheus scrapes `127.0.0.1:4016/metrics` (`bete_*` prefix). Collectors run
+per-scrape and expose: process memory/uptime, and (when AI analysis is on) live
+pipeline gauges — `ai_analysis_queued_conversations`,
+`ai_analysis_active_batch_requests`, `ai_analysis_active_individual_requests`,
+`ai_analysis_individual_in_flight`, `ai_analysis_individual_circuit_breaker_active`,
+`ai_analysis_worker_threads`, `ai_analysis_worker_threads_active`.
 
-### Voice Recording Flow
-1. `voiceController.connect()` joins voice channel
-2. `recorder.ts` subscribes to user audio streams
-3. For each speaking user:
-   - Create audio stream subscription
-   - Decode Opus packets to PCM
-   - Rotate OGG segments (5s default)
-   - Collect user metadata
-4. On silence (3s):
-   - Finalize segment
-   - Create metadata JSON
-   - Upload segment to storage
-   - Publish `discord:voice:uploaded` event
-5. Backend service receives event and indexes recording
+## Key invariants (do not break)
 
-## No Breaking Changes
-
-- Original `src/` remains untouched for now
-- Discord Gateway is a **new service** in `services/discord-gateway/`
-- Can run alongside existing monolith during transition
-- Backend service will consume Redis events
-- Frontend continues to use Backend HTTP API
+- **LLM is the only judge.** Failed LLM → `status:"error"` + recovery retry.
+  Never reintroduce regex/heuristic content classification.
+- **Discord tokens are sanitized** (`discordTokens.ts`: `<:emoji:id>` →
+  `[emoji:name]`, `<@id>` → `@user`, etc.) before content reaches the LLM, so
+  numeric snowflake IDs never trigger false positives.
+- **Semantic cache is batched** (one embed call + one Qdrant batch search),
+  not N sequential round-trips. `ensureQdrantCollection` is memoized.
+- **Streaming is mandatory** against the 9router base URL (non-stream waits for
+  the full body and times out). `llmClient` aggregates SSE chunks.

services/discord-gateway/MODULE_STRUCTURE.md

@@ -1,408 +1,80 @@
-# Discord Gateway Service - Module Structure
+# Discord Gateway Service — Module Structure
 
-## Complete Directory Tree
+> Kept as a compact module map. For the authoritative layout, design
+> decisions, and invariants, see `ARCHITECTURE.md`. This file was rewritten
+> on 2026-08-16 to fix stale references (`winston` → pino,
+> `mock-crc.ts`/`indonesianTextNormalizer.ts` removed,
+> `aiAnalysisWorker.ts` → `ai-analysis-worker.ts`,
+> `llmModerationClient.ts` → `llmClient.ts`).
+
+## Top-level
 
 ```
 services/discord-gateway/
 ├── src/
-│   ├── app/
-│   │   ├── bootstrap.ts
-│   │   │   └── Initializes Discord client, database, Redis broadcaster
-│   │   │       Registers event listeners, handles graceful shutdown
-│   │   └── shutdown.ts
-│   │       └── Graceful shutdown handler for SIGINT/SIGTERM/exceptions
-│   │
-│   ├── shared/
-│   │   ├── config/
-│   │   │   └── config.ts
-│   │   │       └── Zod-validated environment configuration
-│   │   │           - Discord token, database URL, Redis URL
-│   │   │           - AI LLM settings, recording parameters
-│   │   │           - Attachment upload settings, retention policies
-│   │   │
-│   │   ├── database/
-│   │   │   ├── schema.ts
-│   │   │   │   └── Drizzle ORM schema definitions
-│   │   │   ├── drizzle.ts
-│   │   │   │   └── PostgreSQL connection and initialization
-│   │   │   ├── migrate.ts
-│   │   │   │   └── Database migration runner
-│   │   │   ├── migrateCli.ts
-│   │   │   │   └── CLI for programmatic migrations
-│   │   │   ├── voiceRecordingRepo.ts
-│   │   │   │   └── Voice recording repository
-│   │   │   └── migrations/
-│   │   │       └── Database migration files
-│   │   │
-│   │   ├── errors/
-│   │   │   └── errors.ts
-│   │   │       └── Custom error classes
-│   │   │           - AppError (base)
-│   │   │           - ConfigError
-│   │   │           - AudioError
-│   │   │           - VoiceConnectionError
-│   │   │           - ValidationError
-│   │   │
-│   │   ├── logger/
-│   │   │   ├── logger.ts
-│   │   │   │   └── Winston logger wrapper with context support
-│   │   │   └── serialization.ts
-│   │   │       └── Log value serialization utilities
-│   │   │
-│   │   ├── utils/
-│   │   │   └── retry.ts
-│   │   │       └── Retry with exponential backoff utility
-│   │   │
-│   │   └── discord/
-│   │       └── clientOptions.ts
-│   │           └── Discord.js client configuration
-│   │
-│   ├── modules/
-│   │   │
-│   │   ├── message-capture/
-│   │   │   ├── messageCapture.ts
-│   │   │   │   └── CONTROLLER: Discord event listeners
-│   │   │   │       - messageCreate, messageUpdate, messageDelete
-│   │   │   │       - Validates capture target, publishes events
-│   │   │   │
-│   │   │   ├── messageStore.ts
-│   │   │   │   └── REPOSITORY: Database CRUD operations
-│   │   │   │       - upsertMessageForCapture
-│   │   │   │       - updateMessageAsEdited
-│   │   │   │       - updateMessageAsDeleted
-│   │   │   │       - insertAttachment
-│   │   │   │       - getMessageById
-│   │   │   │
-│   │   │   ├── messageMetadata.ts
-│   │   │   │   └── SERVICE: Message metadata extraction
-│   │   │   │       - getMessageMetadata
-│   │   │   │       - getMessageLocation
-│   │   │   │       - getDisplayContent
-│   │   │   │
-│   │   │   ├── types.ts
-│   │   │   │   └── Domain types
-│   │   │   │       - MessageRecord
-│   │   │   │       - AttachmentRecord
-│   │   │   │       - VoiceSegmentRecord
-│   │   │   │       - AIStatus, AISeverity, AIRecommendedAction
-│   │   │   │
-│   │   │   └── index.ts
-│   │       └── Module exports
-│   │
-│   │   ├── ai-moderation/
-│   │   │   ├── aiAnalyzer.ts
-│   │   │   │   └── CONTROLLER: Analysis orchestration
-│   │   │   │       - startPendingAIAnalysisWorker
-│   │   │   │       - queueMessageAnalysis
-│   │   │   │       - Manages analysis queue and worker pool
-│   │   │   │
-│   │   │   ├── llmModerationClient.ts
-│   │   │   │   └── SERVICE: LLM API integration
-│   │   │   │       - Calls LLM for text/image moderation
-│   │   │   │       - Parses responses, handles errors
-│   │   │   │       - Retry logic with backoff
-│   │   │   │
-│   │   │   ├── aiAnalysisWorker.ts
-│   │   │   │   └── SERVICE: Worker pool management
-│   │   │   │       - Piscina worker pool for parallel analysis
-│   │   │   │       - Conversation context batching
-│   │   │   │
-│   │   │   ├── indonesianTextNormalizer.ts
-│   │   │   │   └── SERVICE: Text preprocessing
-│   │   │   │       - Normalize Indonesian text
-│   │   │   │       - Handle diacritics, abbreviations
-│   │   │   │
-│   │   │   ├── moderationPrompt.ts
-│   │   │   │   └── SERVICE: Prompt generation
-│   │   │   │       - Generate LLM prompts for moderation
-│   │   │   │       - Include context and policy
-│   │   │   │
-│   │   │   └── index.ts
-│   │       └── Module exports
-│   │
-│   │   ├── voice-recording/
-│   │   │   ├── voiceController.ts
-│   │   │   │   └── CONTROLLER: Voice connection management
-│   │   │   │       - connect(guildId, channelId)
-│   │   │   │       - disconnect()
-│   │   │   │       - listGuilds(), listVoiceChannels()
-│   │   │   │       - getStatus()
-│   │   │   │
-│   │   │   ├── recorder.ts
-│   │   │   │   └── SERVICE: Recording orchestration
-│   │   │   │       - startRecording(client, channel)
-│   │   │   │       - stopRecording(guildId)
-│   │   │   │       - Manages active recording sessions
-│   │   │   │
-│   │   │   ├── recorder/
-│   │   │   │   ├── audioStream.ts
-│   │   │   │   │   └── SERVICE: Audio stream subscription
-│   │   │   │   │       - subscribeToAudioStream
-│   │   │   │   │       - Opus packet handling
-│   │   │   │   │
-│   │   │   │   ├── decoder.ts
-│   │   │   │   │   └── SERVICE: Opus decoding
-│   │   │   │   │       - OpusDecoder class
-│   │   │   │   │       - Decode Opus to PCM
-│   │   │   │   │       - Rotation and cooldown logic
-│   │   │   │   │
-│   │   │   │   ├── segment.ts
-│   │   │   │   │   └── SERVICE: OGG segment rotation
-│   │   │   │   │       - SegmentManager class
-│   │   │   │   │       - Rotate segments (5s default)
-│   │   │   │   │       - Write OGG files
-│   │   │   │   │
-│   │   │   │   ├── metadata.ts
-│   │   │   │   │   └── SERVICE: Segment metadata
-│   │   │   │   │       - collectUserMetadata
-│   │   │   │   │       - createSegmentMetadata
-│   │   │   │   │       - User info, roles, timestamps
-│   │   │   │   │
-│   │   │   │   ├── sessionRecording.ts
-│   │   │   │   │   └── SERVICE: Session management
-│   │   │   │   │       - createRecordingSession
-│   │   │   │   │       - finalizeRecordingSession
-│   │   │   │   │       - Track active sessions
-│   │   │   │   │
-│   │   │   │   └── uploader.ts
-│   │   │   │       └── SERVICE: Segment upload
-│   │   │   │           - uploadRecordingSegment
-│   │   │   │           - Upload to external storage
-│   │   │   │           - Retry logic
-│   │   │   │
-│   │   │   └── index.ts
-│   │       └── Module exports
-│   │
-│   │   ├── attachment-upload/
-│   │   │   ├── attachmentUploader.ts
-│   │   │   │   └── SERVICE: Upload orchestration
-│   │   │   │       - processAttachmentUpload
-│   │   │   │       - Download from Discord
-│   │   │   │       - Upload to external storage
-│   │   │   │       - Retry with backoff
-│   │   │   │
-│   │   │   ├── imageResizer.ts
-│   │   │   │   └── SERVICE: Image processing
-│   │   │   │       - resizeImage
-│   │   │   │       - Resize to max dimension
-│   │   │   │       - Preserve aspect ratio
-│   │   │   │
-│   │   │   └── index.ts
-│   │       └── Module exports
-│   │
-│   │   └── event-broadcaster/
-│   │       ├── eventBroadcaster.ts
-│   │       │   └── SERVICE: Redis pub/sub publisher
-│   │       │       - EventBroadcaster class
-│   │       │       - RedisEventPublisher class
-│   │       │       - Publish to Redis channels
-│   │       │       - Methods:
-│   │       │         - messageCreated()
-│   │       │         - messageUpdated()
-│   │       │         - messageDeleted()
-│   │       │         - messageAnalyzed()
-│   │       │         - attachmentCreated()
-│   │       │         - attachmentUploaded()
-│   │       │         - voiceRecordingStarted()
-│   │       │         - voiceRecordingStopped()
-│   │       │         - voiceRecordingUploaded()
-│   │       │         - analysisQueueStatus()
-│   │       │
-│   │       ├── eventTypes.ts
-│   │       │   └── Domain types
-│   │       │       - DiscordGatewayEvent interface
-│   │       │       - EventChannels constants
-│   │       │       - Event channel names
-│   │       │
-│   │       └── index.ts
-│           └── Module exports
-│
-│   ├── mock-crc.ts
-│   │   └── CRC polyfill for discord.js compatibility
-│   │
-│   └── index.ts
-│       └── Service entry point
-│           - Initialize Discord Gateway
-│           - Handle startup errors
-│
-├── ARCHITECTURE.md
-│   └── Detailed architecture documentation
-│
-├── README.md
-│   └── Complete service documentation
-│
-├── MODULE_STRUCTURE.md
-│   └── This file - module structure reference
-│
-└── package.json
-    └── Service dependencies and scripts
+│   ├── index.ts                     # Entry point
+│   ├── app/                         # bootstrap, shutdown, retention
+│   ├── shared/                      # config, database, logger, errors, utils, discord, uploader
+│   └── modules/
+│       ├── message-capture/         # Discord listeners + DB store + metadata
+│       ├── ai-moderation/           # LLM moderation pipeline (largest module)
+│       ├── voice-recording/         # Voice connect + Opus→OGG recording (+ recorder/)
+│       ├── voice-pcm-ws/            # Real-time PCM → backend WebSocket
+│       ├── attachment-upload/       # Download + sharp resize + upload
+│       ├── event-broadcaster/        # RedisEventPublisher + EventBroadcaster
+│       ├── command-handler/         # Backend→gateway Redis commands
+│       ├── reaction-tracking/ thread-tracking/ user-presence/
+│       ├── channel-topic/ guild-member-events/
+│       └── gateway-metrics/         # Prometheus /metrics (port 4016)
+├── tests/                           # Vitest suites (129 tests)
+├── drizzle/                         # Drizzle migration SQL + journal
+├── ARCHITECTURE.md  README.md  package.json  tsconfig.json  vitest.config.ts
 ```
 
-## Module Responsibilities
+## Module responsibilities (summary)
 
 ### message-capture
-**Purpose**: Capture Discord messages (create, update, delete)
-**Pattern**: Controller-Service-Repository
-- **Controller** (messageCapture.ts): Listens to Discord events
-- **Service** (messageMetadata.ts): Extracts metadata
-- **Repository** (messageStore.ts): Database operations
-- **Events Published**:
-  - `discord:message:created`
-  - `discord:message:updated`
-  - `discord:message:deleted`
+Captures `messageCreate`/`messageUpdate`/`messageDelete`, extracts metadata,
+stores to Postgres, publishes to Redis. Controller–Service–Repository split:
+`messageCapture.ts` (listener) → `messageStore.ts` (DB) + `messageMetadata.ts`
+(service).
 
 ### ai-moderation
-**Purpose**: Analyze messages with LLM for moderation
-**Pattern**: Controller-Service-Service-Service
-- **Controller** (aiAnalyzer.ts): Orchestrates analysis workflow
-- **Service** (llmModerationClient.ts): LLM API integration
-- **Service** (aiAnalysisWorker.ts): Worker pool management
-- **Service** (indonesianTextNormalizer.ts): Text preprocessing
-- **Service** (moderationPrompt.ts): Prompt generation
-- **Events Published**:
-  - `discord:message:analyzed`
-  - `discord:analysis:queue_status`
+LLM-only moderation. Entry: `aiAnalyzer.ts` (`queueMessageAnalysis`,
+`startPendingAIAnalysisWorker`, `getAnalysisQueueStatus`). Scheduling:
+`batchScheduler.ts` → `batchProcessor.ts` (batch lock + circuit breaker) →
+`individualFallbackProcessor.ts` (per-message retry). Heavy work runs in the
+Piscina pool via `ai-analysis-worker.ts` (jobs `batch` / `individual`).
+Orchestration/caching: `moderationOrchestrator.ts` (exact hash → batched
+semantic Qdrant → LLM), `textBatchProcessor.ts` / `mediaBatchProcessor.ts`
+(one LLM call per sub-batch), `llmClient.ts` (central streaming client),
+`embeddingClient.ts` + `qdrantClient.ts` (semantic cache), plus
+`channelCultureStore.ts` / `userProfileStore.ts` / `userReputationStore.ts`.
 
 ### voice-recording
-**Purpose**: Record voice channel audio
-**Pattern**: Controller-Service-SubServices
-- **Controller** (voiceController.ts): Voice connection management
-- **Service** (recorder.ts): Recording orchestration
-- **Sub-services** (recorder/*): Audio processing pipeline
-  - audioStream.ts: Opus packet subscription
-  - decoder.ts: Opus to PCM decoding
-  - segment.ts: OGG file rotation
-  - metadata.ts: User metadata collection
-  - sessionRecording.ts: Session lifecycle
-  - uploader.ts: Segment upload
-- **Events Published**:
-  - `discord:voice:started`
-  - `discord:voice:stopped`
-  - `discord:voice:uploaded`
+`voiceController.ts` (connect/disconnect/list) + `recorder.ts` (orchestration)
++ `recorder/` (decoder, segment, session, uploader, oggCrc). Publishes
+`discord:voice:*` events. Real-time audio also streamed via `voice-pcm-ws`.
 
 ### attachment-upload
-**Purpose**: Upload message attachments to external storage
-**Pattern**: Service-Service
-- **Service** (attachmentUploader.ts): Upload orchestration
-- **Service** (imageResizer.ts): Image processing
-- **Events Published**:
-  - `discord:attachment:created`
-  - `discord:attachment:uploaded`
+`attachmentUploader.ts` (download → upload to storage) + `imageResizer.ts`
+(sharp resize). Emits `discord:attachment:*`.
 
 ### event-broadcaster
-**Purpose**: Publish events to Redis pub/sub
-**Pattern**: Service-Domain
-- **Service** (eventBroadcaster.ts): Redis publisher
-- **Domain** (eventTypes.ts): Event type definitions
-- **Channels**:
-  - discord:message:* (message events)
-  - discord:attachment:* (attachment events)
-  - discord:voice:* (voice events)
-  - discord:analysis:* (analysis events)
+`RedisEventPublisher` (ioredis publish) + `EventBroadcaster` (typed methods).
+Channel names in `src/shared/redis-channels.ts`.
 
-## Shared Infrastructure
+### gateway-metrics
+`metrics.ts` Prometheus HTTP server on `METRICS_PORT` (4016). Collectors run
+per scrape; live pipeline gauges registered in `bootstrap.ts`.
 
-### config
-- Zod-validated environment variables
-- Type-safe configuration access
-- Sensible defaults
+## Shared infrastructure
+- **config** — Zod schema in `shared/config/index.ts` (single source of truth).
+- **database** — Drizzle ORM over `pg`; pool `min:0` (`shared/config`).
+- **logger** — `pino` wrapper, `createChildLogger()` for context loggers.
+- **errors** — `AppError` hierarchy (`ConfigError`, `AudioError`, …).
 
-### database
-- Drizzle ORM schema
-- PostgreSQL connection
-- Migration management
-- Voice recording repository
-
-### logger
-- Winston logger wrapper
-- Context-aware logging
-- Log serialization utilities
-
-### errors
-- Custom error classes
-- Error codes and HTTP status codes
-- Proper error hierarchy
-
-### utils
-- Retry with exponential backoff
-- Configurable retry parameters
-
-### discord
-- Discord.js client configuration
-- Cache optimization
-- Partial handling
-
-## Event Flow
-
-```
-Discord Events
-    ↓
-message-capture (Controller)
-    ↓
-messageStore (Repository) → PostgreSQL
-    ↓
-eventBroadcaster (Service)
-    ↓
-Redis Pub/Sub
-    ↓
-Backend Service (Subscriber)
-    ↓
-HTTP API / WebSocket
-    ↓
-Frontend Application
-```
-
-## No HTTP Server
-
-- ✅ No Express
-- ✅ No WebSocket server
-- ✅ No HTTP routes
-- ✅ No middleware
-- ✅ Pure event-driven service
-
-## Graceful Shutdown
-
-1. Close PostgreSQL connection
-2. Disconnect from voice channels
-3. Close Redis connection
-4. Destroy Discord client
-5. Exit process
-
-## Dependencies
-
-**Discord**:
-- discord.js-selfbot-v13
-- @discordjs/voice
-- @discordjs/opus
-
-**Audio**:
-- prism-media
-- opusscript
-- sharp
-
-**Data**:
-- drizzle-orm
-- pg
-- zod
-- ioredis
-
-**Logging**:
-- winston
-- p-retry
-- p-limit
-- piscina
-
-## Summary
-
-The Discord Gateway service is a **pure event-driven microservice** that:
-- Captures Discord messages, voice, and attachments
-- Performs AI moderation analysis
-- Publishes events to Redis pub/sub
-- Has no HTTP server or WebSocket
-- Follows Modular MVC pattern
-- Maintains clean module boundaries
-- Provides type-safe configuration
-- Includes structured logging
-- Handles graceful shutdown
-
-The service is designed to run alongside the Backend service, which consumes Redis events and serves the HTTP API to the Frontend.
+## Notes
+- No HTTP server (other than the metrics endpoint). Pure event-driven.
+- `MODULE_STRUCTURE.md` is intentionally a sketch; `ARCHITECTURE.md` is the
+  detailed reference. When they diverge, `ARCHITECTURE.md` wins.

services/discord-gateway/drizzle/migrations/0014_add_term_glossary_cache.sql

@@ -0,0 +1,9 @@
+CREATE TABLE IF NOT EXISTS "term_glossary_cache" (
+	"term" text PRIMARY KEY NOT NULL,
+	"definition" text NOT NULL,
+	"source_url" text DEFAULT '' NOT NULL,
+	"resolved_at" bigint NOT NULL,
+	"hit_count" integer DEFAULT 0 NOT NULL
+);
+--> statement-breakpoint
+CREATE INDEX IF NOT EXISTS "idx_term_glossary_cache_resolved_at" ON "term_glossary_cache" USING btree ("resolved_at");

services/discord-gateway/drizzle/migrations/0015_add_moderation_explainability.sql

@@ -0,0 +1,16 @@
+-- Migration: 0015_add_moderation_explainability.sql
+-- Date: 2026-08-18
+-- Description: Add structured explainability columns to moderation_actions.
+-- These are READ (surfaced read-only to the public web) so they are never
+-- "written but never read" — they back the public moderation transparency view.
+-- Idempotent: no-ops on databases that already carry the columns.
+
+ALTER TABLE IF EXISTS "moderation_actions"
+  ADD COLUMN IF NOT EXISTS "flags" text,
+  ADD COLUMN IF NOT EXISTS "categories" text,
+  ADD COLUMN IF NOT EXISTS "severity" text
+    CHECK ("severity" IS NULL OR "severity" IN ('none','low','medium','high','critical')),
+  ADD COLUMN IF NOT EXISTS "confidence" real,
+  ADD COLUMN IF NOT EXISTS "score" real,
+  ADD COLUMN IF NOT EXISTS "evidence" text,
+  ADD COLUMN IF NOT EXISTS "policy_version" text;

services/discord-gateway/drizzle/migrations/meta/_journal.json

@@ -99,6 +99,20 @@
       "when": 1785551832190,
       "tag": "0013_rename_mascot_chat_to_chatbot",
       "breakpoints": true
+    },
+    {
+      "idx": 14,
+      "version": "7",
+      "when": 1785621600000,
+      "tag": "0014_add_term_glossary_cache",
+      "breakpoints": true
+    },
+    {
+      "idx": 15,
+      "version": "7",
+      "when": 1787184000000,
+      "tag": "0015_add_moderation_explainability",
+      "breakpoints": true
     }
   ]
 }

services/discord-gateway/native/libdatachannel-min/.gitignore

@@ -1,3 +0,0 @@
-node_modules/
-build/
-package-lock.json

services/discord-gateway/native/libdatachannel-min/binding.cpp

@@ -1,526 +0,0 @@
-// libdatachannel-min — minimal N-API binding to libdatachannel.
-// Exposes ONLY what GMW GoLive needs:
-//   PeerConnection (offer/answer, ICE, SDP), DataChannel (signaling),
-//   Track send (added in media phase).
-// Built against libdatachannel 0.24.0 (built from source in /tmp/ldc-build).
-
-#include <napi.h>
-#include <rtc/rtc.hpp>
-
-#include <functional>
-#include <memory>
-#include <string>
-#include <variant>
-
-using namespace Napi;
-
-namespace {
-
-std::string stateToString(rtc::PeerConnection::State s) {
-  switch (s) {
-    case rtc::PeerConnection::State::New: return "new";
-    case rtc::PeerConnection::State::Connecting: return "connecting";
-    case rtc::PeerConnection::State::Connected: return "connected";
-    case rtc::PeerConnection::State::Disconnected: return "disconnected";
-    case rtc::PeerConnection::State::Failed: return "failed";
-    case rtc::PeerConnection::State::Closed: return "closed";
-    default: return "unknown";
-  }
-}
-
-std::string binaryToString(const rtc::binary& data) {
-  // rtc::binary is std::vector<std::byte> in libdatachannel >= 0.21
-  std::string msg(data.size(), '\0');
-  for (size_t i = 0; i < data.size(); i++) {
-    msg[i] = static_cast<char>(data[i]);
-  }
-  return msg;
-}
-
-// Holds a Napi::Promise::Deferred so it can be moved into TSFN lambdas
-// without invalid copies (node-addon-api 8.x Deferred is not movable).
-struct DeferredHolder {
-  Promise::Deferred deferred;
-  explicit DeferredHolder(Promise::Deferred d) : deferred(d) {}
-};
-
-class DataChannelWrap : public Napi::ObjectWrap<DataChannelWrap> {
- public:
-  static Function Init(Napi::Env env) {
-    Function func = DefineClass(env, "DataChannel", {
-      InstanceMethod("send", &DataChannelWrap::Send),
-      InstanceMethod("isOpen", &DataChannelWrap::IsOpen),
-      InstanceMethod("close", &DataChannelWrap::Close),
-      InstanceMethod("onMessage", &DataChannelWrap::OnMessage),
-      InstanceMethod("onOpen", &DataChannelWrap::OnOpen),
-    });
-    dcConstructor = Napi::Persistent(func);
-    return func;
-  }
-
-  // Create a JS wrapper (calls the JS constructor, returns instance).
-  static Object NewInstance(Napi::Env env) {
-    return dcConstructor.New({});
-  }
-
-  DataChannelWrap(const Napi::CallbackInfo& info)
-      : Napi::ObjectWrap<DataChannelWrap>(info) {}
-
-  void Init(std::shared_ptr<rtc::DataChannel> dc) {
-    dc_ = dc;
-    dc_->onMessage([this](rtc::message_variant data) {
-      std::string msg;
-      if (std::holds_alternative<rtc::binary>(data)) {
-        msg = binaryToString(std::get<rtc::binary>(data));
-      } else {
-        msg = std::get<std::string>(data);
-      }
-      if (msgCb_) {
-        msgCb_->BlockingCall([msg](Napi::Env env, Function cb) {
-          cb.Call({String::New(env, msg)});
-        });
-      }
-    });
-    dc_->onOpen([this]() {
-      if (openCb_) {
-        openCb_->BlockingCall([](Napi::Env env, Function cb) {
-          cb.Call({});
-        });
-      }
-    });
-  }
-
- private:
-  static FunctionReference dcConstructor;
-  std::shared_ptr<rtc::DataChannel> dc_;
-  std::shared_ptr<ThreadSafeFunction> msgCb_;
-  std::shared_ptr<ThreadSafeFunction> openCb_;
-
-  void Send(const Napi::CallbackInfo& info) {
-    std::string msg = info[0].As<String>().Utf8Value();
-    if (dc_) dc_->send(msg);
-  }
-
-  Napi::Value IsOpen(const Napi::CallbackInfo& info) {
-    bool open = dc_ && dc_->isOpen();
-    return Boolean::New(info.Env(), open);
-  }
-
-  void Close(const Napi::CallbackInfo& info) {
-    if (dc_) dc_->close();
-  }
-
-  void OnMessage(const Napi::CallbackInfo& info) {
-    Function cb = info[0].As<Function>();
-    msgCb_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(info.Env(), cb, "dc-message", 0, 1));
-  }
-
-  void OnOpen(const Napi::CallbackInfo& info) {
-    Function cb = info[0].As<Function>();
-    openCb_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(info.Env(), cb, "dc-open", 0, 1));
-  }
-};
-
-class TrackWrap : public Napi::ObjectWrap<TrackWrap> {
- public:
-  static Function Init(Napi::Env env) {
-    Function func = DefineClass(env, "Track", {
-      InstanceMethod("send", &TrackWrap::Send),
-      InstanceMethod("isOpen", &TrackWrap::IsOpen),
-      InstanceMethod("close", &TrackWrap::Close),
-      InstanceMethod("setPacketizer", &TrackWrap::SetPacketizer),
-      InstanceMethod("sendFrame", &TrackWrap::SendFrame),
-      InstanceMethod("addTimestamp", &TrackWrap::AddTimestamp),
-    });
-    trackConstructor = Napi::Persistent(func);
-    return func;
-  }
-
-  static Object NewInstance(Napi::Env env) {
-    return trackConstructor.New({});
-  }
-
-  TrackWrap(const Napi::CallbackInfo& info)
-      : Napi::ObjectWrap<TrackWrap>(info) {}
-
-  void Init(std::shared_ptr<rtc::Track> track, Napi::Env env) {
-    track_ = track;
-    (void)env;
-  }
-
- private:
-  static FunctionReference trackConstructor;
-  std::shared_ptr<rtc::Track> track_;
-  std::shared_ptr<rtc::RtpPacketizationConfig> rtpConfig_;
-
-  void Send(const Napi::CallbackInfo& info) {
-    Buffer<uint8_t> buf = info[0].As<Buffer<uint8_t>>();
-    if (!track_) return;
-    rtc::binary data(buf.Length());
-    for (size_t i = 0; i < buf.Length(); i++) data[i] = (std::byte)buf[i];
-    try {
-      track_->send(data);
-    } catch (const std::exception& e) {
-      fprintf(stderr, "[binding] track.send THREW: %s\n", e.what());
-    }
-  }
-
-  // setPacketizer(kind, ssrc, payloadType, clockRate, playoutDelayId,
-  //               playoutDelayMin, playoutDelayMax)
-  // kind: "audio" | "h264" | "h265" | "av1"
-  // Builds the media-handler chain (packetizer → RTCP SR → NACK → pacing for
-  // video) exactly like @dank074's WebRtcWrapper does via node-datachannel.
-  void SetPacketizer(const Napi::CallbackInfo& info) {
-    Napi::Env env = info.Env();
-    if (!track_) throw Error::New(env, "track closed");
-    std::string kind = info[0].As<String>().Utf8Value();
-    uint32_t ssrc = info[1].As<Number>().Uint32Value();
-    uint8_t pt = (uint8_t)info[2].As<Number>().Uint32Value();
-    uint32_t clockRate = info[3].As<Number>().Uint32Value();
-    uint8_t playoutDelayId = (uint8_t)info[4].As<Number>().Uint32Value();
-    uint16_t playoutDelayMin = (uint16_t)info[5].As<Number>().Uint32Value();
-    uint16_t playoutDelayMax = (uint16_t)info[6].As<Number>().Uint32Value();
-    try {
-      auto cfg = std::make_shared<rtc::RtpPacketizationConfig>(
-          ssrc, "", pt, clockRate);
-      cfg->playoutDelayId = playoutDelayId;
-      cfg->playoutDelayMin = playoutDelayMin;
-      cfg->playoutDelayMax = playoutDelayMax;
-      std::shared_ptr<rtc::MediaHandler> handler;
-      if (kind == "audio") {
-        handler = std::make_shared<rtc::OpusRtpPacketizer>(cfg);
-      } else if (kind == "h264") {
-        handler = std::make_shared<rtc::H264RtpPacketizer>(
-            rtc::NalUnit::Separator::StartSequence, cfg);
-      } else if (kind == "h265") {
-        handler = std::make_shared<rtc::H265RtpPacketizer>(
-            rtc::NalUnit::Separator::StartSequence, cfg);
-      } else if (kind == "av1") {
-        handler = std::make_shared<rtc::AV1RtpPacketizer>(
-            rtc::AV1RtpPacketizer::Packetization::Obu, cfg);
-      } else {
-        throw std::runtime_error("unknown packetizer kind: " + kind);
-      }
-      handler->addToChain(std::make_shared<rtc::RtcpSrReporter>(cfg));
-      handler->addToChain(std::make_shared<rtc::RtcpNackResponder>());
-      if (kind != "audio") {
-        handler->addToChain(std::make_shared<rtc::PacingHandler>(
-            25.0 * 1000 * 1000, std::chrono::milliseconds(1)));
-      }
-      track_->setMediaHandler(handler);
-      rtpConfig_ = cfg;
-    } catch (const std::exception& e) {
-      fprintf(stderr, "[binding] setPacketizer THREW: %s\n", e.what());
-      throw Error::New(env, e.what());
-    }
-  }
-
-  // sendFrame(buffer) — sends an ENCODED frame (AnnexB H264 / raw opus /
-  // OBU AV1). The media-handler chain packetizes it into RTP.
-  void SendFrame(const Napi::CallbackInfo& info) {
-    Buffer<uint8_t> buf = info[0].As<Buffer<uint8_t>>();
-    if (!track_) return;
-    rtc::binary data(buf.Length());
-    for (size_t i = 0; i < buf.Length(); i++) data[i] = (std::byte)buf[i];
-    try {
-      track_->send(data);
-    } catch (const std::exception& e) {
-      fprintf(stderr, "[binding] track.sendFrame THREW: %s\n", e.what());
-    }
-  }
-
-  // addTimestamp(delta) — advances the packetizer RTP timestamp by delta
-  // (clock-rate units). Called by JS after each frame, matching the
-  // node-datachannel contract (WebRtcWrapper does the same increment).
-  void AddTimestamp(const Napi::CallbackInfo& info) {
-    uint32_t delta = info[0].As<Number>().Uint32Value();
-    if (rtpConfig_) rtpConfig_->timestamp += delta;
-  }
-
-  Napi::Value IsOpen(const Napi::CallbackInfo& info) {
-    bool open = track_ && track_->isOpen();
-    return Boolean::New(info.Env(), open);
-  }
-
-  void Close(const Napi::CallbackInfo& info) {
-    if (track_) track_->close();
-  }
-
-  void OnStateChange(const Napi::CallbackInfo& info) {
-    // libdatachannel Track has no state-change callback; kept for API parity.
-    (void)info;
-  }
-};
-class PeerConnectionWrap : public Napi::ObjectWrap<PeerConnectionWrap> {
- public:
-  static Function Init(Napi::Env env) {
-    Function func = DefineClass(env, "PeerConnection", {
-      InstanceMethod("state", &PeerConnectionWrap::State),
-      InstanceMethod("createOffer", &PeerConnectionWrap::CreateOffer),
-      InstanceMethod("createAnswer", &PeerConnectionWrap::CreateAnswer),
-      InstanceMethod("setRemoteDescription",
-                     &PeerConnectionWrap::SetRemoteDescription),
-      InstanceMethod("close", &PeerConnectionWrap::Close),
-      InstanceMethod("onStateChange", &PeerConnectionWrap::OnStateChange),
-      InstanceMethod("createDataChannel", &PeerConnectionWrap::CreateDataChannel),
-      InstanceMethod("onDataChannel", &PeerConnectionWrap::OnDataChannel),
-      InstanceMethod("addTrack", &PeerConnectionWrap::AddTrack),
-    });
-    return func;
-  }
-
-  PeerConnectionWrap(const Napi::CallbackInfo& info)
-      : Napi::ObjectWrap<PeerConnectionWrap>(info) {
-    Napi::Env env = info.Env();
-    if (!info[0].IsObject()) {
-      throw TypeError::New(env, "config object required");
-    }
-    Object config = info[0].As<Object>();
-    rtc::Configuration rtcConfig;
-    if (config.Has("iceServers")) {
-      Array servers = config.Get("iceServers").As<Array>();
-      for (uint32_t i = 0; i < servers.Length(); i++) {
-        std::string url = servers.Get(i).As<String>().Utf8Value();
-        rtcConfig.iceServers.emplace_back(url);
-      }
-    }
-    pc_ = std::make_shared<rtc::PeerConnection>(rtcConfig);
-
-    // IMPORTANT: register description/gathering callbacks HERE (constructor),
-    // BEFORE any createDataChannel call. libdatachannel only fires
-    // onLocalDescription for negotiations that start AFTER the callback is
-    // registered — if createDataChannel runs first, the offer callback never
-    // fires (verified in C++ spike: test3 vs test2).
-    pc_->onLocalDescription([this](rtc::Description desc) {
-      latestLocalDesc_ = std::string(desc);
-      fprintf(stderr, "[binding] trickle desc, %zu bytes\n",
-              latestLocalDesc_.size());
-    });
-    pc_->onGatheringStateChange([this](rtc::PeerConnection::GatheringState gs) {
-      fprintf(stderr, "[binding] gathering state: %d\n", (int)gs);
-      if (gs == rtc::PeerConnection::GatheringState::Complete) {
-        // Use the getter — it returns the FULL SDP including candidates after
-        // gathering (trickle callbacks only carry the initial fragment).
-        auto ld = pc_->localDescription();
-        if (ld) {
-          latestLocalDesc_ = std::string(*ld);
-          fprintf(stderr, "[binding] final desc, %zu bytes\n",
-                  latestLocalDesc_.size());
-        }
-        resolvePendingLocalDesc_();
-      }
-    });
-  }
-
- private:
-  std::shared_ptr<rtc::PeerConnection> pc_;
-  std::shared_ptr<ThreadSafeFunction> stateCb_;
-  std::shared_ptr<ThreadSafeFunction> dcCb_;
-  std::string latestLocalDesc_;
-  std::shared_ptr<DeferredHolder> pendingDescDeferred_;
-  std::shared_ptr<ThreadSafeFunction> pendingDescTsfn_;
-
-  void resolvePendingLocalDesc_() {
-    if (!pendingDescDeferred_ || !pendingDescTsfn_) return;
-    auto holder = pendingDescDeferred_;
-    auto tsfn = pendingDescTsfn_;
-    pendingDescDeferred_.reset();
-    pendingDescTsfn_.reset();
-    std::string sdp = latestLocalDesc_;
-    tsfn->BlockingCall([sdp, holder](Napi::Env e, Function) {
-      holder->deferred.Resolve(String::New(e, sdp));
-    });
-  }
-
-  Napi::Value State(const Napi::CallbackInfo& info) {
-    return String::New(info.Env(),
-                       pc_ ? stateToString(pc_->state()) : "closed");
-  }
-
-  // createOffer() -> Promise<string> — sets local description, waits for
-  // ICE gathering to complete (so candidates are in the SDP), resolves SDP.
-  Napi::Value CreateOffer(const Napi::CallbackInfo& info) {
-    Napi::Env env = info.Env();
-    auto holder = std::make_shared<DeferredHolder>(Promise::Deferred::New(env));
-    if (!pc_) {
-      holder->deferred.Reject(Error::New(env, "peer closed").Value());
-      return holder->deferred.Promise();
-    }
-    // createDataChannel already triggers negotiation in libdatachannel 0.24 —
-    // if gathering already completed, resolve immediately from the cached SDP.
-    if (!latestLocalDesc_.empty()) {
-      auto tsfn = std::make_shared<ThreadSafeFunction>(ThreadSafeFunction::New(
-          env, Function::New(env, [](const CallbackInfo&) {}), "desc", 0, 1));
-      std::string sdp = latestLocalDesc_;
-      tsfn->BlockingCall([sdp, holder](Napi::Env e, Function) {
-        holder->deferred.Resolve(String::New(e, sdp));
-      });
-      return holder->deferred.Promise();
-    }
-    if (pendingDescDeferred_) {
-      pendingDescDeferred_->deferred.Reject(
-          Error::New(env, "previous negotiation still pending").Value());
-    }
-    pendingDescDeferred_ = holder;
-    pendingDescTsfn_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(env, Function::New(env, [](const CallbackInfo&) {}),
-                                "desc", 0, 1));
-    fprintf(stderr, "[binding] calling setLocalDescription(Offer)\n");
-    try {
-      pc_->setLocalDescription(rtc::Description::Type::Offer);
-      fprintf(stderr, "[binding] setLocalDescription returned OK\n");
-    } catch (const std::exception& e) {
-      pendingDescDeferred_.reset();
-      fprintf(stderr, "[binding] setLocalDescription THREW: %s\n", e.what());
-      throw Error::New(env, e.what());
-    }
-    return holder->deferred.Promise();
-  }
-
-  // createAnswer(offerSdp: string) -> Promise<string>
-  Napi::Value CreateAnswer(const Napi::CallbackInfo& info) {
-    Napi::Env env = info.Env();
-    std::string offer = info[0].As<String>().Utf8Value();
-    auto holder = std::make_shared<DeferredHolder>(Promise::Deferred::New(env));
-    if (!pc_) {
-      holder->deferred.Reject(Error::New(env, "peer closed").Value());
-      return holder->deferred.Promise();
-    }
-    if (pendingDescDeferred_) {
-      pendingDescDeferred_->deferred.Reject(
-          Error::New(env, "previous negotiation still pending").Value());
-    }
-    pendingDescDeferred_ = holder;
-    pendingDescTsfn_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(env, Function::New(env, [](const CallbackInfo&) {}),
-                                "desc", 0, 1));
-    try {
-      pc_->setRemoteDescription(
-          rtc::Description(offer, rtc::Description::Type::Offer));
-      fprintf(stderr, "[binding] answer: setRemoteDescription OK\n");
-      // libdatachannel 0.24 AUTO-GENERATES the answer when a remote offer is
-      // applied (verified in C++ spike test8/9: B desc type=Answer fires
-      // immediately with a=setup:active). Calling setLocalDescription() again
-      // would OVERWRITE it with a role=actpass SDP, which A rejects with
-      // "Illegal role actpass in remote answer description". So we do NOT call
-      // setLocalDescription here — we just wait for gathering complete and
-      // resolve with the auto-generated answer. This also matches @dank074's
-      // Discord voice flow.
-    } catch (const std::exception& e) {
-      pendingDescDeferred_.reset();
-      fprintf(stderr, "[binding] answer THREW: %s\n", e.what());
-      holder->deferred.Reject(Error::New(env, e.what()).Value());
-    }
-    return holder->deferred.Promise();
-  }
-
-  void SetRemoteDescription(const Napi::CallbackInfo& info) {
-    std::string sdp = info[0].As<String>().Utf8Value();
-    std::string type = info[1].As<String>().Utf8Value();
-    rtc::Description::Type t = (type == "answer")
-                                   ? rtc::Description::Type::Answer
-                                   : rtc::Description::Type::Offer;
-    if (pc_) pc_->setRemoteDescription(rtc::Description(sdp, t));
-  }
-
-  void Close(const Napi::CallbackInfo& info) {
-    if (pc_) pc_->close();
-  }
-
-  void OnStateChange(const Napi::CallbackInfo& info) {
-    Function cb = info[0].As<Function>();
-    stateCb_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(info.Env(), cb, "pc-state", 0, 1));
-    std::shared_ptr<rtc::PeerConnection> pc = pc_;
-    pc->onStateChange([this](rtc::PeerConnection::State state) {
-      if (stateCb_) {
-        std::string s = stateToString(state);
-        stateCb_->BlockingCall([s](Napi::Env env, Function cb) {
-          cb.Call({String::New(env, s)});
-        });
-      }
-    });
-  }
-
-  Napi::Value CreateDataChannel(const Napi::CallbackInfo& info) {
-    Napi::Env env = info.Env();
-    std::string label = info[0].As<String>().Utf8Value();
-    fprintf(stderr, "[binding] createDataChannel(%s)\n", label.c_str());
-    auto dc = pc_->createDataChannel(label);
-    Object obj = DataChannelWrap::NewInstance(env);
-    DataChannelWrap::Unwrap(obj)->Init(dc);
-    return obj;
-  }
-
-  Napi::Value AddTrack(const Napi::CallbackInfo& info) {
-    Napi::Env env = info.Env();
-    std::string mid = info[0].As<String>().Utf8Value();
-    std::string kind = info[1].As<String>().Utf8Value();
-    if (!pc_) throw Error::New(env, "peer closed");
-    fprintf(stderr, "[binding] addTrack(%s, %s) start\n", mid.c_str(), kind.c_str());
-    try {
-      std::shared_ptr<rtc::Track> track;
-      if (kind == "audio") {
-      // Opus payload type 120 (matches @dank074 CodecPayloadType.opus)
-      auto desc = rtc::Description::Audio(mid);
-      desc.addOpusCodec(120);
-      track = pc_->addTrack(desc);
-      } else {
-      // All video codecs with their payload types, matching WebRtcWrapper:
-      // H264 101/102, H265 103/104, VP8 105/106, VP9 107/108, AV1 109/110
-      auto desc = rtc::Description::Video(mid);
-      desc.addH264Codec(101);
-      desc.addRtxCodec(102, 101, 90000);
-      desc.addH265Codec(103);
-      desc.addRtxCodec(104, 103, 90000);
-      desc.addVP8Codec(105);
-      desc.addRtxCodec(106, 105, 90000);
-      desc.addVP9Codec(107);
-      desc.addRtxCodec(108, 107, 90000);
-      desc.addAV1Codec(109);
-      desc.addRtxCodec(110, 109, 90000);
-      track = pc_->addTrack(desc);
-    }
-      Object obj = TrackWrap::NewInstance(env);
-      TrackWrap::Unwrap(obj)->Init(track, env);
-      return obj;
-    } catch (const std::exception& e) {
-      fprintf(stderr, "[binding] addTrack THREW: %s\n", e.what());
-      throw Error::New(env, e.what());
-    }
-  }
-
-  void OnDataChannel(const Napi::CallbackInfo& info) {
-    Function cb = info[0].As<Function>();
-    dcCb_ = std::make_shared<ThreadSafeFunction>(
-        ThreadSafeFunction::New(info.Env(), cb, "dc", 0, 1));
-    std::shared_ptr<rtc::PeerConnection> pc = pc_;
-    pc->onDataChannel([this](std::shared_ptr<rtc::DataChannel> dc) {
-      if (dcCb_) {
-        auto dcPtr = dc;
-        dcCb_->BlockingCall([dcPtr](Napi::Env env, Function cb) {
-          Object obj = DataChannelWrap::NewInstance(env);
-          DataChannelWrap::Unwrap(obj)->Init(dcPtr);
-          cb.Call({obj});
-        });
-      }
-    });
-  }
-};
-
-Object InitAll(Napi::Env env, Object exports) {
-  exports.Set("PeerConnection", PeerConnectionWrap::Init(env));
-  exports.Set("DataChannel", DataChannelWrap::Init(env));
-  exports.Set("Track", TrackWrap::Init(env));
-  return exports;
-}
-
-NODE_API_MODULE(libdatachannel_min, InitAll)
-
-// Definition for the static constructor references.
-FunctionReference DataChannelWrap::dcConstructor;
-FunctionReference TrackWrap::trackConstructor;
-
-}  // namespace

services/discord-gateway/native/libdatachannel-min/binding.gyp

@@ -1,21 +0,0 @@
-{
-  "targets": [
-    {
-      "target_name": "libdatachannel_min",
-      "sources": ["binding.cpp"],
-      "include_dirs": [
-        "<!(node -e \"console.log(process.env.NAPI_INCLUDE || (() => { try { return require('node-addon-api').include; } catch { return '/nonexistent'; } })())\")",
-        "<!(node -e \"const s=process.env.LDC_INCLUDE||'/nix/store/39a85gpfjqy3h3k8jwrwh7m9yc3inqw7-source';console.log(s+'/include')\")"
-      ],
-      "libraries": [
-        "<!(node -e \"console.log(process.env.LDC_LIB || '/tmp/ldc-build/libdatachannel.so.0.24.0')\")"
-      ],
-      "cflags": ["-std=c++17", "-fexceptions"],
-      "cflags_cc": ["-std=c++17", "-fexceptions"],
-      "defines": ["NAPI_CPP_EXCEPTIONS"],
-      "conditions": [
-        ["OS=='linux'", { "cflags": ["-fvisibility=hidden"] }]
-      ]
-    }
-  ]
-}

services/discord-gateway/native/libdatachannel-min/index.js

@@ -1,3 +0,0 @@
-// libdatachannel-min — JS entry.
-const native = require("./build/Release/datachannel_min.node");
-module.exports = native;

services/discord-gateway/native/libdatachannel-min/package.json

@@ -1,17 +0,0 @@
-{
-  "name": "libdatachannel-min",
-  "version": "0.1.0",
-  "description": "Minimal N-API binding to libdatachannel — PeerConnection, DataChannel, ICE, SDP (+ media tracks for GoLive)",
-  "main": "index.js",
-  "gypfile": true,
-  "scripts": {
-    "build": "node-gyp rebuild",
-    "test": "node test-handshake.js"
-  },
-  "dependencies": {
-    "node-addon-api": "^8.3.0"
-  },
-  "devDependencies": {
-    "node-gyp": "^11.5.0"
-  }
-}

services/discord-gateway/native/libdatachannel-min/test-handshake.js

@@ -1,82 +0,0 @@
-// Phase 0 spike: prove the minimal binding can do a full WebRTC handshake
-// (offer/answer + ICE + DataChannel) between two local PeerConnections.
-"use strict";
-const { PeerConnection } = require("./build/Release/datachannel_min.node");
-
-function log(...args) {
-  console.log("[spike]", ...args);
-}
-
-async function main() {
-  const pcA = new PeerConnection({ iceServers: [] });
-  const pcB = new PeerConnection({ iceServers: [] });
-
-  const stateLog = [];
-  pcA.onStateChange((s) => {
-    stateLog.push(`A:${s}`);
-    log("A state:", s);
-  });
-  pcB.onStateChange((s) => {
-    stateLog.push(`B:${s}`);
-    log("B state:", s);
-  });
-
-  // B waits for incoming DataChannel
-  const received = new Promise((resolve) => {
-    pcB.onDataChannel((dc) => {
-      log("B got incoming DataChannel");
-      dc.onOpen(() => log("B DataChannel open"));
-      dc.onMessage((msg) => {
-        log("B received message:", msg);
-        dc.send("pong from B");
-        resolve(msg);
-      });
-    });
-  });
-
-  // A creates an outgoing DataChannel
-  const dcA = pcA.createDataChannel("test");
-  dcA.onOpen(() => {
-    log("A DataChannel open — sending hello");
-    dcA.send("hello from A");
-  });
-  dcA.onMessage((msg) => {
-    log("A received reply:", msg);
-  });
-
-  // Offer/answer dance
-  log("A createOffer...");
-  const offer = await pcA.createOffer();
-  log("Offer SDP bytes:", offer.length);
-  log("B createAnswer...");
-  const answer = await pcB.createAnswer(offer);
-  log("Answer SDP bytes:", answer.length);
-  const setupMatch = answer.match(/a=setup:(\S+)/);
-  log("Answer setup role:", setupMatch ? setupMatch[1] : "NONE");
-  pcA.setRemoteDescription(answer, "answer");
-
-  // Wait for message roundtrip
-  const msg = await Promise.race([
-    received,
-    new Promise((_, rej) => setTimeout(() => rej(new Error("TIMEOUT waiting for datachannel message")), 15000)),
-  ]);
-
-  log("ROUNDTRIP OK — B got:", msg);
-  log("States:", stateLog.join(" | "));
-
-  const aState = pcA.state();
-  const bState = pcB.state();
-  log("Final states — A:", aState, "B:", bState);
-
-  pcA.close();
-  pcB.close();
-
-  if (msg !== "hello from A") throw new Error("wrong message");
-  if (aState !== "connected" && aState !== "disconnected") throw new Error("A not connected: " + aState);
-  log("SPIKE PASSED ✅");
-}
-
-main().catch((e) => {
-  console.error("SPIKE FAILED:", e.message);
-  process.exit(1);
-});

services/discord-gateway/native/libdatachannel-min/test-packetizer.js

@@ -1,80 +0,0 @@
-// Verify setPacketizer + sendFrame: two peers connect, audio+video tracks
-// packetize real encoded frames (opus + AnnexB H264), RTP flows without crash.
-"use strict";
-const { PeerConnection } = require("./build/Release/datachannel_min.node");
-
-function sleep(ms) { return new Promise((r) => setTimeout(r, ms)); }
-
-async function main() {
-  const pcA = new PeerConnection({ iceServers: [] });
-  const pcB = new PeerConnection({ iceServers: [] });
-
-  const aAudio = pcA.addTrack("0", "audio");
-  const aVideo = pcA.addTrack("1", "video");
-  pcB.addTrack("0", "audio");
-  pcB.addTrack("1", "video");
-
-  let states = { a: "", b: "" };
-  pcA.onStateChange((s) => (states.a = s));
-  pcB.onStateChange((s) => (states.b = s));
-
-  // A: offer (createDataChannel not needed — tracks trigger negotiation)
-  const offer = await pcA.createOffer();
-  pcB.setRemoteDescription(offer, "offer");
-  const answer = await pcB.createAnswer(offer);
-  pcA.setRemoteDescription(answer, "answer");
-
-  // Wait for connected
-  for (let i = 0; i < 50; i++) {
-    if (states.a === "connected" && states.b === "connected") break;
-    await sleep(100);
-  }
-  console.log("[pkt] states:", states.a, states.b);
-  if (states.a !== "connected" || states.b !== "connected") {
-    console.log("PKT TEST FAILED: not connected");
-    process.exit(1);
-  }
-
-  // Setup packetizers on A (sender)
-  aAudio.setPacketizer("audio", 1234, 120, 48000, 5, 0, 1);
-  aVideo.setPacketizer("h264", 5678, 101, 90000, 5, 0, 10);
-
-  // Fake opus frame (20ms @48kHz stereo — payload can be any bytes)
-  const opusFrame = Buffer.alloc(160);
-  for (let i = 0; i < 160; i++) opusFrame[i] = i & 0xff;
-
-  // Fake AnnexB H264 frame: SPS + PPS + IDR slice
-  const sps = Buffer.from([0x00, 0x00, 0x00, 0x01, 0x67, 0x42, 0xc0, 0x1e, 0xd9, 0x01, 0x40, 0x7e]);
-  const pps = Buffer.from([0x00, 0x00, 0x00, 0x01, 0x68, 0xce, 0x3c, 0x80]);
-  const idr = Buffer.from([0x00, 0x00, 0x00, 0x01, 0x65, 0x88, 0x84, 0x00, 0x01, 0x02, 0x03, 0x04, 0x05, 0x06, 0x07]);
-  const h264Frame = Buffer.concat([sps, pps, idr]);
-
-  // Send 10 audio frames (20ms each) + 3 video frames (33ms each)
-  for (let i = 0; i < 10; i++) {
-    aAudio.sendFrame(opusFrame);
-    aAudio.addTimestamp(960); // 20ms @ 48kHz
-  }
-  for (let i = 0; i < 3; i++) {
-    aVideo.sendFrame(h264Frame);
-    aVideo.addTimestamp(3000); // 33ms @ 90kHz
-  }
-
-  await sleep(500);
-  console.log("[pkt] after send: states:", states.a, states.b);
-  console.log("[pkt] audio track open:", aAudio.isOpen(), "| video track open:", aVideo.isOpen());
-  const ok = states.a === "connected" && aAudio.isOpen() && aVideo.isOpen();
-  console.log(ok ? "PKT TEST PASSED" : "PKT TEST FAILED");
-  pcA.close();
-  pcB.close();
-  process.exit(ok ? 0 : 1);
-}
-
-main().catch((e) => {
-  console.error("[pkt] FAILED:", e.message);
-  process.exit(1);
-});
-
-setTimeout(() => {
-  console.error("[pkt] TIMEOUT");
-  process.exit(1);
-}, 25000);

services/discord-gateway/native/libdatachannel-min/test-track.js

@@ -1,33 +0,0 @@
-// Verify addTrack produces SDP with audio+video media sections.
-"use strict";
-const { PeerConnection } = require("./build/Release/datachannel_min.node");
-
-const pc = new PeerConnection({ iceServers: [] });
-const audioTrack = pc.addTrack("0", "audio");
-const videoTrack = pc.addTrack("1", "video");
-
-pc.onStateChange((s) => console.log("[test-track] state:", s));
-
-pc.createOffer().then((sdp) => {
-  const hasAudio = /^m=audio\s/m.test(sdp);
-  const hasVideo = /^m=video\s/m.test(sdp);
-  const audioPts = sdp.match(/a=rtpmap:(\d+) opus/g) || [];
-  const videoPts = sdp.match(/a=rtpmap:(\d+) H264/g) || [];
-  console.log("[test-track] SDP bytes:", sdp.length);
-  console.log("[test-track] m=audio:", hasAudio, "| m=video:", hasVideo);
-  console.log("[test-track] opus pt:", audioPts, "| H264 pt:", videoPts);
-  console.log("[test-track] audio track send ok:", typeof audioTrack.send === "function");
-  console.log("[test-track] video track send ok:", typeof videoTrack.send === "function");
-  const ok = hasAudio && hasVideo && audioPts.length > 0 && videoPts.length > 0;
-  console.log(ok ? "TRACK TEST PASSED" : "TRACK TEST FAILED");
-  pc.close();
-  process.exit(ok ? 0 : 1);
-}).catch((e) => {
-  console.error("[test-track] FAILED:", e.message);
-  process.exit(1);
-});
-
-setTimeout(() => {
-  console.error("[test-track] TIMEOUT");
-  process.exit(1);
-}, 20000);

services/discord-gateway/package.json

@@ -28,7 +28,6 @@
     "discord.js-selfbot-v13": "^3.7.1",
     "dotenv": "^17.4.2",
     "drizzle-orm": "^0.45.2",
-    "imghash": "^1.1.4",
     "ioredis": "^5.11.0",
     "libsodium-wrappers": "^0.8.4",
     "lru-cache": "^11.5.1",

services/discord-gateway/pnpm-lock.yaml

@@ -29,9 +29,6 @@ importers:
       drizzle-orm:
         specifier: ^0.45.2
         version: 0.45.2(@types/pg@8.20.0)(pg@8.22.0)
-      imghash:
-        specifier: ^1.1.4
-        version: 1.1.4
       ioredis:
         specifier: ^5.11.0
         version: 5.11.1(supports-color@7.2.0)
@@ -80,7 +77,7 @@ importers:
     devDependencies:
       '@biomejs/biome':
         specifier: latest
-        version: 2.5.7
+        version: 2.5.8
       '@types/node':
         specifier: ^25.9.0
         version: 25.9.5
@@ -105,86 +102,63 @@ importers:
 
 packages:
 
-  '@biomejs/biome@2.5.7':
-    resolution: {integrity: sha512-zr8K/DcY5tYsQOQwqMJ0AWElo6QgmgNI7idXgXLhevVszlt8RGVpesEJPqx3ThazLaOwjJ5Y8fz3BtH5fGZNsw==}
+  '@biomejs/biome@2.5.8':
+    resolution: {integrity: sha512-aeAeeJB9fSDc7Gq+2GqpQxA0qBj6gj1k2R6L1cYqGePKP/baIq1WX8y6B+D+nRsO5ViQL22K/8IwbqERW0q1nw==}
     engines: {node: '>=14.21.3'}
     hasBin: true
 
-  '@biomejs/cli-darwin-arm64@2.5.7':
-    resolution: {integrity: sha512-vxo/Ls3/PYdQWyLhYYcgMOCzQypAjcY+iihS8M0wW03l16TCLW4zqZzGo75gm1VdCMj38hTVZ31KBWrZ4G9dJw==}
+  '@biomejs/cli-darwin-arm64@2.5.8':
+    resolution: {integrity: sha512-mk1QON9PHllvvLN5gU3f4rMxeh4syK5p9OvKyWH6/W8ueh04uaC8TUXXByhGufWf/y5mQc03ZLM45zU+cmqMjA==}
     engines: {node: '>=14.21.3'}
     cpu: [arm64]
     os: [darwin]
 
-  '@biomejs/cli-darwin-x64@2.5.7':
-    resolution: {integrity: sha512-Cd3Ga61amT/Yl/0x8elP5hhGYaFy4bw6WuysTgf7oo8TA5tJ5A1k+DkVoJ2BHbTVil51gTX9VPzArnrlLJ3Kyg==}
+  '@biomejs/cli-darwin-x64@2.5.8':
+    resolution: {integrity: sha512-bsGwFMBNyHPyiLSsQcZJxdoRrg1V4JL+d7wEsvUBczlP9U9lwM+7mzQHxI4o1mhBsTmdOBbAb6fHU3Z3snN45w==}
     engines: {node: '>=14.21.3'}
     cpu: [x64]
     os: [darwin]
 
-  '@biomejs/cli-linux-arm64-musl@2.5.7':
-    resolution: {integrity: sha512-xPI5yB6XlpDbNkS+bm1t42olw5c4l3UrlOmLg7KtLJvjvkNF/1V4tnUgfkylGIeb3u/T+BzMGYqgQhzjAoJzuQ==}
+  '@biomejs/cli-linux-arm64-musl@2.5.8':
+    resolution: {integrity: sha512-VcJNbstduTHx83NGAdhp78/JOcP45BZHXL7yNsfI1uGzdUgegAz2s+mSoT7wK6PBNzLoqG0zDOXaz/RQYVtSiw==}
     engines: {node: '>=14.21.3'}
     cpu: [arm64]
     os: [linux]
     libc: [musl]
 
-  '@biomejs/cli-linux-arm64@2.5.7':
-    resolution: {integrity: sha512-rR2QE0yF2GYSuYuKIa7pKvODGJqnOH+2eDREAM8wV+mWKSkMQKdAp4zXEZfTaxY8PMoNONnpgSWcBCyLDPDOKg==}
+  '@biomejs/cli-linux-arm64@2.5.8':
+    resolution: {integrity: sha512-XmFiA0WPYFC+uiUDC8WRFzAIH9bo7vwQLav38Uoq4ETC+T/+uBi0TsYGJECkugY3r8USl3jc+Ae2/irAF6F2lQ==}
     engines: {node: '>=14.21.3'}
     cpu: [arm64]
     os: [linux]
     libc: [glibc]
 
-  '@biomejs/cli-linux-x64-musl@2.5.7':
-    resolution: {integrity: sha512-rE5VZi+qtmPgQH+l7jVxYoZ18b/TiHEhulhMpjmCZH1PltSbjRcxNWywC3HZ9tYottG7ORkeTtoscBilKSBm0g==}
+  '@biomejs/cli-linux-x64-musl@2.5.8':
+    resolution: {integrity: sha512-kKmiyokeISRGq2FLwvr+TzsgBusfxaZ0FZNLcOYOpCK/78tRrEjeEBLvq3xLZMpqbANgJdRPI7vZX8ZL37u9/w==}
     engines: {node: '>=14.21.3'}
     cpu: [x64]
     os: [linux]
     libc: [musl]
 
-  '@biomejs/cli-linux-x64@2.5.7':
-    resolution: {integrity: sha512-FQgqJhscrqJUFptGaRSUJWlXAExwWcDwLuK49dvKfkQ1bB5SEEyFssnsxQY83Xm6jR0EbbX3+8+D5bfvYqUG2Q==}
+  '@biomejs/cli-linux-x64@2.5.8':
+    resolution: {integrity: sha512-S5wcm9OBDvLHodD4PUaN488hCpco9QD/9ZxuYJiw4euWtr/oQvLR72z2ixItH8Wd5BCm6FZaeb+YNvOoM1xHtQ==}
     engines: {node: '>=14.21.3'}
     cpu: [x64]
     os: [linux]
     libc: [glibc]
 
-  '@biomejs/cli-win32-arm64@2.5.7':
-    resolution: {integrity: sha512-Oq4x0CCwP4jirrcTywXs5kOGZ4v5vuEP+gWrbtjApOA2CL9F3F9GlIdQIci8AKSCa/zURanMRpX/4wQ7Am6hHg==}
+  '@biomejs/cli-win32-arm64@2.5.8':
+    resolution: {integrity: sha512-nILH0mzm3Hi3iEdd7o7GpB8kBR/mSQwfQG/tyBqyNrY2GFtcgwfV9nV8xLmbtUpMNY/Oi0Ml1XgfR4flOdq+AA==}
     engines: {node: '>=14.21.3'}
     cpu: [arm64]
     os: [win32]
 
-  '@biomejs/cli-win32-x64@2.5.7':
-    resolution: {integrity: sha512-V+0wu/nrj2S+MhP4EQ0uHNolP0IALEsz45pg0WoKkHfDeh0+ItHwP/p7bX5RPoMOl9NkpHYWdYPhIcy2mACHvQ==}
+  '@biomejs/cli-win32-x64@2.5.8':
+    resolution: {integrity: sha512-I2czzXTY61f3nFJxXoMDq80t7MivxDEnCjE+8sDKoFfcKMaoQdkqhIFQ3KyY0XLzeSpUBYeNAXgD+iOV/BU0VA==}
     engines: {node: '>=14.21.3'}
     cpu: [x64]
     os: [win32]
 
-  '@canvas/image-data@1.1.0':
-    resolution: {integrity: sha512-QdObRRjRbcXGmM1tmJ+MrHcaz1MftF2+W7YI+MsphnsCrmtyfS0d5qJbk0MeSbUeyM/jCb0hmnkXPsy026L7dA==}
-
-  '@canvas/image@2.0.0':
-    resolution: {integrity: sha512-DQKEftZ5M4eM8Rzhv8FFZGdOsO8bVjzPC/9pBF+P//HjQM/Xf+PvQRTv97mVpsHt+Pejs1V7ooK6xf+dYgDNpw==}
-    engines: {node: '>=10'}
-
-  '@cwasm/jpeg-turbo@0.1.3':
-    resolution: {integrity: sha512-FkZxwwC6r4zhzlqM0nYGaMj/MDSrZPxLOdPdM6ySlgsMfOpNAZcLQkpNF4jP+DmsuUvRoeUD0YSMBvg3jYfK6w==}
-
-  '@cwasm/lodepng@0.1.9':
-    resolution: {integrity: sha512-vb2H7/jTxnqJi7hHiEgtFm3smIqVpeY417vN+8cwsq3iTNrHzwnMzFXbeCf2H9Dl13Vh64qgUUcC2mxf6TPODA==}
-    engines: {node: '>=8.0.0'}
-
-  '@cwasm/nsbmp@0.1.3':
-    resolution: {integrity: sha512-APiz9Rj2E049rBapTtwnCGqQeqJjmC85busDQ44UCaujU+LoggUm06NuS1WIBAZcDMRbJOgCFcRWc0tMT2kpfg==}
-
-  '@cwasm/nsgif@0.1.2':
-    resolution: {integrity: sha512-LOD5HlL0O5jpnIAl+dLSZcB3v0RBNBjtoaymdCEPe2kyKzaP20BF+jy/QUyOZogQsgMVjusZES3tgwwoiiJ2rA==}
-
-  '@cwasm/webp@0.1.5':
-    resolution: {integrity: sha512-ceIZQkyxK+s7mmItNcWqqHdOBiJAxYxTnrnPNgUNjldB1M9j+Bp/3eVIVwC8rUFyN/zoFwuT0331pyY3ackaNA==}
-
   '@discordjs/builders@1.14.1':
     resolution: {integrity: sha512-gSKkhXLqs96TCzk66VZuHHl8z2bQMJFGwrXC0f33ngK+FLNau4hU1PYny3DNJfNdSH+gVMzE85/d5FQ2BpcNwQ==}
     engines: {node: '>=16.11.0'}
@@ -1288,9 +1262,6 @@ packages:
   base64-js@1.5.1:
     resolution: {integrity: sha512-AKpaYlHn8t4SVbOHCy+b5+KKgvR4vrsD8vbvrbiQJps7fKDTkjkDry6ji0rUJjC0kzbNePLwzxq8iypo41qeWA==}
 
-  blockhash-core@0.1.0:
-    resolution: {integrity: sha512-Cv7BgBo0jjVPaeuel4cvxf9LqIGsYNIPz9DAGvvrF9LRlEq9Q3HXu+S8bklPCae0sCxAXic4HGMoImf3FeO3Nw==}
-
   brace-expansion@1.1.18:
     resolution: {integrity: sha512-Edep/X9fGqVNmzKBVsDYIOtD+z1tuezV70LBjdCst9Tqu76lsnvRiZ6oTic1n+/BIwX6QDGAO94PN4N2SADvtw==}
 
@@ -1377,18 +1348,6 @@ packages:
     resolution: {integrity: sha512-z2S+W9X73hAUUki+N+9Za2lBlun89zigOyGrsax+KUQ6wKW4ZoWpEYBkGhQjwAjjDCkWxhY0VKEhk8wzY7F5cA==}
     engines: {node: '>=0.10.0'}
 
-  decode-bmp@0.2.1:
-    resolution: {integrity: sha512-NiOaGe+GN0KJqi2STf24hfMkFitDUaIoUU3eKvP/wAbLe8o6FuW5n/x7MHPR0HKvBokp6MQY/j7w8lewEeVCIA==}
-    engines: {node: '>=8.6.0'}
-
-  decode-ico@0.4.1:
-    resolution: {integrity: sha512-69NZfbKIzux1vBOd31al3XnMnH+2mqDhEgLdpygErm4d60N+UwA5Sq5WFjmEDQzumgB9fElojGwWG0vybVfFmA==}
-    engines: {node: '>=8.6'}
-
-  decompress-response@6.0.0:
-    resolution: {integrity: sha512-aW35yZM6Bb/4oJlZncMH2LCoZtJXTRxES17vE3hoRiowU2kWHaJKFkSBDnDR+cm9J+9QhXmREyIfv0pji9ejCQ==}
-    engines: {node: '>=10'}
-
   delayed-stream@1.0.0:
     resolution: {integrity: sha512-ZySD7Nf91aLB0RxL4KGrKHBXl7Eds1DAmEdcoVawXnLD7SDhpNgtuII2aAkg7a7QS41jxPSZ17p4VdGnMHk3MQ==}
     engines: {node: '>=0.4.0'}
@@ -1566,15 +1525,6 @@ packages:
     resolution: {integrity: sha512-KfYbmpRm0VbLjEvVa9yGwCi9GI34xvi7A/HXYWQO65CSD2u3MczUJSuwXKFIxlGsgBQizV9q5J9NHj4VG0n+pA==}
     engines: {node: '>=12.0.0'}
 
-  fast-base64-decode@1.0.0:
-    resolution: {integrity: sha512-qwaScUgUGBYeDNRnbc/KyllVU88Jk1pRHPStuF/lO7B0/RTRLj7U0lkdTAutlBblY08rwZDff6tNU9cjv6j//Q==}
-
-  fast-base64-encode@1.0.0:
-    resolution: {integrity: sha512-z2XCzVK4fde2cuTEHu2QGkLD6BPtJNKJPn0Z7oINvmhq/quUuIIVPYKUdN0gYeZqOyurjJjBH/bUzK5gafyHvw==}
-
-  fast-base64-length@1.0.0:
-    resolution: {integrity: sha512-MV+/ioblHx6SMjc/1l4EAnRJyAku6+6DxZ6RW0FoFCF1Aol/Ldb6FqwE3Kn3Ju1aam2m1KCIVoCljhgcG+Umzg==}
-
   fast-deep-equal@3.1.3:
     resolution: {integrity: sha512-f3qQ9oQy9j2AhBe/H9VC91wLmKBCCU/gDOnKNAYG5hswO7BLKj09Hc5HYNz9cGI++xlpDCIgDaitVs03ATR84Q==}
 
@@ -1590,10 +1540,6 @@ packages:
   fetch-cookie@3.2.0:
     resolution: {integrity: sha512-n61pQIxP25C6DRhcJxn7BDzgHP/+S56Urowb5WFxtcRMpU6drqXD90xjyAsVQYsNSNNVbaCcYY1DuHsdkZLuiA==}
 
-  file-type@10.11.0:
-    resolution: {integrity: sha512-uzk64HRpUZyTGZtVuvrjP0FYxzQrBf4rojot6J65YMEbwBLB0CWm0CLojVpwpmFmxcE/lkvYICgfcGozbBq6rw==}
-    engines: {node: '>=6'}
-
   find-process@2.1.1:
     resolution: {integrity: sha512-SrQDx3QhlmHM90iqn9rdjCQcw/T+WlpOkHFsjoRgB+zTpDfltNA1VSNYeYELwhUTJy12UFxqjWhmhOrJc+o4sA==}
     hasBin: true
@@ -1684,14 +1630,6 @@ packages:
   ieee754@1.2.1:
     resolution: {integrity: sha512-dcyqhDvX1C46lXZcVqCpK+FtMRQVdIMN6/Df5js2zouUsqG7I6sFxitIC+7KYK29KdXOLHdu9zL4sFnoVQnqaA==}
 
-  image-type@4.1.0:
-    resolution: {integrity: sha512-CFJMJ8QK8lJvRlTCEgarL4ro6hfDQKif2HjSvYCdQZESaIPV4v9imrf7BQHK+sQeTeNeMpWciR9hyC/g8ybXEg==}
-    engines: {node: '>=6'}
-
-  imghash@1.1.4:
-    resolution: {integrity: sha512-atRI6S7rwrdZlr8pBsuk0NfBfeuPzyna98ugz2Sodj1P8SOZJLVYuqWnUrUFg2YnFTxtdbdSq4Ucn1osLFQ+qA==}
-    engines: {node: '>=20'}
-
   inflight@1.0.6:
     resolution: {integrity: sha512-k92I/b08q4wvFscXCLvqfsHCrjrF7yiXsQuIVvVE7N82W3+aqpzuUdBbfhWcy/FZR3/4IgflMgKLOsvPDrGCJA==}
     deprecated: This module is not supported, and leaks memory. Do not use it. Check out lru-cache if you want a good and tested way to coalesce async requests by a key value, which is much more comprehensive and powerful.
@@ -1711,9 +1649,6 @@ packages:
     resolution: {integrity: sha512-PhBY86zaxNZUuWP6h13Vu5oFe0XY6/UlKzQnYFELzGVHygP3MxmvTfYSG7GN3aIab/iWudSMgjSnG9Dq+nHrgA==}
     engines: {node: '>=16'}
 
-  jpeg-js@0.4.4:
-    resolution: {integrity: sha512-WZzeDOEtTOBK4Mdsar0IqEU5sMr3vSV2RqkAIzUEV2BHnUfKGyswWFPFwK5EeDo93K3FohSHbLAjj0s1Wzd+dg==}
-
   libsodium-wrappers@0.8.4:
     resolution: {integrity: sha512-mu8aAWucZjTB5O/BtGXtW4e1agy7uHxNYG7zPthmmD1jU43LCDmSWZLN4JhflbdPXj3yDO4lxM1O9hLDgIOXDw==}
 
@@ -1831,10 +1766,6 @@ packages:
     resolution: {integrity: sha512-ZDY+bPm5zTTF+YpCrAU9nK0UgICYPT0QtT1NZWFv4s++TNkcgVaT0g6+4R2uI4MjQjzysHB1zxuWL50hzaeXiw==}
     engines: {node: '>= 0.6'}
 
-  mimic-response@3.1.0:
-    resolution: {integrity: sha512-z0yWI+4FDrrweS8Zmt4Ej5HdJmky15+L2e6Wgn3+iK5fWzb6T3fhNFq2+MeTRb064c6Wr4N/wv0DzQTjNzHNGQ==}
-    engines: {node: '>=10'}
-
   minimatch@3.1.5:
     resolution: {integrity: sha512-VgjWUsnnT6n+NUk6eZq77zeFdpW2LWDzP6zFGrCbHXiYNul5Dzqk2HHQ5uFH2DNW5Xbp8+jVzaeNt94ssEEl4w==}
 
@@ -2139,12 +2070,6 @@ packages:
   signal-exit@3.0.7:
     resolution: {integrity: sha512-wnD2ZE+l+SPC/uoS0vXeE9L1+0wuaMqKlfz9AMUo38JsyLSBWSFcHR1Rri62LZc12vLr1gb3jl7iwQhgwpAbGQ==}
 
-  simple-concat@1.0.1:
-    resolution: {integrity: sha512-cSFtAPtRhljv69IK0hTVZQ+OfE9nePi/rtJmw5UjHeVyVroEqJXP1sFztKUy1qU+xvz3u/sfYJLa947b7nAN2Q==}
-
-  simple-get@4.0.1:
-    resolution: {integrity: sha512-brv7p5WgH0jmQJr1ZDDfKDOSeWWg+OVypG99A/5vYGPqJ6pxiaHLy8nxtFjBA7oMa01ebA9gfh1uMCFqOuXxvA==}
-
   sonic-boom@4.2.1:
     resolution: {integrity: sha512-w6AxtubXa2wTXAUsZMMWERrsIRAdrK0Sc+FUytWvYAhBJLyuI4llrMIC1DtlNSdI99EI86KZum2MMq3EAZlF9Q==}
 
@@ -2231,9 +2156,6 @@ packages:
     resolution: {integrity: sha512-3kZ8wQQ/k5DrChD4X4FVvr2D7E5uoRgAqkPyLpSCGUvqOvqu+JEdr3mwMUaVWb+vMHZaKhF5fp2PBigKsui7hA==}
     hasBin: true
 
-  to-data-view@1.1.0:
-    resolution: {integrity: sha512-1eAdufMg6mwgmlojAx3QeMnzB/BTVp7Tbndi3U7ftcT2zCZadjxkkmLmd97zmaxWi+sgGcgWrokmpEoy0Dn0vQ==}
-
   tough-cookie@5.1.2:
     resolution: {integrity: sha512-FVDYdxtnj0G6Qm/DhNPSb8Ju59ULcup3tuJxkFb5K8Bv2pUXILbf0xZWU8PX8Ov19OXljbUyveOFwRMwkXzO+A==}
     engines: {node: '>=16'}
@@ -2426,77 +2348,41 @@ packages:
 
 snapshots:
 
-  '@biomejs/biome@2.5.7':
+  '@biomejs/biome@2.5.8':
     optionalDependencies:
-      '@biomejs/cli-darwin-arm64': 2.5.7
-      '@biomejs/cli-darwin-x64': 2.5.7
-      '@biomejs/cli-linux-arm64': 2.5.7
-      '@biomejs/cli-linux-arm64-musl': 2.5.7
-      '@biomejs/cli-linux-x64': 2.5.7
-      '@biomejs/cli-linux-x64-musl': 2.5.7
-      '@biomejs/cli-win32-arm64': 2.5.7
-      '@biomejs/cli-win32-x64': 2.5.7
+      '@biomejs/cli-darwin-arm64': 2.5.8
+      '@biomejs/cli-darwin-x64': 2.5.8
+      '@biomejs/cli-linux-arm64': 2.5.8
+      '@biomejs/cli-linux-arm64-musl': 2.5.8
+      '@biomejs/cli-linux-x64': 2.5.8
+      '@biomejs/cli-linux-x64-musl': 2.5.8
+      '@biomejs/cli-win32-arm64': 2.5.8
+      '@biomejs/cli-win32-x64': 2.5.8
 
-  '@biomejs/cli-darwin-arm64@2.5.7':
+  '@biomejs/cli-darwin-arm64@2.5.8':
     optional: true
 
-  '@biomejs/cli-darwin-x64@2.5.7':
+  '@biomejs/cli-darwin-x64@2.5.8':
     optional: true
 
-  '@biomejs/cli-linux-arm64-musl@2.5.7':
+  '@biomejs/cli-linux-arm64-musl@2.5.8':
     optional: true
 
-  '@biomejs/cli-linux-arm64@2.5.7':
+  '@biomejs/cli-linux-arm64@2.5.8':
     optional: true
 
-  '@biomejs/cli-linux-x64-musl@2.5.7':
+  '@biomejs/cli-linux-x64-musl@2.5.8':
     optional: true
 
-  '@biomejs/cli-linux-x64@2.5.7':
+  '@biomejs/cli-linux-x64@2.5.8':
     optional: true
 
-  '@biomejs/cli-win32-arm64@2.5.7':
+  '@biomejs/cli-win32-arm64@2.5.8':
     optional: true
 
-  '@biomejs/cli-win32-x64@2.5.7':
+  '@biomejs/cli-win32-x64@2.5.8':
     optional: true
 
-  '@canvas/image-data@1.1.0': {}
-
-  '@canvas/image@2.0.0':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-      '@cwasm/jpeg-turbo': 0.1.3
-      '@cwasm/lodepng': 0.1.9
-      '@cwasm/nsbmp': 0.1.3
-      '@cwasm/nsgif': 0.1.2
-      '@cwasm/webp': 0.1.5
-      decode-ico: 0.4.1
-      fast-base64-decode: 1.0.0
-      fast-base64-encode: 1.0.0
-      fast-base64-length: 1.0.0
-      simple-get: 4.0.1
-
-  '@cwasm/jpeg-turbo@0.1.3':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-
-  '@cwasm/lodepng@0.1.9':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-
-  '@cwasm/nsbmp@0.1.3':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-
-  '@cwasm/nsgif@0.1.2':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-
-  '@cwasm/webp@0.1.5':
-    dependencies:
-      '@canvas/image-data': 1.1.0
-
   '@discordjs/builders@1.14.1':
     dependencies:
       '@discordjs/formatters': 0.6.2
@@ -3280,8 +3166,6 @@ snapshots:
 
   base64-js@1.5.1: {}
 
-  blockhash-core@0.1.0: {}
-
   brace-expansion@1.1.18:
     dependencies:
       balanced-match: 1.0.2
@@ -3352,21 +3236,6 @@ snapshots:
 
   decamelize@1.2.0: {}
 
-  decode-bmp@0.2.1:
-    dependencies:
-      '@canvas/image-data': 1.1.0
-      to-data-view: 1.1.0
-
-  decode-ico@0.4.1:
-    dependencies:
-      '@canvas/image-data': 1.1.0
-      decode-bmp: 0.2.1
-      to-data-view: 1.1.0
-
-  decompress-response@6.0.0:
-    dependencies:
-      mimic-response: 3.1.0
-
   delayed-stream@1.0.0: {}
 
   delegates@1.0.0: {}
@@ -3535,12 +3404,6 @@ snapshots:
 
   expect-type@1.4.0: {}
 
-  fast-base64-decode@1.0.0: {}
-
-  fast-base64-encode@1.0.0: {}
-
-  fast-base64-length@1.0.0: {}
-
   fast-deep-equal@3.1.3: {}
 
   fdir@6.5.0(picomatch@4.0.5):
@@ -3552,8 +3415,6 @@ snapshots:
       set-cookie-parser: 2.7.2
       tough-cookie: 6.0.2
 
-  file-type@10.11.0: {}
-
   find-process@2.1.1:
     dependencies:
       chalk: 4.1.2
@@ -3658,17 +3519,6 @@ snapshots:
 
   ieee754@1.2.1: {}
 
-  image-type@4.1.0:
-    dependencies:
-      file-type: 10.11.0
-
-  imghash@1.1.4:
-    dependencies:
-      '@canvas/image': 2.0.0
-      blockhash-core: 0.1.0
-      image-type: 4.1.0
-      jpeg-js: 0.4.4
-
   inflight@1.0.6:
     dependencies:
       once: 1.4.0
@@ -3692,8 +3542,6 @@ snapshots:
 
   is-network-error@1.3.2: {}
 
-  jpeg-js@0.4.4: {}
-
   libsodium-wrappers@0.8.4:
     dependencies:
       libsodium: 0.8.4
@@ -3780,8 +3628,6 @@ snapshots:
     dependencies:
       mime-db: 1.52.0
 
-  mimic-response@3.1.0: {}
-
   minimatch@3.1.5:
     dependencies:
       brace-expansion: 1.1.18
@@ -4061,14 +3907,6 @@ snapshots:
 
   signal-exit@3.0.7: {}
 
-  simple-concat@1.0.1: {}
-
-  simple-get@4.0.1:
-    dependencies:
-      decompress-response: 6.0.0
-      once: 1.4.0
-      simple-concat: 1.0.1
-
   sonic-boom@4.2.1:
     dependencies:
       atomic-sleep: 1.0.0
@@ -4148,8 +3986,6 @@ snapshots:
     dependencies:
       tldts-core: 7.4.9
 
-  to-data-view@1.1.0: {}
-
   tough-cookie@5.1.2:
     dependencies:
       tldts: 6.1.86

services/discord-gateway/scripts/fix-imports.mjs

@@ -0,0 +1,49 @@
+// Rewrite import specifiers in the compiled dist/ so the output runs under
+// plain `node dist/index.js` (native ESM, no bundler / no tsx).
+//
+// Background: tsconfig uses moduleResolution:"bundler", so `tsc` emits BARE
+// relative specifiers WITHOUT extensions (e.g. `import "./router"`) and leaves
+// the `@/*` path-alias imports untouched. Node's native ESM resolver rejects
+// extensionless relative specifiers and knows nothing about the `@/` alias, so
+// the emitted dist/ crashes at startup (`ERR_MODULE_NOT_FOUND`). This script
+// fixes both:
+//   1. `@/foo`            -> relative path to dist/foo.js
+//   2. `./foo` / `../foo` -> `./foo.js` / `../foo.js` (append .js)
+// Already-extensioned relative imports (.js/.json/.node/.mjs/.cjs) and bare
+// package specifiers are left untouched (idempotent).
+import { readFileSync, writeFileSync, existsSync, readdirSync } from "node:fs";
+import { join, relative, dirname } from "node:path";
+
+let count = 0;
+function walk(dir) {
+  if (!existsSync(dir)) return;
+  for (const e of readdirSync(dir, { withFileTypes: true })) {
+    const p = join(dir, e.name);
+    if (e.isDirectory()) walk(p);
+    else if (e.name.endsWith(".js")) {
+      const c = readFileSync(p, "utf8");
+      const pat = /from\s+['"]([^'"]+)['"]/g;
+      const n = c.replace(pat, (m, spec) => {
+        if (spec.startsWith("@/")) {
+          const target = join("dist", spec.slice(2)) + ".js";
+          let rel = relative(dirname(p), target);
+          if (!rel.startsWith(".")) rel = "./" + rel;
+          return `from "${rel}"`;
+        }
+        if (
+          (spec.startsWith("./") || spec.startsWith("../")) &&
+          !/\.(js|json|node|mjs|cjs)$/.test(spec)
+        ) {
+          return `from "${spec}.js"`;
+        }
+        return m;
+      });
+      if (n !== c) {
+        writeFileSync(p, n);
+        count++;
+      }
+    }
+  }
+}
+walk("dist");
+console.log(`Fixed ${count} import specifiers in dist/`);

services/discord-gateway/src/app/bootstrap.ts

@@ -3,7 +3,11 @@ import { inArray, lt } from "drizzle-orm";
 import type { NodePgDatabase } from "drizzle-orm/node-postgres";
 import { ConfigError, DatabaseError } from "@/shared/errors/index";
 import { createChildLogger } from "@/shared/logger/index";
-import { startPendingAIAnalysisWorker } from "../modules/ai-moderation/aiAnalyzer.js";
+import {
+  getAnalysisQueueStatus,
+  startPendingAIAnalysisWorker,
+} from "../modules/ai-moderation/aiAnalyzer.js";
+import { workerPool } from "../modules/ai-moderation/circuitBreaker.js";
 import { registerChannelTopicCapture } from "../modules/channel-topic/index.js";
 import { CommandHandler } from "../modules/command-handler/commandHandler.js";
 import {
@@ -11,6 +15,8 @@ import {
   RedisEventPublisher,
 } from "../modules/event-broadcaster/index.js";
 import {
+  registerCollector,
+  setGauge,
   startMetricsServer,
   stopMetricsServer,
 } from "../modules/gateway-metrics/index.js";
@@ -222,7 +228,10 @@ export async function initializeDiscordGateway() {
     await initializeDatabase();
     logger.info("PostgreSQL database initialized");
   } catch (err) {
-    logger.error({ error: err }, "Failed to initialize database");
+    logger.error(
+      { err, errorMsg: err instanceof Error ? err.message : String(err) },
+      "Failed to initialize database",
+    );
     throw new DatabaseError(
       `Database initialization failed: ${err instanceof Error ? err.message : String(err)}`,
     );
@@ -267,7 +276,10 @@ export async function initializeDiscordGateway() {
   });
 
   client.on("error", (err) => {
-    logger.error({ error: err }, "Client error");
+    logger.error(
+      { err, errorMsg: err instanceof Error ? err.message : String(err) },
+      "Client error",
+    );
   });
 
   process.on("SIGINT", () => {
@@ -279,15 +291,97 @@ export async function initializeDiscordGateway() {
   });
 
   process.on("uncaughtException", (err) => {
-    logger.error({ error: err }, "Uncaught exception");
+    const code =
+      typeof (err as NodeJS.ErrnoException).code === "string"
+        ? (err as NodeJS.ErrnoException).code
+        : "";
+    // Transient stream-teardown errors (voice stop/disconnect races, child
+    // process stdin closed while we still write) are NOT fatal — crashing the
+    // gateway on EPIPE takes the whole bot offline mid-music. Log + continue.
+    if (
+      code === "EPIPE" ||
+      code === "ERR_STREAM_DESTROYED" ||
+      code === "ERR_STREAM_WRITE_AFTER_END" ||
+      code === "ECONNRESET"
+    ) {
+      logger.warn(
+        { error: err },
+        "Uncaught transient stream error — continuing",
+      );
+      return;
+    }
+    logger.error(
+      {
+        err,
+        errorMsg: err instanceof Error ? err.message : String(err),
+        stack: err?.stack,
+      },
+      "Uncaught exception",
+    );
     gracefulShutdown("uncaughtException");
   });
 
-  process.on("unhandledRejection", (reason, promise) => {
-    logger.error({ reason, promise }, "Unhandled rejection");
+  process.on("unhandledRejection", (reason) => {
+    const err =
+      reason instanceof Error ? reason : new Error(String(reason ?? "unknown"));
+    const code = (err as NodeJS.ErrnoException).code ?? "";
+    // Same transient-teardown policy as uncaughtException: a rejection that
+    // fires while a stream is being torn down (EPIPE after ffmpeg stdin
+    // closes, write-after-destroy, socket reset) must NOT take the whole
+    // gateway offline. Log detail + continue. Everything else still shuts
+    // down so real bugs surface.
+    if (
+      code === "EPIPE" ||
+      code === "ERR_STREAM_DESTROYED" ||
+      code === "ERR_STREAM_WRITE_AFTER_END" ||
+      code === "ECONNRESET"
+    ) {
+      logger.warn(
+        { error: err },
+        "Unhandled rejection transient stream error — continuing",
+      );
+      return;
+    }
+    logger.error({ error: err, reason: String(reason) }, "Unhandled rejection");
     gracefulShutdown("unhandledRejection");
   });
 
+  // ── Metrics: register live pipeline collectors before starting server ──
+  // These refresh on every scrape so Prometheus sees real AI-analysis
+  // queue depth, concurrency, and DB pool state instead of an empty stub.
+  registerCollector(() => {
+    if (!config.AI_ANALYSIS_ENABLED) return;
+    try {
+      const status = getAnalysisQueueStatus();
+      setGauge("ai_analysis_queued_conversations", status.queuedConversations);
+      setGauge("ai_analysis_active_batch_requests", status.activeRequests);
+      setGauge(
+        "ai_analysis_active_individual_requests",
+        status.activeIndividualRequests,
+      );
+      setGauge(
+        "ai_analysis_individual_in_flight",
+        status.individualInFlightCount,
+      );
+      setGauge(
+        "ai_analysis_individual_circuit_breaker_active",
+        status.individualCircuitBreakerActive ? 1 : 0,
+      );
+      if (typeof status.lastError === "string") {
+        setGauge("ai_analysis_last_error_present", status.lastError ? 1 : 0);
+      }
+      const pool = workerPool as unknown as {
+        _poolState?: { size: number; active: number };
+      };
+      if (pool._poolState) {
+        setGauge("ai_analysis_worker_threads", pool._poolState.size);
+        setGauge("ai_analysis_worker_threads_active", pool._poolState.active);
+      }
+    } catch (err) {
+      logger.warn({ error: String(err) }, "AI metrics collector failed");
+    }
+  });
+
   // Start metrics server
   startMetricsServer();
 

services/discord-gateway/src/goLive/AnnexBBitstreamReaderWriter.ts

@@ -1,155 +0,0 @@
-/**
- * AnnexB bitstream reader/writer (RBSP + emulation prevention) — ported
- * from @dank074/discord-video-stream AnnexBBitstreamReaderWriter.js.
- */
-
-export class AnnexBBitstreamReader {
-  private _buffer: Uint8Array;
-  private _byteOffset = 0;
-  private _bitOffset = 0;
-
-  constructor(buffer: Uint8Array) {
-    this._buffer = buffer;
-  }
-
-  readBits(count: number): number {
-    if (count === 0) return 0;
-    let result = 0;
-    while (count > 0) {
-      if (this._byteOffset >= this._buffer.length) {
-        throw new Error("Bad byte offset");
-      }
-      if (
-        this._bitOffset === 0 &&
-        this._byteOffset >= 2 &&
-        this._buffer[this._byteOffset - 2] === 0 &&
-        this._buffer[this._byteOffset - 1] === 0 &&
-        this._buffer[this._byteOffset] === 3
-      ) {
-        // Skip over emulation prevention
-        this._byteOffset++;
-      }
-      if (this._bitOffset === 0 && count >= 8) {
-        result = (result << 8) | this._buffer[this._byteOffset++];
-        count -= 8;
-      } else {
-        const numBitsToRead = Math.min(count, 8 - this._bitOffset);
-        const mask = (1 << numBitsToRead) - 1;
-        const newBits =
-          (this._buffer[this._byteOffset] >>
-            (8 - this._bitOffset - numBitsToRead)) &
-          mask;
-        result = (result << numBitsToRead) | newBits;
-        count -= numBitsToRead;
-        this._bitOffset += numBitsToRead;
-        if (this._bitOffset === 8) {
-          this._bitOffset = 0;
-          this._byteOffset++;
-        }
-      }
-    }
-    return result;
-  }
-
-  readUnsigned(bits: number): number {
-    return this.readBits(bits);
-  }
-
-  readSigned(bits: number): number {
-    const unsigned = this.readUnsigned(bits);
-    if (unsigned & (1 << (bits - 1))) return unsigned - (1 << bits);
-    return unsigned;
-  }
-
-  readUnsignedExpGolomb(): number {
-    let leading0 = 0;
-    while (this.readBits(1) === 0) leading0++;
-    return (1 << leading0) + this.readBits(leading0) - 1;
-  }
-
-  readSignedExpGolomb(): number {
-    const unsigned = this.readUnsignedExpGolomb();
-    if (unsigned % 2 === 0) return unsigned / -2;
-    return (unsigned + 1) / 2;
-  }
-}
-
-export class AnnexBBitstreamWriter {
-  private _arr: number[] = [];
-  private _pendingByte = 0;
-  private _bitOffset = 0;
-
-  toBuffer(): Buffer {
-    return Buffer.from(this._arr);
-  }
-
-  flush(): void {
-    // Emulation prevention: insert 0x03 before 00 00
-    if (
-      this._pendingByte <= 3 &&
-      this._arr[this._arr.length - 1] === 0 &&
-      this._arr[this._arr.length - 2] === 0
-    ) {
-      this._arr.push(3);
-    }
-    this._arr.push(this._pendingByte);
-    this._pendingByte = 0;
-    this._bitOffset = 0;
-  }
-
-  writeBits(bits: number, count: number): void {
-    while (count > 0) {
-      if (this._bitOffset === 0) {
-        if (count >= 8) {
-          this._pendingByte = (bits >> (count - 8)) & 0xff;
-          count -= 8;
-          this.flush();
-        } else {
-          const mask = (1 << count) - 1;
-          this._pendingByte |= (bits & mask) << (8 - count);
-          this._bitOffset = count;
-          count = 0;
-        }
-      } else {
-        const numBitsToWrite = Math.min(8 - this._bitOffset, count);
-        const bitsToWrite =
-          (bits >> (count - numBitsToWrite)) & ((1 << numBitsToWrite) - 1);
-        this._pendingByte |=
-          bitsToWrite << (8 - this._bitOffset - numBitsToWrite);
-        count -= numBitsToWrite;
-        this._bitOffset += numBitsToWrite;
-        if (this._bitOffset === 8) {
-          this._bitOffset = 0;
-          this.flush();
-        }
-      }
-    }
-  }
-
-  writeUnsigned(num: number, count: number): void {
-    if (num < 0) throw new Error("Expected a non-negative number");
-    this.writeBits(num, count);
-  }
-
-  writeSigned(num: number, count: number): void {
-    if (count <= 0) return;
-    if (count > 32) throw new Error("writeSigned supports up to 32 bits");
-    const mask =
-      count === 32 ? 0xffffffff >>> 0 : (((1 << count) >>> 0) - 1) >>> 0;
-    const unsigned = (num & mask) >>> 0;
-    this.writeBits(unsigned, count);
-  }
-
-  writeUnsignedExpGolomb(num: number): void {
-    if (num < 0) throw new Error("Expected a non-negative number");
-    num++;
-    const bitCount = 32 - Math.clz32(num >>> 0);
-    this.writeBits(0, bitCount - 1);
-    this.writeBits(num, bitCount);
-  }
-
-  writeSignedExpGolomb(num: number): void {
-    if (num < 0) this.writeUnsignedExpGolomb(-2 * num);
-    else this.writeUnsignedExpGolomb(2 * num - 1);
-  }
-}

services/discord-gateway/src/goLive/AnnexBHelper.ts

@@ -1,112 +0,0 @@
-/**
- * H264/H265 NAL helpers — ported from @dank074/discord-video-stream
- * AnnexBHelper.js. Only the H264 parts are used by GoLive (H264 encoder),
- * H265 constants kept for completeness of the port.
- */
-
-export enum H264NalUnitTypes {
-  Unspecified = 0,
-  CodedSliceNonIDR = 1,
-  CodedSlicePartitionA = 2,
-  CodedSlicePartitionB = 3,
-  CodedSlicePartitionC = 4,
-  CodedSliceIdr = 5,
-  SEI = 6,
-  SPS = 7,
-  PPS = 8,
-  AccessUnitDelimiter = 9,
-  EndOfSequence = 10,
-  EndOfStream = 11,
-  FillerData = 12,
-  SEIExtenstion = 13,
-  PrefixNalUnit = 14,
-  SubsetSPS = 15,
-}
-
-export enum H265NalUnitTypes {
-  TRAIL_N = 0,
-  TRAIL_R = 1,
-  TSA_N = 2,
-  TSA_R = 3,
-  STSA_N = 4,
-  STSA_R = 5,
-  RADL_N = 6,
-  RADL_R = 7,
-  RASL_N = 8,
-  RASL_R = 9,
-  RSV_VCL_N10 = 10,
-  RSV_VCL_R11 = 11,
-  RSV_VCL_N12 = 12,
-  RSV_VCL_R13 = 13,
-  RSV_VCL_N14 = 14,
-  RSV_VCL_R15 = 15,
-  BLA_W_LP = 16,
-  BLA_W_RADL = 17,
-  BLA_N_LP = 18,
-  IDR_W_RADL = 19,
-  IDR_N_LP = 20,
-  CRA_NUT = 21,
-  RSV_IRAP_VCL22 = 22,
-  RSV_IRAP_VCL23 = 23,
-  RSV_VCL24 = 24,
-  RSV_VCL25 = 25,
-  RSV_VCL26 = 26,
-  RSV_VCL27 = 27,
-  RSV_VCL28 = 28,
-  RSV_VCL29 = 29,
-  RSV_VCL30 = 30,
-  RSV_VCL31 = 31,
-  VPS_NUT = 32,
-  SPS_NUT = 33,
-  PPS_NUT = 34,
-  AUD_NUT = 35,
-  EOS_NUT = 36,
-  EOB_NUT = 37,
-  FD_NUT = 38,
-  PREFIX_SEI_NUT = 39,
-  SUFFIX_SEI_NUT = 40,
-}
-
-export const H264Helpers = {
-  getUnitType(frame: Uint8Array): number {
-    return frame[0] & 0x1f;
-  },
-  splitHeader(frame: Uint8Array): [Uint8Array, Uint8Array] {
-    return [frame.subarray(0, 1), frame.subarray(1)];
-  },
-  isAUD(unitType: number): boolean {
-    return unitType === H264NalUnitTypes.AccessUnitDelimiter;
-  },
-};
-
-export const H265Helpers = {
-  getUnitType(frame: Uint8Array): number {
-    return (frame[0] >> 1) & 0x3f;
-  },
-  splitHeader(frame: Uint8Array): [Uint8Array, Uint8Array] {
-    return [frame.subarray(0, 2), frame.subarray(2)];
-  },
-  isAUD(unitType: number): boolean {
-    return unitType === H265NalUnitTypes.AUD_NUT;
-  },
-};
-
-export const startCode3 = Buffer.from([0, 0, 1]);
-
-/** Split an AnnexB bitstream into NAL units (start codes stripped). */
-export function splitNalu(buf: Buffer): Buffer[] {
-  let temp: Buffer | null = buf;
-  const nalus: Buffer[] = [];
-  while (temp?.byteLength) {
-    let pos: number = temp.indexOf(startCode3);
-    let length = 3;
-    if (pos > 0 && temp[pos - 1] === 0) {
-      pos--;
-      length++;
-    }
-    const nalu = pos === -1 ? temp : temp.subarray(0, pos);
-    temp = pos === -1 ? null : temp.subarray(pos + length);
-    if (nalu.byteLength) nalus.push(nalu);
-  }
-  return nalus;
-}

services/discord-gateway/src/goLive/AudioStream.ts

@@ -1,20 +0,0 @@
-/**
- * AudioStream — feeds encoded opus frames into the WebRTC connection.
- * Ported from @dank074/discord-video-stream AudioStream.js.
- */
-
-import { BaseMediaStream } from "./BaseMediaStream.js";
-import type { WebRtcConnWrapper } from "./WebRtcWrapper.js";
-
-export class AudioStream extends BaseMediaStream {
-  _conn: WebRtcConnWrapper;
-
-  constructor(conn: WebRtcConnWrapper, noSleep = false) {
-    super("audio", noSleep);
-    this._conn = conn;
-  }
-
-  async _sendFrame(frame: Buffer, frametime: number): Promise<void> {
-    this._conn.sendAudioFrame(frame, frametime);
-  }
-}

services/discord-gateway/src/goLive/BaseMediaConnection.ts

@@ -1,594 +0,0 @@
-/**
- * Base media connection for Discord GoLive — ported from
- * @dank074/discord-video-stream BaseMediaConnection.js.
- *
- * Owns the voice WebSocket (identify/select_protocol/heartbeat/resume),
- * SDP negotiation against Discord's media server, DAVE E2E voice
- * (via @snazzah/davey), and speaking/video attribute signaling.
- */
-
-import { randomUUID } from "node:crypto";
-import { EventEmitter } from "node:events";
-import Davey from "@snazzah/davey";
-import { CodecPayloadType } from "./CodecPayloadType.js";
-import type { NativePeerConnection } from "./native.js";
-import { isNativeAvailable } from "./native.js";
-import { STREAMS_SIMULCAST } from "./utils.js";
-import { VoiceOpCodes, VoiceOpCodesBinary } from "./VoiceOpCodes.js";
-import { WebRtcConnWrapper } from "./WebRtcWrapper.js";
-
-export interface MediaConnectionStatus {
-  hasSession: boolean;
-  hasToken: boolean;
-  started: boolean;
-  resuming: boolean;
-}
-
-export interface VideoAttribute {
-  fps: number;
-  width: number;
-  height: number;
-}
-
-export interface StreamerLike {
-  opts: Record<string, unknown>;
-}
-
-export class BaseMediaConnection extends EventEmitter {
-  interval: ReturnType<typeof setInterval> | null = null;
-  guildId: string | null = null;
-  channelId: string;
-  botId: string;
-  ws: WebSocket | null = null;
-  status: MediaConnectionStatus;
-  server: string | null = null; // websocket url
-  token: string | null = null;
-  session_id: string | null = null;
-  protected _webRtcWrapper: WebRtcConnWrapper;
-  _webRtcParams: {
-    address: string;
-    port: number;
-    audioSsrc: number;
-    videoSsrc: number;
-    rtxSsrc: number;
-    supportedEncryptionModes: string[];
-  } | null = null;
-  protected _closed = false;
-  ready: ((conn: WebRtcConnWrapper) => void) | null;
-  protected _streamer: StreamerLike;
-  protected _sequenceNumber = -1;
-  protected _daveSession: Davey.DAVESession | null = null;
-  protected _connectedUsers = new Set<string>();
-  protected _daveProtocolVersion = 0;
-  protected _davePendingTransitions = new Map<number, number>();
-  protected _daveDowngraded = false;
-
-  constructor(
-    streamer: StreamerLike,
-    guildId: string | null,
-    botId: string,
-    channelId: string,
-    callback: ((conn: WebRtcConnWrapper) => void) | null,
-  ) {
-    super();
-    this._streamer = streamer;
-    this.status = {
-      hasSession: false,
-      hasToken: false,
-      started: false,
-      resuming: false,
-    };
-    this.guildId = guildId;
-    this.channelId = channelId;
-    this.botId = botId;
-    this.ready = callback;
-    this._webRtcWrapper = new WebRtcConnWrapper(this);
-  }
-
-  get type(): "guild" | "call" {
-    return this.guildId ? "guild" : "call";
-  }
-
-  get webRtcConn(): WebRtcConnWrapper {
-    return this._webRtcWrapper;
-  }
-
-  get webRtcParams(): BaseMediaConnection["_webRtcParams"] {
-    return this._webRtcParams;
-  }
-
-  get streamer(): StreamerLike {
-    return this._streamer;
-  }
-
-  /** daveChannelId — overridden in VoiceConnection (channelId) and StreamConnection (serverId - 1n). */
-  get daveChannelId(): string {
-    throw new Error("daveChannelId not implemented");
-  }
-
-  stop(): void {
-    this._closed = true;
-    this._webRtcWrapper.close();
-    this.ws?.close();
-  }
-
-  setSession(session_id: string): void {
-    this.session_id = session_id;
-    this.status.hasSession = true;
-    this.start();
-  }
-
-  setTokens(server: string, token: string): void {
-    this.token = token;
-    this.server = server;
-    this.status.hasToken = true;
-    this.start();
-  }
-
-  start(): void {
-    if (this.status.hasSession && this.status.hasToken) {
-      if (this.status.started) return;
-      this.status.started = true;
-      this.ws = new WebSocket(`wss://${this.server}/?v=8`);
-      this.ws.binaryType = "arraybuffer";
-      this.ws.addEventListener("open", () => {
-        if (this.status.resuming) {
-          this.status.resuming = false;
-          this.resume();
-        } else {
-          this.identify();
-        }
-      });
-      this.ws.addEventListener("error", (err) => {
-        console.error(err);
-      });
-      this.ws.addEventListener("close", (e) => {
-        const wasStarted = this.status.started;
-        this.interval && clearInterval(this.interval);
-        this.status.started = false;
-        const canResume = e.code === 4015 || e.code < 4000;
-        if (canResume && wasStarted) {
-          this.status.resuming = true;
-          this.start();
-        } else {
-          this._closed = true;
-          this._webRtcWrapper?.close();
-        }
-      });
-      this.setupEvents();
-    }
-  }
-
-  handleReady(d: {
-    ip: string;
-    port: number;
-    ssrc: number;
-    streams: { ssrc: number; rtx_ssrc: number }[];
-    modes: string[];
-  }): void {
-    // we hardcoded STREAMS_SIMULCAST, which will always be array of 1
-    const stream = d.streams[0];
-    this._webRtcParams = {
-      address: d.ip,
-      port: d.port,
-      audioSsrc: d.ssrc,
-      videoSsrc: stream.ssrc,
-      rtxSsrc: stream.rtx_ssrc,
-      supportedEncryptionModes: d.modes,
-    };
-  }
-
-  async handleProtocolAck(d: {
-    sdp?: string;
-    dave_protocol_version?: number;
-  }): Promise<void> {
-    if (!("sdp" in d)) throw new Error("Only WebRTC connections are allowed");
-    this._daveProtocolVersion = d.dave_protocol_version ?? 0;
-    this.initDave();
-    // Discord's SDP is garbage — generate our own from its pieces
-    let ip = "";
-    let port = "";
-    let iceUsername = "";
-    let icePassword = "";
-    let fingerprint = "";
-    let candidate = "";
-    for (const line of (d.sdp ?? "").split("\n")) {
-      if (line.startsWith("c=")) ip = line;
-      else if (line.startsWith("a=rtcp")) port = line.split(":")[1];
-      else if (line.startsWith("a=ice-ufrag")) iceUsername = line;
-      else if (line.startsWith("a=ice-pwd")) icePassword = line;
-      else if (line.startsWith("a=fingerprint")) fingerprint = line;
-      else if (line.startsWith("a=candidate")) candidate = line;
-    }
-    const audioPayloadType = CodecPayloadType.opus.payload_type;
-    const audioSection = `
-m=audio ${port} UDP/TLS/RTP/SAVPF ${audioPayloadType}
-${ip}
-a=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level
-a=extmap:3 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01
-a=setup:passive
-a=mid:0
-a=maxptime:60
-a=inactive
-${iceUsername}
-${icePassword}
-${fingerprint}
-${candidate}
-a=rtcp-mux
-a=rtpmap:${audioPayloadType} opus/48000/2
-a=fmtp:${audioPayloadType} minptime=10;useinbandfec=1;usedtx=1
-a=rtcp-fb:${audioPayloadType} transport-cc
-a=rtcp-fb:${audioPayloadType} nack
-a=ice-lite
-`.trim();
-    const videoPayloads = Object.values(CodecPayloadType).filter(
-      (el) => el.type === "video",
-    );
-    const videoPayloadTypes = videoPayloads.flatMap((el) => [
-      el.payload_type,
-      el.rtx_payload_type ?? 0,
-    ]);
-    const videoSection = `
-m=video ${port} UDP/TLS/RTP/SAVPF ${videoPayloadTypes.join(" ")}
-${ip}
-a=extmap:2 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time
-a=extmap:3 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01
-a=extmap:14 urn:ietf:params:rtp-hdrext:toffset
-a=extmap:13 urn:3gpp:video-orientation
-a=extmap:5 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay
-a=setup:passive
-a=mid:1
-a=inactive
-${iceUsername}
-${icePassword}
-${fingerprint}
-${candidate}
-a=rtcp-mux
-a=ice-lite
-`.trim();
-    const videoRtpMap = videoPayloads
-      .flatMap((el) => [
-        `a=rtpmap:${el.payload_type} ${el.name}/90000`,
-        `a=rtpmap:${el.rtx_payload_type} rtx/90000`,
-        `a=fmtp:${el.rtx_payload_type} apt=${el.payload_type}`,
-        `a=rtcp-fb:${el.payload_type} ccm fir`,
-        `a=rtcp-fb:${el.payload_type} nack`,
-        `a=rtcp-fb:${el.payload_type} nack pli`,
-        `a=rtcp-fb:${el.payload_type} goog-remb`,
-        `a=rtcp-fb:${el.payload_type} transport-cc`,
-      ])
-      .join("\n");
-    this._webRtcWrapper.webRtcConn?.setRemoteDescription(
-      [audioSection, videoSection, videoRtpMap].join("\n"),
-      "answer",
-    );
-    this.emit("select_protocol_ack");
-  }
-
-  initDave(): void {
-    if (this._daveProtocolVersion) {
-      if (this._daveSession) {
-        this._daveSession.reinit(
-          this._daveProtocolVersion,
-          this.botId,
-          this.daveChannelId,
-        );
-      } else {
-        this._daveSession = new Davey.DAVESession(
-          this._daveProtocolVersion,
-          this.botId,
-          this.daveChannelId,
-        );
-      }
-      this.sendOpcodeBinary(
-        VoiceOpCodesBinary.MLS_KEY_PACKAGE,
-        this._daveSession.getSerializedKeyPackage(),
-      );
-    } else if (this._daveSession) {
-      this._daveSession.reset();
-      this._daveSession.setPassthroughMode(true, 10);
-    }
-  }
-
-  processInvalidCommit(transitionId: number): void {
-    this.sendOpcode(VoiceOpCodes.MLS_INVALID_COMMIT_WELCOME, {
-      transition_id: transitionId,
-    });
-    this.initDave();
-  }
-
-  executePendingTransition(transitionId: number): void {
-    const newVersion = this._davePendingTransitions.get(transitionId);
-    if (newVersion === undefined) {
-      console.error("Unrecognized transition ID", { transitionId });
-      return;
-    }
-    const oldVersion = this._daveProtocolVersion;
-    this._daveProtocolVersion = newVersion;
-    if (oldVersion !== newVersion && newVersion === 0) {
-      // Downgraded
-      this._daveDowngraded = true;
-    } else if (transitionId > 0 && this._daveDowngraded) {
-      this._daveDowngraded = false;
-      this._daveSession?.setPassthroughMode(true, 10);
-    }
-    this._davePendingTransitions.delete(transitionId);
-  }
-
-  setupEvents(): void {
-    this.ws?.addEventListener("message", async (e) => {
-      if (e.data instanceof ArrayBuffer) {
-        this.handleBinaryMessages(Buffer.from(e.data));
-        return;
-      }
-      const { op, d, seq } = JSON.parse(e.data as string) as {
-        op: number;
-        // biome-ignore lint/suspicious/noExplicitAny: Discord voice WS payload is dynamically typed
-        d: any;
-        seq?: number;
-      };
-      if (seq) this._sequenceNumber = seq;
-      if (op === VoiceOpCodes.READY) {
-        this.handleReady(d);
-        this.setProtocols().then(() => this.ready?.(this._webRtcWrapper));
-        this.setVideoAttributes(false);
-      } else if (op >= 4000) {
-        console.error(`${this.constructor.name} connection error`, d);
-      } else if (op === VoiceOpCodes.HELLO) {
-        this.setupHeartbeat(d.heartbeat_interval);
-      } else if (op === VoiceOpCodes.SELECT_PROTOCOL_ACK) {
-        await this.handleProtocolAck(d);
-      } else if (op === VoiceOpCodes.SPEAKING) {
-        // ignore speaking updates
-      } else if (op === VoiceOpCodes.HEARTBEAT_ACK) {
-        // ignore heartbeat acknowledgements
-      } else if (op === VoiceOpCodes.RESUMED) {
-        this.status.started = true;
-      } else if (op === VoiceOpCodes.CLIENTS_CONNECT) {
-        d.user_ids.forEach((id: string) => {
-          this._connectedUsers.add(id);
-        });
-      } else if (op === VoiceOpCodes.CLIENT_DISCONNECT) {
-        this._connectedUsers.delete(d.user_id);
-      } else if (op === VoiceOpCodes.DAVE_PREPARE_TRANSITION) {
-        this._davePendingTransitions.set(d.transition_id, d.protocol_version);
-        if (d.transition_id === 0) {
-          this.executePendingTransition(d.transition_id);
-        } else {
-          if (d.protocol_version === 0) {
-            this._daveSession?.setPassthroughMode(true, 120);
-          }
-          this.sendOpcode(VoiceOpCodes.DAVE_TRANSITION_READY, {
-            transition_id: d.transition_id,
-          });
-        }
-      } else if (op === VoiceOpCodes.DAVE_EXECUTE_TRANSITION) {
-        this.executePendingTransition(d.transition_id);
-      } else if (op === VoiceOpCodes.DAVE_PREPARE_EPOCH) {
-        if (d.epoch === 1) {
-          this._daveProtocolVersion = d.protocol_version;
-          this.initDave();
-        }
-      }
-    });
-  }
-
-  handleBinaryMessages(msg: Buffer): void {
-    this._sequenceNumber = msg.readUint16BE(0);
-    const op = msg.readUint8(2);
-    switch (op) {
-      case VoiceOpCodesBinary.MLS_EXTERNAL_SENDER: {
-        this._daveSession?.setExternalSender(msg.subarray(3));
-        break;
-      }
-      case VoiceOpCodesBinary.MLS_PROPOSALS: {
-        const optype = msg.readUint8(3);
-        if (!this._daveSession) break;
-        const { commit, welcome } = this._daveSession.processProposals(
-          optype,
-          msg.subarray(4),
-          [...this._connectedUsers],
-        );
-        if (commit) {
-          this.sendOpcodeBinary(
-            VoiceOpCodesBinary.MLS_COMMIT_WELCOME,
-            welcome ? Buffer.concat([commit, welcome]) : commit,
-          );
-        }
-        break;
-      }
-      case VoiceOpCodesBinary.MLS_ANNOUNCE_COMMIT_TRANSITION: {
-        const transitionId = msg.readUInt16BE(3);
-        try {
-          this._daveSession?.processCommit(msg.subarray(5));
-          if (transitionId) {
-            this._davePendingTransitions.set(
-              transitionId,
-              this._daveProtocolVersion,
-            );
-            this.sendOpcode(VoiceOpCodes.DAVE_TRANSITION_READY, {
-              transition_id: transitionId,
-            });
-          }
-        } catch (e) {
-          console.debug("MLS commit errored", e);
-          this.processInvalidCommit(transitionId);
-        }
-        break;
-      }
-      case VoiceOpCodesBinary.MLS_WELCOME: {
-        const transitionId = msg.readUInt16BE(3);
-        try {
-          this._daveSession?.processWelcome(msg.subarray(5));
-          if (transitionId) {
-            this._davePendingTransitions.set(
-              transitionId,
-              this._daveProtocolVersion,
-            );
-            this.sendOpcode(VoiceOpCodes.DAVE_TRANSITION_READY, {
-              transition_id: transitionId,
-            });
-          }
-        } catch (e) {
-          console.debug("MLS welcome errored", e);
-          this.processInvalidCommit(transitionId);
-        }
-        break;
-      }
-    }
-  }
-
-  get daveReady(): boolean {
-    return !!this._daveProtocolVersion && !!this._daveSession?.ready;
-  }
-
-  get daveSession(): Davey.DAVESession | null {
-    return this._daveSession;
-  }
-
-  setupHeartbeat(interval: number): void {
-    if (this.interval) {
-      clearInterval(this.interval);
-    }
-    this.interval = setInterval(() => {
-      try {
-        this.sendOpcode(VoiceOpCodes.HEARTBEAT, {
-          t: Date.now(),
-          seq_ack: this._sequenceNumber,
-        });
-      } catch {
-        /* ignore */
-      }
-    }, interval);
-  }
-
-  sendOpcode(code: number, data: unknown): void {
-    if (this.ws?.readyState !== WebSocket.OPEN) return;
-    this.ws.send(JSON.stringify({ op: code, d: data }));
-  }
-
-  sendOpcodeBinary(code: number, data: Uint8Array): void {
-    if (this.ws?.readyState !== WebSocket.OPEN) return;
-    const buf = Buffer.allocUnsafe(data.length + 1);
-    buf.writeUInt8(code);
-    Buffer.from(data).copy(buf, 1);
-    this.ws.send(buf);
-  }
-
-  /** serverId — overridden in VoiceConnection (guildId ?? channelId) and StreamConnection (rtc_server_id). */
-  get serverId(): string | null {
-    throw new Error("serverId not implemented");
-  }
-
-  /** identifies with media server with credentials */
-  identify(): void {
-    if (!this.serverId) throw new Error("Server ID is null or empty");
-    if (!this.session_id) throw new Error("Session ID is null or empty");
-    if (!this.token) throw new Error("Token is null or empty");
-    this.sendOpcode(VoiceOpCodes.IDENTIFY, {
-      server_id: this.serverId,
-      user_id: this.botId,
-      session_id: this.session_id,
-      token: this.token,
-      video: true,
-      streams: STREAMS_SIMULCAST,
-      max_dave_protocol_version: Davey.DAVE_PROTOCOL_VERSION ?? 0,
-    });
-  }
-
-  resume(): void {
-    if (!this.serverId) throw new Error("Server ID is null or empty");
-    if (!this.session_id) throw new Error("Session ID is null or empty");
-    if (!this.token) throw new Error("Token is null or empty");
-    this.sendOpcode(VoiceOpCodes.RESUME, {
-      server_id: this.serverId,
-      session_id: this.session_id,
-      token: this.token,
-      seq_ack: this._sequenceNumber,
-    });
-  }
-
-  /** Sets protocols and ip data used for video and audio (vp8 video, opus audio). */
-  async setProtocols(): Promise<void> {
-    if (!this._webRtcParams) throw new Error("WebRTC parameters not set");
-    if (!isNativeAvailable()) {
-      throw new Error(
-        "libdatachannel-min native binding not built — cannot start GoLive",
-      );
-    }
-    const reconnect = () => {
-      const webRtcConn = this._webRtcWrapper.initWebRtc();
-      webRtcConn.onStateChange((state) => {
-        if (state === "closed" && !this._closed) reconnect();
-      });
-      this._webRtcWrapper.onLocalDescription = (sdp) => {
-        const rtc_connection_id = randomUUID();
-        this.sendOpcode(VoiceOpCodes.SELECT_PROTOCOL, {
-          protocol: "webrtc",
-          codecs: Object.values(CodecPayloadType),
-          data: sdp,
-          sdp,
-          rtc_connection_id,
-        });
-      };
-      // createOffer (binding resolves full SDP incl. candidates after gathering)
-      void webRtcConn.createOffer().then((sdp) => {
-        this._webRtcWrapper.onLocalDescription?.(sdp);
-      });
-    };
-    reconnect();
-    return new Promise((resolve) => {
-      this.once("select_protocol_ack", () => resolve());
-    });
-  }
-
-  setVideoAttributes(enabled: boolean, attr?: VideoAttribute): void {
-    if (!this._webRtcParams) throw new Error("WebRTC parameters not set");
-    const { audioSsrc, videoSsrc, rtxSsrc } = this._webRtcParams;
-    if (!enabled) {
-      this.sendOpcode(VoiceOpCodes.VIDEO, {
-        audio_ssrc: audioSsrc,
-        video_ssrc: 0,
-        rtx_ssrc: 0,
-        streams: [],
-      });
-    } else {
-      if (!attr) throw new Error("Need to specify video attributes");
-      this.sendOpcode(VoiceOpCodes.VIDEO, {
-        audio_ssrc: audioSsrc,
-        video_ssrc: videoSsrc,
-        rtx_ssrc: rtxSsrc,
-        streams: [
-          {
-            type: "video",
-            rid: "100",
-            ssrc: videoSsrc,
-            active: true,
-            quality: 100,
-            rtx_ssrc: rtxSsrc,
-            // hardcode the max bitrate because we don't really know anyway
-            max_bitrate: 10000 * 1000,
-            max_framerate: enabled ? attr.fps : 0,
-            max_resolution: {
-              type: "fixed",
-              width: attr.width,
-              height: attr.height,
-            },
-          },
-        ],
-      });
-    }
-  }
-
-  /** Set speaking status */
-  setSpeaking(speaking: boolean): void {
-    if (!this._webRtcParams) throw new Error("WebRTC connection not ready");
-    this.sendOpcode(VoiceOpCodes.SPEAKING, {
-      delay: 0,
-      speaking: speaking ? 1 : 0,
-      ssrc: this._webRtcParams.audioSsrc,
-    });
-  }
-}
-
-export type { NativePeerConnection };

services/discord-gateway/src/goLive/BaseMediaStream.ts

@@ -1,175 +0,0 @@
-/**
- * BaseMediaStream — pacing/sync for GoLive frames. Ported from
- * @dank074/discord-video-stream BaseMediaStream.js, minus node-av's
- * AVFrame (frames are plain objects here) and debug-level (uses the GMW
- * logger instead).
- */
-
-import { Writable } from "node:stream";
-import { setTimeout as sleep } from "node:timers/promises";
-
-export interface GoLiveFrame {
-  data: Buffer | null;
-  pts: number;
-  duration: number;
-  timeBase: { num: number; den: number };
-  free?: () => void;
-}
-
-export class BaseMediaStream extends Writable {
-  _pts: number | undefined;
-  _syncTolerance = 20;
-  _noSleep: boolean;
-  _startTime: number | undefined;
-  _startPts: number | undefined;
-  _sync = true;
-  _syncStream: BaseMediaStream | undefined;
-  _type: string;
-
-  constructor(type: string, noSleep = false) {
-    super({ objectMode: true, highWaterMark: 0 });
-    this._type = type;
-    this._noSleep = noSleep;
-  }
-
-  get sync(): boolean {
-    return this._sync;
-  }
-
-  set sync(val: boolean) {
-    this._sync = val;
-  }
-
-  get syncStream(): BaseMediaStream | undefined {
-    return this._syncStream;
-  }
-
-  set syncStream(stream: BaseMediaStream | undefined) {
-    if (stream !== undefined && this === stream.syncStream) {
-      throw new Error("Cannot sync 2 streams with eachother");
-    }
-    this._syncStream = stream;
-  }
-
-  get noSleep(): boolean {
-    return this._noSleep;
-  }
-
-  set noSleep(val: boolean) {
-    this._noSleep = val;
-    if (!val) this.resetTimingCompensation();
-  }
-
-  get pts(): number | undefined {
-    return this._pts;
-  }
-
-  get syncTolerance(): number {
-    return this._syncTolerance;
-  }
-
-  set syncTolerance(n: number) {
-    if (n < 0) return;
-    this._syncTolerance = n;
-  }
-
-  async _sendFrame(_frame: Buffer, _frametime: number): Promise<void> {
-    throw new Error("Not implemented");
-  }
-
-  ptsDelta(): number | undefined {
-    if (this.pts !== undefined && this.syncStream?.pts !== undefined) {
-      return this.pts - this.syncStream.pts;
-    }
-    return undefined;
-  }
-
-  isAhead(): boolean {
-    const delta = this.ptsDelta();
-    return (
-      this.syncStream?.writableEnded === false &&
-      delta !== undefined &&
-      delta > this.syncTolerance
-    );
-  }
-
-  isBehind(): boolean {
-    const delta = this.ptsDelta();
-    return (
-      this.syncStream?.writableEnded === false &&
-      delta !== undefined &&
-      delta < -this.syncTolerance
-    );
-  }
-
-  resetTimingCompensation(): void {
-    this._startTime = this._startPts = undefined;
-  }
-
-  async _write(
-    frame: GoLiveFrame,
-    _encoding: BufferEncoding,
-    callback: (error?: Error | null) => void,
-  ): Promise<void> {
-    const { data, pts, duration, timeBase } = frame;
-    if (!data) {
-      frame.free?.();
-      callback();
-      return;
-    }
-    const frametime = (Number(duration) / timeBase.den) * timeBase.num * 1000;
-    const start_sendFrame = performance.now();
-    await this._sendFrame(Buffer.from(data), frametime);
-    const end_sendFrame = performance.now();
-    this._pts = (Number(pts) / timeBase.den) * timeBase.num * 1000;
-    this.emit("pts", this._pts);
-    const sendTime = end_sendFrame - start_sendFrame;
-    const ratio = sendTime / frametime;
-    if (ratio > 1) {
-      // Frame takes longer to send than its frametime — warn once per 100
-      if (
-        this._lastWarnedRatio === undefined ||
-        ratio > this._lastWarnedRatio
-      ) {
-        this._lastWarnedRatio = ratio;
-      }
-    }
-    this._startTime ??= start_sendFrame;
-    this._startPts ??= this._pts;
-    const sleepMs = Math.max(
-      0,
-      this._pts -
-        this._startPts +
-        frametime -
-        (end_sendFrame - this._startTime),
-    );
-    if (this._noSleep || sleepMs === 0) {
-      callback(null);
-    } else if (this.sync && this.isBehind()) {
-      // Stream is behind — don't sleep for this frame
-      this.resetTimingCompensation();
-      callback(null);
-    } else if (this.sync && this.isAhead()) {
-      // Stream is ahead — wait until the sync stream catches up
-      do {
-        await sleep(frametime);
-      } while (this.sync && this.isAhead());
-      this.resetTimingCompensation();
-      callback(null);
-    } else {
-      await sleep(sleepMs);
-      callback(null);
-    }
-    frame.free?.();
-  }
-
-  _lastWarnedRatio: number | undefined;
-
-  _destroy(
-    error: Error | null,
-    callback: (error?: Error | null) => void,
-  ): void {
-    super._destroy(error, callback);
-    this.syncStream = undefined;
-  }
-}

services/discord-gateway/src/goLive/CodecPayloadType.ts

@@ -1,71 +0,0 @@
-/** Payload types for Discord GoLive media — ported from @dank074/discord-video-stream. */
-export interface CodecPayloadTypeEntry {
-  name: string;
-  type: "audio" | "video";
-  clockRate: number;
-  priority: number;
-  payload_type: number;
-  rtx_payload_type?: number;
-  encode?: boolean;
-  decode?: boolean;
-}
-
-export const CodecPayloadType: Record<string, CodecPayloadTypeEntry> = {
-  opus: {
-    name: "opus",
-    type: "audio",
-    clockRate: 48000,
-    priority: 1000,
-    payload_type: 120,
-  },
-  H264: {
-    name: "H264",
-    type: "video",
-    clockRate: 90000,
-    priority: 1000,
-    payload_type: 101,
-    rtx_payload_type: 102,
-    encode: true,
-    decode: true,
-  },
-  H265: {
-    name: "H265",
-    type: "video",
-    clockRate: 90000,
-    priority: 1000,
-    payload_type: 103,
-    rtx_payload_type: 104,
-    encode: true,
-    decode: true,
-  },
-  VP8: {
-    name: "VP8",
-    type: "video",
-    clockRate: 90000,
-    priority: 1000,
-    payload_type: 105,
-    rtx_payload_type: 106,
-    encode: true,
-    decode: true,
-  },
-  VP9: {
-    name: "VP9",
-    type: "video",
-    clockRate: 90000,
-    priority: 1000,
-    payload_type: 107,
-    rtx_payload_type: 108,
-    encode: true,
-    decode: true,
-  },
-  AV1: {
-    name: "AV1",
-    type: "video",
-    clockRate: 90000,
-    priority: 1000,
-    payload_type: 109,
-    rtx_payload_type: 110,
-    encode: true,
-    decode: true,
-  },
-};

services/discord-gateway/src/goLive/Demuxer.ts

@@ -1,377 +0,0 @@
-/**
- * Lightweight demuxer — replaces node-av's LibavDemuxer for GoLive.
- *
- * Spawns ffmpeg to remux input into H264 AnnexB on stdout (video only —
- * screen share doesn't need to mux audio into the demuxer; audio goes
- * separately). This replaces the 114MB node-av binary with a plain ffmpeg
- * spawn.
- *
- * Each video "frame" emitted is a complete NAL sequence terminated by a
- * keyframe boundary (IDR). Audio is not extracted here — for GoLive with
- * audio, the NUT mux + full demuxer would be needed; screen share audio is
- * handled via a separate ffmpeg instance (see getDirectScreenInput).
- */
-
-import { spawn } from "node:child_process";
-import { randomUUID } from "node:crypto";
-import { createWriteStream, existsSync, readdirSync } from "node:fs";
-import { tmpdir } from "node:os";
-import { join } from "node:path";
-import { PassThrough } from "node:stream";
-
-/**
- * Resolve ffmpeg/ffprobe binary. Prefers explicit env override, then PATH,
- * then a Nix-store ffmpeg-headless (the GMW flake provides it in the service
- * profile, but dev shells / tests may not have it on PATH).
- */
-function resolveBin(name: "ffmpeg"): string {
-  const override = process.env.FFMPEG_PATH;
-  if (override && existsSync(override)) return override;
-  // Nix store scan: <store>/<hash>-ffmpeg-headless-*/bin/<name>
-  const store = "/nix/store";
-  if (existsSync(store)) {
-    const entries = readdirSync(store);
-    for (const entry of entries) {
-      if (!entry.includes("ffmpeg-headless-")) continue;
-      const candidate = join(store, entry, "bin", name);
-      if (existsSync(candidate)) return candidate;
-    }
-  }
-  return name; // fall back to PATH
-}
-
-const FFMPEG = resolveBin("ffmpeg");
-
-export const AVCodecID = {
-  AV_CODEC_ID_H264: 27,
-  AV_CODEC_ID_HEVC: 173,
-  AV_CODEC_ID_VP8: 139,
-  AV_CODEC_ID_VP9: 167,
-  AV_CODEC_ID_AV1: 225,
-  AV_CODEC_ID_OPUS: 86019,
-} as const;
-export type AVCodecID = (typeof AVCodecID)[keyof typeof AVCodecID];
-
-export const AV_PKT_FLAG_KEY = 1;
-
-export interface Frame {
-  data: Buffer | null;
-  pts: number;
-  duration: number;
-  timeBase: { num: number; den: number };
-  flags: number;
-  streamIndex: number;
-  free(): void;
-}
-
-export interface DemuxedStream {
-  codec: number;
-  codecName: string;
-  width: number;
-  height: number;
-  framerate_num: number;
-  framerate_den: number;
-  sample_rate: number;
-  stream: PassThrough;
-}
-
-/**
- * Probe a media file for stream info using ffmpeg's stderr (the
- * ffmpeg-headless Nix package ships ffmpeg but not ffprobe). Returns
- * stream descriptors in the same shape ffprobe -show_streams would.
- */
-export async function probeStreams(
-  url: string,
-): Promise<Array<Record<string, unknown>>> {
-  return new Promise((resolve, reject) => {
-    const proc = spawn(FFMPEG, [
-      "-hide_banner",
-      "-loglevel",
-      "info",
-      "-i",
-      url,
-      "-f",
-      "null",
-      "-",
-    ]);
-    let stderr = "";
-    proc.stderr.on("data", (d: Buffer) => (stderr += d.toString()));
-    proc.on("close", () => {
-      // Parse "Stream #0:0: Video: h264 (High), yuv420p, 640x360, 30 fps"
-      const streams: Array<Record<string, unknown>> = [];
-      const re = /Stream #0:(\d+): (Video|Audio): ([^,]+)/g;
-      let m: RegExpExecArray | null;
-      // biome-ignore lint/suspicious/noAssignInExpressions: regex loop idiom
-      while ((m = re.exec(stderr)) !== null) {
-        const [full, idx, kind, codecRaw] = m;
-        void full;
-        const codecName = codecRaw.split(" ")[0].toLowerCase();
-        const stream: Record<string, unknown> = {
-          index: Number(idx),
-          codec_type: kind.toLowerCase(),
-          codec_name: codecName,
-          width: 0,
-          height: 0,
-          r_frame_rate: "0/1",
-          sample_rate: 0,
-        };
-        // dimensions: "640x360"
-        const dim = /(\d{2,5})x(\d{2,5})/.exec(stderr.slice(m.index));
-        if (dim) {
-          stream.width = Number(dim[1]);
-          stream.height = Number(dim[2]);
-        }
-        // fps: "30 fps" or "29.97 fps"
-        const fps = /(\d+(?:\.\d+)?) fps/.exec(stderr.slice(m.index));
-        if (fps) {
-          const v = Number(fps[1]);
-          stream.r_frame_rate = `${Math.round(v * 1000)}/1000`;
-        }
-        // sample rate for audio: "48000 Hz"
-        const sr = /(\d+) Hz/.exec(stderr.slice(m.index));
-        if (sr) stream.sample_rate = Number(sr[1]);
-        streams.push(stream);
-      }
-      resolve(streams);
-    });
-    proc.on("error", (err) => reject(err));
-  });
-}
-
-/**
- * Demux input (URL string or readable stream) into video frames on a
- * PassThrough. Uses ffmpeg -f h264 -c copy for video-only AnnexB output.
- * Returns stream info + the video pipe. Audio is not extracted (GoLive
- * screen share sends silence / uses Discord's mixed audio).
- */
-export async function demux(
-  input: string | PassThrough,
-  _opts: { format: string },
-): Promise<{
-  video: DemuxedStream | undefined;
-  audio: DemuxedStream | undefined;
-  close: () => void;
-}> {
-  const _label = randomUUID();
-  const vPipe = new PassThrough({ objectMode: true, highWaterMark: 128 });
-  const aPipe = new PassThrough({ objectMode: true, highWaterMark: 128 });
-
-  // For stream input, spool to a temp file first so ffprobe can inspect it
-  // (ffprobe needs a seekable file; pipes can't be re-read). The stream is
-  // fully consumed before ffmpeg starts — acceptable for screen-share
-  // sources which are already fully buffered by yt-dlp in practice.
-  let spoolPath: string | null = null;
-  const cleanupSpool = () => {
-    if (spoolPath) {
-      import("node:fs").then(({ unlink }) => unlink(spoolPath!, () => {}));
-      spoolPath = null;
-    }
-  };
-
-  let effectiveInput: string;
-  if (typeof input === "string") {
-    effectiveInput = input;
-  } else {
-    spoolPath = join(tmpdir(), `golive-demux-${_label}.h264`);
-    const ws = createWriteStream(spoolPath);
-    await new Promise<void>((resolve, reject) => {
-      input.pipe(ws);
-      input.on("error", reject);
-      ws.on("finish", resolve);
-      ws.on("error", reject);
-    });
-    effectiveInput = spoolPath;
-  }
-
-  // Probe for codec + dimensions
-  let streams: Array<Record<string, unknown>> = [];
-  try {
-    streams = await probeStreams(effectiveInput);
-  } catch (_e) {
-    // probe failed (e.g. raw h264 without container) — infer h264 default
-    streams = [];
-  }
-
-  const v = streams.find((s) => s.codec_type === "video");
-  const a = streams.find((s) => s.codec_type === "audio");
-  let vInfo: DemuxedStream | undefined;
-  let aInfo: DemuxedStream | undefined;
-
-  if (v) {
-    const codecName = (v.codec_name as string) ?? "h264";
-    const rFrame = (v.r_frame_rate as string) ?? "0/1";
-    const [num, den] = rFrame.split("/").map((n) => Number(n));
-    vInfo = {
-      codec:
-        AVCodecID[
-          (codecName.toUpperCase() as keyof typeof AVCodecID) ??
-            "AV_CODEC_ID_H264"
-        ] ?? AVCodecID.AV_CODEC_ID_H264,
-      codecName,
-      width: (v.width as number) ?? 0,
-      height: (v.height as number) ?? 0,
-      framerate_num: num ?? 0,
-      framerate_den: den ?? 1,
-      sample_rate: 0,
-      stream: vPipe,
-    };
-  } else {
-    // Probe failed (e.g. raw AnnexB h264 input) — still emit frames on the
-    // video pipe; playStream infers dimensions from the first frame.
-    vInfo = {
-      codec: AVCodecID.AV_CODEC_ID_H264,
-      codecName: "h264",
-      width: 0,
-      height: 0,
-      framerate_num: 0,
-      framerate_den: 1,
-      sample_rate: 0,
-      stream: vPipe,
-    };
-  }
-
-  if (a) {
-    const codecName = (a.codec_name as string) ?? "opus";
-    aInfo = {
-      codec:
-        AVCodecID[
-          (codecName.toUpperCase() as keyof typeof AVCodecID) ??
-            "AV_CODEC_ID_OPUS"
-        ],
-      codecName,
-      width: 0,
-      height: 0,
-      framerate_num: 0,
-      framerate_den: 0,
-      sample_rate: Number(a.sample_rate) ?? 0,
-      stream: aPipe,
-    };
-  }
-
-  // Spawn ffmpeg — extract raw video (AnnexB for H264) to stdout
-  const args: string[] = [
-    "-hide_banner",
-    "-loglevel",
-    "error",
-    "-i",
-    effectiveInput,
-    "-c:v",
-    "copy",
-    "-an", // no audio in this minimal demuxer
-    "-f",
-    "h264",
-    "pipe:1",
-  ];
-
-  const proc = spawn(FFMPEG, args, { stdio: ["ignore", "pipe", "pipe"] });
-
-  // Scan stdout for NAL units. Each NAL unit (between start codes) is one frame
-  // payload. We emit them individually; the packetizer chain handles FU-A.
-  let videoBuf = Buffer.alloc(0);
-  let frameCount = 0;
-
-  const emitFrame = (nal: Uint8Array, isKeyFrame: boolean) => {
-    vPipe.write({
-      data: Buffer.from(nal),
-      pts: frameCount,
-      duration: 1,
-      timeBase: { num: 1, den: 90000 },
-      flags: isKeyFrame ? AV_PKT_FLAG_KEY : 0,
-      streamIndex: 0,
-      free: () => {},
-    });
-    frameCount++;
-  };
-
-  if (proc.stdout) {
-    proc.stdout.on("data", (chunk: Buffer) => {
-      videoBuf = Buffer.concat([videoBuf, chunk]);
-      // Find start codes (00 00 01 or 00 00 00 01) and split NALs
-      let start = 0;
-      // If buffer starts with zeros, that's the first start code — emit from there
-      while (start < videoBuf.length) {
-        let scPos = -1;
-        for (let i = start + 1; i < videoBuf.length - 2; i++) {
-          if (
-            videoBuf[i] === 0 &&
-            videoBuf[i + 1] === 0 &&
-            videoBuf[i + 2] === 1
-          ) {
-            scPos = i + 3;
-            break;
-          }
-        }
-        if (scPos === -1) break;
-        // Emit the NAL from `start` to `scPos` (but skip the start code bytes at `start`)
-        if (start < scPos) {
-          let nalStart = start;
-          // Skip start code bytes for the NAL itself (00 00 01)
-          if (
-            videoBuf[nalStart] === 0 &&
-            videoBuf[nalStart + 1] === 0 &&
-            videoBuf[nalStart + 2] === 1
-          ) {
-            nalStart += 3;
-          } else if (
-            nalStart + 3 < scPos &&
-            videoBuf[nalStart] === 0 &&
-            videoBuf[nalStart + 1] === 0 &&
-            videoBuf[nalStart + 2] === 0 &&
-            videoBuf[nalStart + 3] === 1
-          ) {
-            nalStart += 4;
-          }
-          const nal = videoBuf.subarray(nalStart, scPos);
-          // Trim trailing zero bytes (from start code overlap)
-          let end = nal.length;
-          while (end > 0 && nal[end - 1] === 0) end--;
-          if (end > 0) {
-            const nalTrimmed = nal.subarray(0, end);
-            const isIdr = (nalTrimmed[0] & 0x1f) === 5; // IDR
-            emitFrame(nalTrimmed, isIdr);
-          }
-        }
-        // Skip the 00 00 01 at scPos-3 to find next
-        start = scPos;
-        // But the next start code needs at least 3 bytes
-        if (start > videoBuf.length - 3) break;
-      }
-      // Keep remaining bytes (potential partial NAL or start code)
-      if (start > 0 && start < videoBuf.length) {
-        videoBuf = videoBuf.subarray(start);
-      } else if (videoBuf.length > 4) {
-        // No full NAL found, but avoid unbounded growth
-        // Keep a sliding window
-        videoBuf = videoBuf.subarray(videoBuf.length - 3);
-      }
-    });
-    proc.stdout.on("end", () => {
-      if (videoBuf.length > 0) {
-        let end = videoBuf.length;
-        while (end > 0 && videoBuf[end - 1] === 0) end--;
-        if (end > 0) emitFrame(videoBuf.subarray(0, end), false);
-      }
-      vPipe.end();
-      aPipe.end();
-    });
-  }
-
-  if (proc.stderr) {
-    proc.stderr.on("data", () => {
-      /* errors swallowed */
-    });
-  }
-  proc.on("close", () => {
-    vPipe.end();
-    aPipe.end();
-  });
-
-  const close = () => {
-    proc.kill("SIGTERM");
-    vPipe.end();
-    aPipe.end();
-    cleanupSpool();
-  };
-
-  return { video: vInfo, audio: aInfo, close };
-}

services/discord-gateway/src/goLive/Encoders.ts

@@ -1,51 +0,0 @@
-/**
- * Lightweight encoders config — ported from @dank074/discord-video-stream
- * encoders/software.js. Only software (libx264) is needed for GoLive.
- */
-
-export interface EncoderSettings {
-  name: string;
-  options: string[];
-  outFilters?: string[];
-  globalOptions?: string[];
-}
-
-export interface EncoderSet {
-  H264: EncoderSettings;
-  H265: EncoderSettings;
-  VP8: EncoderSettings;
-  VP9: EncoderSettings;
-  AV1: EncoderSettings;
-}
-
-/** Software x264 encoder. Matches @dank074's software() defaults. */
-export function software(
-  opts: {
-    x264?: { preset?: string; tune?: string };
-    x265?: { preset?: string; tune?: string };
-  } = {},
-): () => EncoderSet {
-  const { x264, x265 } = opts;
-  const { preset: x264Preset = "superfast", tune: x264Tune = "film" } =
-    x264 ?? {};
-  const { preset: x265Preset = "superfast", tune: x265Tune } = x265 ?? {};
-  return () => ({
-    H264: {
-      name: "libx264",
-      options: ["-forced-idr 1", `-tune ${x264Tune}`, `-preset ${x264Preset}`],
-    },
-    H265: {
-      name: "libx265",
-      options: [
-        "-forced-idr 1",
-        ...(x265Tune ? [`-tune ${x265Tune}`] : []),
-        `-preset ${x265Preset}`,
-      ],
-    },
-    VP8: { name: "libvpx", options: ["-deadline 20000"] },
-    VP9: { name: "libvpx-vp9", options: ["-deadline 20000"] },
-    AV1: { name: "libsvtav1", options: [] },
-  });
-}
-
-export const Encoders = { software };

services/discord-gateway/src/goLive/GatewayOpCodes.ts

@@ -1,41 +0,0 @@
-/** Discord gateway opcodes used by Streamer — ported from @dank074/discord-video-stream. */
-export enum GatewayOpCodes {
-  DISPATCH = 0,
-  HEARTBEAT = 1,
-  IDENTIFY = 2,
-  PRESENCE_UPDATE = 3,
-  VOICE_STATE_UPDATE = 4,
-  VOICE_SERVER_PING = 5,
-  RESUME = 6,
-  RECONNECT = 7,
-  REQUEST_GUILD_MEMBERS = 8,
-  INVALID_SESSION = 9,
-  HELLO = 10,
-  HEARTBEAT_ACK = 11,
-  CALL_CONNECT = 13,
-  GUILD_SUBSCRIPTIONS = 14,
-  LOBBY_CONNECT = 15,
-  LOBBY_DISCONNECT = 16,
-  LOBBY_VOICE_STATES_UPDATE = 17,
-  STREAM_CREATE = 18,
-  STREAM_DELETE = 19,
-  STREAM_WATCH = 20,
-  STREAM_PING = 21,
-  STREAM_SET_PAUSED = 22,
-  REQUEST_GUILD_APPLICATION_COMMANDS = 24,
-  EMBEDDED_ACTIVITY_LAUNCH = 25,
-  EMBEDDED_ACTIVITY_CLOSE = 26,
-  EMBEDDED_ACTIVITY_UPDATE = 27,
-  REQUEST_FORUM_UNREADS = 28,
-  REMOTE_COMMAND = 29,
-  GET_DELETED_ENTITY_IDS_NOT_MATCHING_HASH = 30,
-  REQUEST_SOUNDBOARD_SOUNDS = 31,
-  SPEED_TEST_CREATE = 32,
-  SPEED_TEST_DELETE = 33,
-  REQUEST_LAST_MESSAGES = 34,
-  SEARCH_RECENT_MEMBERS = 35,
-  REQUEST_CHANNEL_STATUSES = 36,
-  GUILD_SUBSCRIPTIONS_BULK = 37,
-  GUILD_CHANNELS_RESYNC = 38,
-  REQUEST_CHANNEL_MEMBER_COUNT = 39,
-}

services/discord-gateway/src/goLive/SPSVUIRewriter.ts

@@ -1,291 +0,0 @@
-/**
- * H264 SPS VUI rewriter — ported from @dank074/discord-video-stream
- * SPSVUIRewriter.js. Rewrites the SPS so Discord's receiver applies
- * bitstream restrictions (max_num_reorder_frames=0, max_dec_frame_buffering
- * bounded) — required for low-latency GoLive decode.
- */
-
-import {
-  AnnexBBitstreamReader,
-  AnnexBBitstreamWriter,
-} from "./AnnexBBitstreamReaderWriter.js";
-
-export function rewriteSPSVUI(buffer: Uint8Array): Buffer {
-  const reader = new AnnexBBitstreamReader(buffer.subarray(1));
-  const writer = new AnnexBBitstreamWriter();
-  const readBit = (n = 1) => reader.readBits(n);
-  const writeBit = (v: number, n = 1) => writer.writeBits(v, n);
-  const readU = (n: number) => reader.readUnsigned(n);
-  const writeU = (v: number, n: number) => writer.writeUnsigned(v, n);
-  const readUE = () => reader.readUnsignedExpGolomb();
-  const writeUE = (v: number) => writer.writeUnsignedExpGolomb(v);
-  const readSE = () => reader.readSignedExpGolomb();
-  const writeSE = (v: number) => writer.writeSignedExpGolomb(v);
-
-  // Rewrite the NAL header
-  writeU(buffer[0], 8);
-  const profile_idc = readU(8);
-  writeU(profile_idc, 8);
-  const constraint_flags = readU(8);
-  writeU(constraint_flags, 8);
-  const level_idc = readU(8);
-  writeU(level_idc, 8);
-  const seq_parameter_set_id = readUE();
-  writeUE(seq_parameter_set_id);
-
-  // If profile in high profiles, additional fields
-  const highProfiles = new Set([
-    100, 110, 122, 244, 44, 83, 86, 118, 128, 138, 144,
-  ]);
-  if (highProfiles.has(profile_idc)) {
-    const chroma_format_idc = readUE();
-    writeUE(chroma_format_idc);
-    if (chroma_format_idc === 3) {
-      const separate_colour_plane_flag = readBit(1);
-      writeBit(separate_colour_plane_flag, 1);
-    }
-    const bit_depth_luma_minus8 = readUE();
-    writeUE(bit_depth_luma_minus8);
-    const bit_depth_chroma_minus8 = readUE();
-    writeUE(bit_depth_chroma_minus8);
-    const qpprime_y_zero_transform_bypass_flag = readBit(1);
-    writeBit(qpprime_y_zero_transform_bypass_flag, 1);
-    const seq_scaling_matrix_present_flag = readBit(1);
-    writeBit(seq_scaling_matrix_present_flag, 1);
-    if (seq_scaling_matrix_present_flag) {
-      const scalingCount = chroma_format_idc !== 3 ? 8 : 12;
-      for (let i = 0; i < scalingCount; i++) {
-        const seq_scaling_list_present_flag = readBit(1);
-        writeBit(seq_scaling_list_present_flag, 1);
-        if (seq_scaling_list_present_flag) {
-          const size = i < 6 ? 16 : 64;
-          let lastScale = 8;
-          let nextScale = 8;
-          for (let j = 0; j < size; j++) {
-            const delta = readSE();
-            writeSE(delta);
-            nextScale = (lastScale + delta + 256) % 256;
-            if (nextScale !== 0) lastScale = nextScale;
-          }
-        }
-      }
-    }
-  }
-
-  const log2_max_frame_num_minus4 = readUE();
-  writeUE(log2_max_frame_num_minus4);
-  const pic_order_cnt_type = readUE();
-  writeUE(pic_order_cnt_type);
-  if (pic_order_cnt_type === 0) {
-    const log2_max_pic_order_cnt_lsb_minus4 = readUE();
-    writeUE(log2_max_pic_order_cnt_lsb_minus4);
-  } else if (pic_order_cnt_type === 1) {
-    const delta_pic_order_always_zero_flag = readBit(1);
-    writeBit(delta_pic_order_always_zero_flag, 1);
-    const offset_for_non_ref_pic = readSE();
-    writeSE(offset_for_non_ref_pic);
-    const offset_for_top_to_bottom_field = readSE();
-    writeSE(offset_for_top_to_bottom_field);
-    const num_ref_frames_in_pic_order_cnt_cycle = readUE();
-    writeUE(num_ref_frames_in_pic_order_cnt_cycle);
-    for (let i = 0; i < num_ref_frames_in_pic_order_cnt_cycle; i++) {
-      const offset_for_ref_frame = readSE();
-      writeSE(offset_for_ref_frame);
-    }
-  }
-  const max_num_ref_frames = readUE();
-  writeUE(max_num_ref_frames);
-  const gaps_in_frame_num_value_allowed_flag = readBit(1);
-  writeBit(gaps_in_frame_num_value_allowed_flag, 1);
-  const pic_width_in_mbs_minus1 = readUE();
-  writeUE(pic_width_in_mbs_minus1);
-  const pic_height_in_map_units_minus1 = readUE();
-  writeUE(pic_height_in_map_units_minus1);
-  const frame_mbs_only_flag = readBit(1);
-  writeBit(frame_mbs_only_flag, 1);
-  if (frame_mbs_only_flag === 0) {
-    const mb_adaptive_frame_field_flag = readBit(1);
-    writeBit(mb_adaptive_frame_field_flag, 1);
-  }
-  const direct_8x8_inference_flag = readBit(1);
-  writeBit(direct_8x8_inference_flag, 1);
-  const frame_cropping_flag = readBit(1);
-  writeBit(frame_cropping_flag, 1);
-  if (frame_cropping_flag) {
-    const frame_crop_left_offset = readUE();
-    writeUE(frame_crop_left_offset);
-    const frame_crop_right_offset = readUE();
-    writeUE(frame_crop_right_offset);
-    const frame_crop_top_offset = readUE();
-    writeUE(frame_crop_top_offset);
-    const frame_crop_bottom_offset = readUE();
-    writeUE(frame_crop_bottom_offset);
-  }
-
-  // https://webrtc.googlesource.com/src/+/5f2c9278f35e47ff72eb191669d473b7400c9f3e/common_video/h264/sps_vui_rewriter.cc#283
-  function addBitstreamRestriction() {
-    // motion_vectors_over_pic_boundaries_flag: u(1) — Default is 1 when not present.
-    writeBit(1, 1);
-    // max_bytes_per_pic_denom: ue(v) — Default is 2 when not present.
-    writeUE(2);
-    // max_bits_per_mb_denom: ue(v) — Default is 1 when not present.
-    writeUE(1);
-    // log2_max_mv_length_horizontal / vertical — both default to 16.
-    writeUE(16);
-    writeUE(16);
-    // IMPORTANT: max_num_reorder_frames must be 0 for low latency.
-    writeUE(0);
-    writeUE(max_num_ref_frames);
-  }
-
-  const vui_parameters_present_flag = readBit(1);
-  writeBit(1, 1);
-  // If no VUI exists, write one
-  if (!vui_parameters_present_flag) {
-    // aspect_ratio_info_present_flag, overscan_info_present_flag. Both u(1).
-    writeBit(0, 2);
-    // video_signal_type_present_flag, u(1) — write 0, ignore color space.
-    writeBit(0, 1);
-    // chroma_loc_info_present_flag, timing_info_present_flag,
-    // nal_hrd_parameters_present_flag, vcl_hrd_parameters_present_flag,
-    // pic_struct_present_flag — all u(1)
-    writeBit(0, 5);
-    // bitstream_restriction_flag: u(1)
-    writeBit(1, 1);
-    addBitstreamRestriction();
-  } else {
-    // VUI parsing and copying
-    const aspect_ratio_info_present_flag = readBit(1);
-    writeBit(aspect_ratio_info_present_flag, 1);
-    if (aspect_ratio_info_present_flag) {
-      const aspect_ratio_idc = readU(8);
-      writeU(aspect_ratio_idc, 8);
-      if (aspect_ratio_idc === 255) {
-        const sar_width = readU(16);
-        writeU(sar_width, 16);
-        const sar_height = readU(16);
-        writeU(sar_height, 16);
-      }
-    }
-    const overscan_info_present_flag = readBit(1);
-    writeBit(overscan_info_present_flag, 1);
-    if (overscan_info_present_flag) {
-      const overscan_appropriate_flag = readBit(1);
-      writeBit(overscan_appropriate_flag, 1);
-    }
-    // Read the video signal type, but don't copy it
-    const video_signal_type_present_flag = readBit(1);
-    writeBit(0, 1);
-    if (video_signal_type_present_flag) {
-      readBit(3); // _video_format
-      readBit(1); // _video_full_range_flag
-      const colour_description_present_flag = readBit(1);
-      if (colour_description_present_flag) {
-        readU(8); // _colour_primaries
-        readU(8); // _transfer_characteristics
-        readU(8); // _matrix_coeffs
-      }
-    }
-    const chroma_loc_info_present_flag = readBit(1);
-    writeBit(chroma_loc_info_present_flag, 1);
-    if (chroma_loc_info_present_flag) {
-      const chroma_sample_loc_type_top_field = readUE();
-      writeUE(chroma_sample_loc_type_top_field);
-      const chroma_sample_loc_type_bottom_field = readUE();
-      writeUE(chroma_sample_loc_type_bottom_field);
-    }
-    const timing_info_present_flag = readBit(1);
-    writeBit(timing_info_present_flag, 1);
-    if (timing_info_present_flag) {
-      const num_units_in_tick = readU(32);
-      writeU(num_units_in_tick, 32);
-      const time_scale = readU(32);
-      writeU(time_scale, 32);
-      const fixed_frame_rate_flag = readBit(1);
-      writeBit(fixed_frame_rate_flag, 1);
-    }
-    const nal_hrd_parameters_present_flag = readBit(1);
-    writeBit(nal_hrd_parameters_present_flag, 1);
-    if (nal_hrd_parameters_present_flag) {
-      // hrd_parameters()
-      const cpb_cnt_minus1 = readUE();
-      writeUE(cpb_cnt_minus1);
-      const bit_rate_scale = readBit(4);
-      writeBit(bit_rate_scale, 4);
-      const cpb_size_scale = readBit(4);
-      writeBit(cpb_size_scale, 4);
-      for (let i = 0; i <= cpb_cnt_minus1; i++) {
-        const bit_rate_value_minus1 = readUE();
-        writeUE(bit_rate_value_minus1);
-        const cpb_size_value_minus1 = readUE();
-        writeUE(cpb_size_value_minus1);
-        const cbr_flag = readBit(1);
-        writeBit(cbr_flag, 1);
-      }
-      const initial_cpb_removal_delay_length_minus1 = readBit(5);
-      writeBit(initial_cpb_removal_delay_length_minus1, 5);
-      const cpb_removal_delay_length_minus1 = readBit(5);
-      writeBit(cpb_removal_delay_length_minus1, 5);
-      const dpb_output_delay_length_minus1 = readBit(5);
-      writeBit(dpb_output_delay_length_minus1, 5);
-      const time_offset_length = readBit(5);
-      writeBit(time_offset_length, 5);
-    }
-    const vcl_hrd_parameters_present_flag = readBit(1);
-    writeBit(vcl_hrd_parameters_present_flag, 1);
-    if (vcl_hrd_parameters_present_flag) {
-      // hrd_parameters()
-      const cpb_cnt_minus1 = readUE();
-      writeUE(cpb_cnt_minus1);
-      const bit_rate_scale = readBit(4);
-      writeBit(bit_rate_scale, 4);
-      const cpb_size_scale = readBit(4);
-      writeBit(cpb_size_scale, 4);
-      for (let i = 0; i <= cpb_cnt_minus1; i++) {
-        const bit_rate_value_minus1 = readUE();
-        writeUE(bit_rate_value_minus1);
-        const cpb_size_value_minus1 = readUE();
-        writeUE(cpb_size_value_minus1);
-        const cbr_flag = readBit(1);
-        writeBit(cbr_flag, 1);
-      }
-      const initial_cpb_removal_delay_length_minus1 = readBit(5);
-      writeBit(initial_cpb_removal_delay_length_minus1, 5);
-      const cpb_removal_delay_length_minus1 = readBit(5);
-      writeBit(cpb_removal_delay_length_minus1, 5);
-      const dpb_output_delay_length_minus1 = readBit(5);
-      writeBit(dpb_output_delay_length_minus1, 5);
-      const time_offset_length = readBit(5);
-      writeBit(time_offset_length, 5);
-    }
-    if (nal_hrd_parameters_present_flag || vcl_hrd_parameters_present_flag) {
-      const low_delay_hrd_flag = readBit(1);
-      writeBit(low_delay_hrd_flag, 1);
-    }
-    const pic_struct_present_flag = readBit(1);
-    writeBit(pic_struct_present_flag, 1);
-    const bitstream_restriction_flag = readBit(1);
-    writeBit(1, 1);
-    if (!bitstream_restriction_flag) {
-      addBitstreamRestriction();
-    } else {
-      const motion_vectors_over_pic_boundaries_flag = readBit(1);
-      writeBit(motion_vectors_over_pic_boundaries_flag, 1);
-      const max_bytes_per_pic_denom = readUE();
-      writeUE(max_bytes_per_pic_denom);
-      const max_bits_per_mb_denom = readUE();
-      writeUE(max_bits_per_mb_denom);
-      const log2_max_mv_length_horizontal = readUE();
-      writeUE(log2_max_mv_length_horizontal);
-      const log2_max_mv_length_vertical = readUE();
-      writeUE(log2_max_mv_length_vertical);
-      readUE(); // _num_reorder_frames
-      writeUE(0);
-      readUE(); // _max_dec_frame_buffering
-      writeUE(max_num_ref_frames);
-    }
-  }
-  writeBit(1, 1); // rbsp_stop_one_bit
-  writer.flush();
-  return writer.toBuffer();
-}

services/discord-gateway/src/goLive/StreamConnection.ts

@@ -1,45 +0,0 @@
-/**
- * StreamConnection — GoLive stream connection (screen share).
- * Ported from @dank074/discord-video-stream StreamConnection.js.
- */
-
-import { BaseMediaConnection } from "./BaseMediaConnection.js";
-import { VoiceOpCodes } from "./VoiceOpCodes.js";
-
-export class StreamConnection extends BaseMediaConnection {
-  _streamKey: string | null = null;
-  _serverId: string | null = null;
-
-  setSpeaking(speaking: boolean): void {
-    if (!this.webRtcParams) throw new Error("WebRTC connection not ready");
-    this.sendOpcode(VoiceOpCodes.SPEAKING, {
-      delay: 0,
-      speaking: speaking ? 2 : 0,
-      ssrc: this.webRtcParams.audioSsrc,
-    });
-  }
-
-  get daveChannelId(): string {
-    if (this._serverId === null) {
-      throw new Error("Server ID not set (this shouldn't happen)");
-    }
-    const channelId = BigInt(this._serverId) - 1n;
-    return channelId.toString();
-  }
-
-  get serverId(): string | null {
-    return this._serverId;
-  }
-
-  set serverId(id: string | null) {
-    this._serverId = id;
-  }
-
-  get streamKey(): string | null {
-    return this._streamKey;
-  }
-
-  set streamKey(value: string | null) {
-    this._streamKey = value;
-  }
-}

services/discord-gateway/src/goLive/Streamer.ts

@@ -1,280 +0,0 @@
-/**
- * Streamer — gateway-level GoLive controller. Ported from
- * @dank074/discord-video-stream Streamer.js.
- *
- * Drives the Discord gateway (VOICE_STATE_UPDATE, STREAM_CREATE, ...) and
- * hands back a VoiceConnection / StreamConnection once the media server
- * session is ready.
- */
-
-import { EventEmitter } from "node:events";
-import { GatewayOpCodes } from "./GatewayOpCodes.js";
-import type { NativePeerConnection } from "./native.js";
-import { StreamConnection } from "./StreamConnection.js";
-import { generateStreamKey, parseStreamKey } from "./utils.js";
-import { VoiceConnection } from "./VoiceConnection.js";
-import type { WebRtcConnWrapper } from "./WebRtcWrapper.js";
-
-/** Minimal surface of a discord.js-selfbot-v13 client used by Streamer. */
-export interface StreamerClientLike {
-  user: { id: string; username?: string } | null;
-  token: string | null;
-  on(
-    event: "raw",
-    listener: (packet: { t: string; d: unknown }) => void,
-  ): unknown;
-  ws: {
-    broadcast(data: { op: number; d: unknown }): void;
-  };
-  guilds?: {
-    // biome-ignore lint/suspicious/noExplicitAny: discord.js-selfbot client shape is dynamic
-    fetch(id: string): Promise<any>;
-  };
-}
-
-/** Minimal channel shape accepted by joinVoiceChannel. */
-export interface VoiceChannelLike {
-  id: string;
-  type: string;
-  guildId?: string | null;
-}
-
-export class Streamer {
-  _voiceConnection: VoiceConnection | null = null;
-  _client: StreamerClientLike;
-  _gatewayEmitter = new EventEmitter();
-
-  constructor(client: StreamerClientLike) {
-    this._client = client;
-    // listen for gateway dispatch events
-    this.client.on("raw", (packet) => {
-      this._gatewayEmitter.emit(packet.t, packet.d);
-    });
-  }
-
-  get client(): StreamerClientLike {
-    return this._client;
-  }
-
-  get opts(): Record<string, unknown> {
-    return {};
-  }
-
-  get voiceConnection(): VoiceConnection | null {
-    return this._voiceConnection;
-  }
-
-  sendOpcode(code: number, data: unknown): void {
-    this.client.ws.broadcast({ op: code, d: data });
-  }
-
-  joinVoiceChannel(channel: VoiceChannelLike): Promise<WebRtcConnWrapper> {
-    let guildId: string | null = null;
-    if (
-      channel.type === "GUILD_STAGE_VOICE" ||
-      channel.type === "GUILD_VOICE"
-    ) {
-      guildId = channel.guildId ?? null;
-    }
-    return this.joinVoice(guildId, channel.id);
-  }
-
-  /**
-   * Joins a voice channel and resolves with the WebRtcConnWrapper when the
-   * media session is ready.
-   */
-  joinVoice(
-    guild_id: string | null,
-    channel_id: string,
-  ): Promise<WebRtcConnWrapper> {
-    return new Promise((resolve, reject) => {
-      if (!this.client.user) {
-        reject(new Error("Client not logged in"));
-        return;
-      }
-      const user_id = this.client.user.id;
-      const voiceConn = new VoiceConnection(
-        this,
-        guild_id,
-        user_id,
-        channel_id,
-        (conn) => {
-          resolve(conn);
-        },
-      );
-      this._voiceConnection = voiceConn;
-      this._gatewayEmitter.on(
-        "VOICE_STATE_UPDATE",
-        (d: { user_id: string; session_id: string }) => {
-          if (user_id !== d.user_id) return;
-          voiceConn.setSession(d.session_id);
-        },
-      );
-      this._gatewayEmitter.on(
-        "VOICE_SERVER_UPDATE",
-        (d: {
-          guild_id: string | null;
-          channel_id?: string;
-          endpoint: string;
-          token: string;
-        }) => {
-          if (guild_id !== d.guild_id) return;
-          // channel_id is not set for guild voice calls
-          if (d.channel_id && channel_id !== d.channel_id) return;
-          voiceConn.setTokens(d.endpoint, d.token);
-        },
-      );
-      this.signalVideo(false);
-    });
-  }
-
-  /** Create a GoLive stream (screen share) on top of the voice connection. */
-  createStream(): Promise<WebRtcConnWrapper> {
-    return new Promise((resolve, reject) => {
-      if (!this.client.user) {
-        reject(new Error("Client not logged in"));
-        return;
-      }
-      if (!this.voiceConnection) {
-        reject(
-          new Error("cannot start stream without first joining voice channel"),
-        );
-        return;
-      }
-      this.signalStream();
-      const {
-        guildId: clientGuildId,
-        channelId: clientChannelId,
-        session_id,
-      } = this.voiceConnection;
-      const clientUserId = this.client.user.id;
-      if (!session_id) throw new Error("Session doesn't exist yet");
-      const streamConn = new StreamConnection(
-        this,
-        clientGuildId,
-        clientUserId,
-        clientChannelId,
-        (conn) => {
-          resolve(conn);
-        },
-      );
-      this.voiceConnection.streamConnection = streamConn;
-      this._gatewayEmitter.on(
-        "STREAM_CREATE",
-        (d: { stream_key: string; rtc_server_id: string }) => {
-          const { channelId, guildId, userId } = parseStreamKey(d.stream_key);
-          if (
-            clientGuildId !== guildId ||
-            clientChannelId !== channelId ||
-            clientUserId !== userId
-          ) {
-            return;
-          }
-          streamConn.serverId = d.rtc_server_id;
-          streamConn.streamKey = d.stream_key;
-          streamConn.setSession(session_id);
-        },
-      );
-      this._gatewayEmitter.on(
-        "STREAM_SERVER_UPDATE",
-        (d: { stream_key: string; endpoint: string; token: string }) => {
-          const { channelId, guildId, userId } = parseStreamKey(d.stream_key);
-          if (
-            clientGuildId !== guildId ||
-            clientChannelId !== channelId ||
-            clientUserId !== userId
-          ) {
-            return;
-          }
-          streamConn.setTokens(d.endpoint, d.token);
-        },
-      );
-    });
-  }
-
-  async setStreamPreview(image: Buffer): Promise<void> {
-    if (!this.client.token) throw new Error("Please login :)");
-    if (!this.voiceConnection?.streamConnection?.guildId) return;
-    const data = `data:image/jpeg;base64,${image.toString("base64")}`;
-    const { guildId } = this.voiceConnection.streamConnection;
-    if (!this.client.guilds) return;
-    const server = await this.client.guilds.fetch(guildId);
-    // biome-ignore lint/suspicious/noExplicitAny: discord.js-selfbot dynamic
-    (server as any).members.me?.voice?.postPreview(data);
-  }
-
-  stopStream(): void {
-    const stream = this.voiceConnection?.streamConnection;
-    if (!stream) return;
-    stream.stop();
-    this.signalStopStream();
-    this.voiceConnection.streamConnection = null;
-    this._gatewayEmitter.removeAllListeners("STREAM_CREATE");
-    this._gatewayEmitter.removeAllListeners("STREAM_SERVER_UPDATE");
-  }
-
-  leaveVoice(): void {
-    this.voiceConnection?.stop();
-    this.signalLeaveVoice();
-    this._voiceConnection = null;
-    this._gatewayEmitter.removeAllListeners("VOICE_STATE_UPDATE");
-    this._gatewayEmitter.removeAllListeners("VOICE_SERVER_UPDATE");
-  }
-
-  signalVideo(video_enabled: boolean): void {
-    if (!this.voiceConnection) return;
-    const { guildId: guild_id, channelId: channel_id } = this.voiceConnection;
-    this.sendOpcode(GatewayOpCodes.VOICE_STATE_UPDATE, {
-      guild_id: guild_id,
-      channel_id,
-      self_mute: false,
-      self_deaf: true,
-      self_video: video_enabled,
-    });
-  }
-
-  signalStream(): void {
-    if (!this.voiceConnection) return;
-    const {
-      type,
-      guildId: guild_id,
-      channelId: channel_id,
-      botId: user_id,
-    } = this.voiceConnection;
-    this.sendOpcode(GatewayOpCodes.STREAM_CREATE, {
-      type,
-      guild_id,
-      channel_id,
-      preferred_region: null,
-    });
-    this.sendOpcode(GatewayOpCodes.STREAM_SET_PAUSED, {
-      stream_key: generateStreamKey(type, guild_id, channel_id, user_id),
-      paused: false,
-    });
-  }
-
-  signalStopStream(): void {
-    if (!this.voiceConnection) return;
-    const {
-      type,
-      guildId: guild_id,
-      channelId: channel_id,
-      botId: user_id,
-    } = this.voiceConnection;
-    this.sendOpcode(GatewayOpCodes.STREAM_DELETE, {
-      stream_key: generateStreamKey(type, guild_id, channel_id, user_id),
-    });
-  }
-
-  signalLeaveVoice(): void {
-    this.sendOpcode(GatewayOpCodes.VOICE_STATE_UPDATE, {
-      guild_id: null,
-      channel_id: null,
-      self_mute: true,
-      self_deaf: false,
-      self_video: false,
-    });
-  }
-}
-
-export type { NativePeerConnection };

services/discord-gateway/src/goLive/VideoStream.ts

@@ -1,20 +0,0 @@
-/**
- * VideoStream — feeds encoded H264 frames into the WebRTC connection.
- * Ported from @dank074/discord-video-stream VideoStream.js.
- */
-
-import { BaseMediaStream } from "./BaseMediaStream.js";
-import type { WebRtcConnWrapper } from "./WebRtcWrapper.js";
-
-export class VideoStream extends BaseMediaStream {
-  _conn: WebRtcConnWrapper;
-
-  constructor(conn: WebRtcConnWrapper, noSleep = false) {
-    super("video", noSleep);
-    this._conn = conn;
-  }
-
-  async _sendFrame(frame: Buffer, frametime: number): Promise<void> {
-    this._conn.sendVideoFrame(frame, frametime);
-  }
-}

services/discord-gateway/src/goLive/VoiceConnection.ts

@@ -1,25 +0,0 @@
-/**
- * VoiceConnection — guild/DM voice channel GoLive connection.
- * Ported from @dank074/discord-video-stream VoiceConnection.js.
- */
-
-import { BaseMediaConnection } from "./BaseMediaConnection.js";
-import type { StreamConnection } from "./StreamConnection.js";
-
-export class VoiceConnection extends BaseMediaConnection {
-  streamConnection: StreamConnection | null = null;
-
-  get daveChannelId(): string {
-    return this.channelId;
-  }
-
-  get serverId(): string | null {
-    // for guild vc it is the guild id, for dm voice it is the channel id
-    return this.guildId ?? this.channelId;
-  }
-
-  stop(): void {
-    super.stop();
-    this.streamConnection?.stop();
-  }
-}

services/discord-gateway/src/goLive/VoiceOpCodes.ts

@@ -1,38 +0,0 @@
-/** Discord voice WebSocket opcodes — ported from @dank074/discord-video-stream. */
-export enum VoiceOpCodes {
-  IDENTIFY = 0,
-  SELECT_PROTOCOL = 1,
-  READY = 2,
-  HEARTBEAT = 3,
-  SELECT_PROTOCOL_ACK = 4,
-  SPEAKING = 5,
-  HEARTBEAT_ACK = 6,
-  RESUME = 7,
-  HELLO = 8,
-  RESUMED = 9,
-  CLIENTS_CONNECT = 11,
-  VIDEO = 12,
-  CLIENT_DISCONNECT = 13,
-  SESSION_UPDATE = 14,
-  MEDIA_SINK_WANTS = 15,
-  VOICE_BACKEND_VERSION = 16,
-  CHANNEL_OPTIONS_UPDATE = 17,
-  FLAGS = 18,
-  SPEED_TEST = 19,
-  PLATFORM = 20,
-  DAVE_PREPARE_TRANSITION = 21,
-  DAVE_EXECUTE_TRANSITION = 22,
-  DAVE_TRANSITION_READY = 23,
-  DAVE_PREPARE_EPOCH = 24,
-  MLS_INVALID_COMMIT_WELCOME = 31,
-}
-
-/** Binary voice WebSocket opcodes (DAVE / MLS). */
-export enum VoiceOpCodesBinary {
-  MLS_EXTERNAL_SENDER = 25,
-  MLS_KEY_PACKAGE = 26,
-  MLS_PROPOSALS = 27,
-  MLS_COMMIT_WELCOME = 28,
-  MLS_ANNOUNCE_COMMIT_TRANSITION = 29,
-  MLS_WELCOME = 30,
-}

services/discord-gateway/src/goLive/WebRtcWrapper.ts

@@ -1,205 +0,0 @@
-/**
- * WebRTC connection wrapper for GoLive — ported from
- * @dank074/discord-video-stream WebRtcWrapper.js, with the media stack
- * (packetizers, RTCP SR/NACK, pacing) provided by the libdatachannel-min
- * binding instead of node-datachannel's JS-exposed media classes.
- */
-
-import {
-  H264Helpers,
-  H264NalUnitTypes,
-  splitNalu,
-  startCode3,
-} from "./AnnexBHelper.js";
-import { CodecPayloadType } from "./CodecPayloadType.js";
-import type { NativePeerConnection, NativeTrack } from "./native.js";
-import { loadNative } from "./native.js";
-import { rewriteSPSVUI } from "./SPSVUIRewriter.js";
-import { normalizeVideoCodec } from "./utils.js";
-
-export type WebRtcVideoCodec = "H264" | "H265" | "VP8" | "VP9" | "AV1";
-
-export interface WebRtcParams {
-  address: string;
-  port: number;
-  audioSsrc: number;
-  videoSsrc: number;
-  rtxSsrc: number;
-  supportedEncryptionModes: string[];
-}
-
-/** Minimal surface of the media connection that WebRtcWrapper drives. */
-export interface VideoAttribute {
-  fps: number;
-  width: number;
-  height: number;
-}
-
-export interface MediaConnectionLike {
-  daveReady: boolean;
-  daveSession: {
-    encryptOpus(frame: Buffer): Buffer;
-    encrypt(mediaType: number, codec: number, frame: Buffer): Buffer;
-  } | null;
-  webRtcParams: WebRtcParams | null;
-  setSpeaking(speaking: boolean): void;
-  setVideoAttributes(enabled: boolean, attr?: VideoAttribute): void;
-}
-
-/** Media types used by DAVE encryption (from @dank074). */
-export enum DaveMediaType {
-  AUDIO = 0,
-  VIDEO = 1,
-}
-
-/** DAVE codec ids (from @dank074). */
-export enum DaveCodec {
-  UNKNOWN = 0,
-  VP8 = 2,
-  VP9 = 3,
-  H264 = 4,
-  H265 = 5,
-  AV1 = 6,
-}
-
-export class WebRtcConnWrapper {
-  private _mediaConn: MediaConnectionLike;
-  private _webRtcConn: NativePeerConnection | null = null;
-  private _audioTrack: NativeTrack | null = null;
-  private _videoTrack: NativeTrack | null = null;
-  private _videoCodec: WebRtcVideoCodec | null = null;
-  /** Assigned by BaseMediaConnection to send the gathered SDP to Discord. */
-  onLocalDescription: ((sdp: string) => void) | null = null;
-
-  constructor(mediaConn: MediaConnectionLike) {
-    this._mediaConn = mediaConn;
-  }
-
-  initWebRtc(): NativePeerConnection {
-    const native = loadNative();
-    this._webRtcConn = new native.PeerConnection({
-      iceServers: ["stun:stun.l.google.com:19302"],
-    });
-    // Track mids must match @dank074: "0" audio, "1" video.
-    this._audioTrack = this._webRtcConn.addTrack("0", "audio");
-    this._videoTrack = this._webRtcConn.addTrack("1", "video");
-    return this._webRtcConn;
-  }
-
-  close(): void {
-    this._webRtcConn?.close();
-    this._webRtcConn = null;
-  }
-
-  get webRtcConn(): NativePeerConnection | null {
-    return this._webRtcConn;
-  }
-
-  get ready(): boolean {
-    return this._webRtcConn?.state() === "connected";
-  }
-
-  get mediaConnection(): MediaConnectionLike {
-    return this._mediaConn;
-  }
-
-  sendAudioFrame(frame: Buffer, frametime: number): void {
-    if (!this.ready || !this._audioTrack) return;
-    const clockRate = CodecPayloadType.opus.clockRate;
-    if (this.mediaConnection.daveReady && this.mediaConnection.daveSession) {
-      frame = this.mediaConnection.daveSession.encryptOpus(frame);
-    }
-    this._audioTrack.sendFrame(frame);
-    this._audioTrack.addTimestamp(Math.round((frametime * clockRate) / 1000));
-  }
-
-  sendVideoFrame(frame: Buffer, frametime: number): void {
-    if (!this.ready || !this._videoTrack) return;
-    const clockRate = CodecPayloadType[this._videoCodec ?? "H264"].clockRate;
-    if (this._videoCodec === "H264") {
-      let spsRewritten = false;
-      const nalus = splitNalu(frame).map((el) => {
-        if (H264Helpers.getUnitType(el) === H264NalUnitTypes.SPS) {
-          spsRewritten = true;
-          return rewriteSPSVUI(el);
-        }
-        return el;
-      });
-      if (spsRewritten)
-        frame = Buffer.concat(nalus.flatMap((el) => [startCode3, el]));
-    }
-    if (this.mediaConnection.daveReady && this.mediaConnection.daveSession) {
-      let daveCodec = DaveCodec.UNKNOWN;
-      switch (this._videoCodec) {
-        case "H264":
-          daveCodec = DaveCodec.H264;
-          break;
-        case "H265":
-          daveCodec = DaveCodec.H265;
-          break;
-        case "VP8":
-          daveCodec = DaveCodec.VP8;
-          break;
-        case "VP9":
-          daveCodec = DaveCodec.VP9;
-          break;
-        case "AV1":
-          daveCodec = DaveCodec.AV1;
-          break;
-        default:
-          break;
-      }
-      frame = this.mediaConnection.daveSession.encrypt(
-        DaveMediaType.VIDEO,
-        daveCodec,
-        frame,
-      );
-    }
-    this._videoTrack.sendFrame(frame);
-    this._videoTrack.addTimestamp(Math.round((frametime * clockRate) / 1000));
-  }
-
-  setPacketizer(videoCodec: string): void {
-    if (!this.mediaConnection.webRtcParams) {
-      throw new Error("WebRTC connection not ready");
-    }
-    const { audioSsrc, videoSsrc } = this.mediaConnection.webRtcParams;
-    this._videoCodec = normalizeVideoCodec(videoCodec);
-    // Audio packetizer: opus 120 @ 48kHz, playout delay ext id 5 (like @dank074)
-    this._audioTrack?.setPacketizer(
-      "audio",
-      audioSsrc,
-      CodecPayloadType.opus.payload_type,
-      CodecPayloadType.opus.clockRate,
-      5,
-      0,
-      1,
-    );
-    // Video packetizer: H264/H265/AV1 with their payload types
-    const codecEntry = CodecPayloadType[this._videoCodec];
-    if (!codecEntry) {
-      throw new Error(`Packetizer not implemented for ${this._videoCodec}`);
-    }
-    const nativeKind =
-      this._videoCodec === "H264"
-        ? "h264"
-        : this._videoCodec === "H265"
-          ? "h265"
-          : this._videoCodec === "AV1"
-            ? "av1"
-            : (() => {
-                throw new Error(
-                  `Packetizer not implemented for ${this._videoCodec}`,
-                );
-              })();
-    this._videoTrack?.setPacketizer(
-      nativeKind,
-      videoSsrc,
-      codecEntry.payload_type,
-      codecEntry.clockRate,
-      5,
-      0,
-      10,
-    );
-  }
-}

services/discord-gateway/src/goLive/index.ts

@@ -1,19 +0,0 @@
-/**
- * goLive public API — re-exports the ported @dank074 modules.
- * Drop-in replacement for `@dank074/discord-video-stream` in
- * screenShareController.ts.
- */
-
-export { AudioStream } from "./AudioStream.js";
-export { BaseMediaConnection } from "./BaseMediaConnection.js";
-export { BaseMediaStream } from "./BaseMediaStream.js";
-export { CodecPayloadType } from "./CodecPayloadType.js";
-export { demux } from "./Demuxer.js";
-export { Encoders } from "./Encoders.js";
-export { playStream, prepareStream } from "./prepareStream.js";
-export { StreamConnection } from "./StreamConnection.js";
-export { Streamer } from "./Streamer.js";
-export { normalizeVideoCodec } from "./utils.js";
-export { VideoStream } from "./VideoStream.js";
-export { VoiceConnection } from "./VoiceConnection.js";
-export { WebRtcConnWrapper } from "./WebRtcWrapper.js";

services/discord-gateway/src/goLive/native.ts

@@ -1,116 +0,0 @@
-/**
- * Loader + typings for the minimal libdatachannel N-API binding
- * (native/libdatachannel-min). The binding exposes ONLY what GoLive needs:
- * PeerConnection, DataChannel, Track (raw RTP + media packetizer chain).
- *
- * The .node file is built by node-gyp against libdatachannel 0.24.0 (built
- * from source — nixpkgs 0.24.1 is glibc-incompatible with this host). It is
- * NOT shipped via npm; the Nix flake builds it as part of the gateway.
- */
-
-export interface NativeTrack {
-  /** Send a RAW RTP/RTCP packet (no media handler installed). */
-  send(buffer: Uint8Array): void;
-  /** Send an ENCODED frame; the packetizer chain turns it into RTP. */
-  sendFrame(buffer: Uint8Array): void;
-  /** Advance the packetizer RTP timestamp by delta (clock-rate units). */
-  addTimestamp(delta: number): void;
-  /** Install the media-handler chain (packetizer → RTCP SR → NACK → pacing). */
-  setPacketizer(
-    kind: "audio" | "h264" | "h265" | "av1",
-    ssrc: number,
-    payloadType: number,
-    clockRate: number,
-    playoutDelayId: number,
-    playoutDelayMin: number,
-    playoutDelayMax: number,
-  ): void;
-  isOpen(): boolean;
-  close(): void;
-}
-
-export interface NativePeerConnection {
-  /** mid must be "0" (audio) or "1" (video) — matches @dank074's track defs. */
-  addTrack(mid: string, kind: "audio" | "video"): NativeTrack;
-  /** Resolves with the full SDP (incl. candidates) after gathering completes. */
-  createOffer(): Promise<string>;
-  /** Resolves with the auto-generated answer SDP. */
-  createAnswer(offerSdp: string): Promise<string>;
-  setRemoteDescription(sdp: string, type: "offer" | "answer"): void;
-  state(): string;
-  close(): void;
-  onStateChange(cb: (state: string) => void): void;
-}
-
-export interface NativeBinding {
-  PeerConnection: new (config: {
-    iceServers: string[];
-  }) => NativePeerConnection;
-  DataChannel: unknown;
-  Track: unknown;
-}
-
-let cached: NativeBinding | null = null;
-
-/** Load the native binding. Throws only if the .node is truly missing —
- *  callers (screen share) guard with `isNativeAvailable()`. */
-export function loadNative(): NativeBinding {
-  if (cached) return cached;
-  // Resolve relative to this file: src/goLive/ → native/libdatachannel-min/
-  const candidates = [
-    new URL(
-      "../../native/libdatachannel-min/build/Release/datachannel_min.node",
-      import.meta.url,
-    ),
-    new URL(
-      "../../../native/libdatachannel-min/build/Release/datachannel_min.node",
-      import.meta.url,
-    ),
-  ];
-  let lastErr: unknown;
-  for (const url of candidates) {
-    try {
-      // @ts-expect-error — .node modules are not typed; dynamic require via file URL
-      const mod = process.dlopen ? null : null;
-      void mod;
-      const nativePath = url.pathname;
-      // eslint-disable-next-line @typescript-eslint/no-require-imports
-      const req = createRequire(import.meta.url);
-      const binding = req(nativePath) as NativeBinding;
-      if (typeof binding.PeerConnection === "function") {
-        cached = binding;
-        return binding;
-      }
-    } catch (e) {
-      lastErr = e;
-    }
-  }
-  // Fallback: plain relative require (tsx / jest environments)
-  try {
-    const req = createRequire(import.meta.url);
-    const binding = req(
-      "../../native/libdatachannel-min/build/Release/datachannel_min.node",
-    ) as NativeBinding;
-    if (typeof binding.PeerConnection === "function") {
-      cached = binding;
-      return binding;
-    }
-  } catch (e) {
-    lastErr = e;
-  }
-  throw new Error(
-    `libdatachannel-min native binding not built (${String(lastErr)}). Run: cd native/libdatachannel-min && npx node-gyp rebuild`,
-  );
-}
-
-import { createRequire } from "node:module";
-
-/** True when the native binding is built — screen share stays disabled otherwise. */
-export function isNativeAvailable(): boolean {
-  try {
-    loadNative();
-    return true;
-  } catch {
-    return false;
-  }
-}

services/discord-gateway/src/goLive/prepareStream.ts

@@ -1,325 +0,0 @@
-/**
- * prepareStream & playStream — ported from @dank074/discord-video-stream
- * newApi.js (Encoders/prepareStream/playStream), but uses `child_process.spawn`
- * + ffmpeg CLI args directly instead of fluent-ffmpeg + node-av.
- *
- * Replaces the @dank074 video pipeline entirely:
- *   input (URL or Readable) → ffmpeg spawn → H264 AnnexB frames
- *   → Demuxer stream → VideoStream/AudioStream → WebRtcConnWrapper
- */
-
-import { type ChildProcess, spawn } from "node:child_process";
-import { existsSync, readdirSync } from "node:fs";
-import { join } from "node:path";
-import { PassThrough, type Readable } from "node:stream";
-import { demux } from "./Demuxer.js";
-import { type EncoderSettings, Encoders } from "./Encoders.js";
-import { VideoStream } from "./VideoStream.js";
-import type { WebRtcConnWrapper } from "./WebRtcWrapper.js";
-
-export interface PrepareStreamResult {
-  command: ChildProcess;
-  output: PassThrough;
-  encoder: () => Record<string, EncoderSettings>;
-  options: Record<string, unknown>;
-  videoCodec: string;
-  width: number;
-  height: number;
-  frameRate?: number;
-  includeAudio: boolean;
-}
-
-function isFiniteNonZero(n: unknown): n is number {
-  return typeof n === "number" && !!n && Number.isFinite(n);
-}
-
-const DEFAULT_HEADERS = {
-  "User-Agent":
-    "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/107.0.0.0 Safari/537.36",
-  Connection: "keep-alive",
-};
-
-/** Resolve ffmpeg binary (env override → PATH → Nix store ffmpeg-headless). */
-function resolveFfmpeg(): string {
-  if (process.env.FFMPEG_PATH && existsSync(process.env.FFMPEG_PATH)) {
-    return process.env.FFMPEG_PATH;
-  }
-  const store = "/nix/store";
-  if (existsSync(store)) {
-    const entries = readdirSync(store);
-    for (const entry of entries) {
-      if (!entry.includes("ffmpeg-headless-")) continue;
-      const candidate = join(store, entry, "bin", "ffmpeg");
-      if (existsSync(candidate)) return candidate;
-    }
-  }
-  return "ffmpeg";
-}
-
-const FFMPEG_BIN = resolveFfmpeg();
-
-/**
- * prepareStream — build an ffmpeg command (as spawn args + PassThrough output)
- * that transcodes the input into a pipe we can demux. Mirrors @dank074's
- * prepareStream but produces a raw spawn instead of a fluent-ffmpeg command.
- */
-export function prepareStream(
-  input: string | Readable,
-  options: Record<string, unknown> = {},
-): PrepareStreamResult {
-  const mergedOptions = {
-    noTranscoding: false,
-    width: isFiniteNonZero(options.width)
-      ? Math.round(options.width as number)
-      : -2,
-    height: isFiniteNonZero(options.height)
-      ? Math.round(options.height as number)
-      : -2,
-    frameRate:
-      isFiniteNonZero(options.frameRate) && (options.frameRate as number) > 0
-        ? options.frameRate
-        : undefined,
-    videoCodec: (options.videoCodec as string) ?? "H264",
-    bitrateVideo:
-      isFiniteNonZero(options.bitrateVideo) &&
-      (options.bitrateVideo as number) > 0
-        ? Math.round(options.bitrateVideo as number)
-        : 5000,
-    bitrateVideoMax:
-      isFiniteNonZero(options.bitrateVideoMax) &&
-      (options.bitrateVideoMax as number) > 0
-        ? Math.round(options.bitrateVideoMax as number)
-        : 7000,
-    bitrateAudio:
-      isFiniteNonZero(options.bitrateAudio) &&
-      (options.bitrateAudio as number) > 0
-        ? Math.round(options.bitrateAudio as number)
-        : 128,
-    includeAudio: options.includeAudio ?? true,
-    encoder:
-      (options.encoder as () => Record<string, EncoderSettings>) ??
-      Encoders.software(),
-    customHeaders: {
-      ...DEFAULT_HEADERS,
-      ...(options.customHeaders as Record<string, string> | undefined),
-    },
-    customInputOptions: (options.customInputOptions as string[]) ?? [],
-    customFfmpegFlags: (options.customFfmpegFlags as string[]) ?? [],
-    minimizeLatency: options.minimizeLatency ?? false,
-  };
-
-  const output = new PassThrough();
-
-  const args: string[] = [
-    "-hide_banner",
-    "-loglevel",
-    "error",
-    ...(typeof input === "string" ? ["-i", input] : ["-i", "pipe:0"]),
-    ...mergedOptions.customInputOptions,
-  ];
-
-  if (mergedOptions.minimizeLatency) {
-    args.push("-fflags", "nobuffer", "-analyzeduration", "0");
-  }
-
-  if (typeof input === "string" && input.startsWith("http")) {
-    const headerStr = Object.entries(mergedOptions.customHeaders)
-      .map(([k, v]) => `${k}: ${v}`)
-      .join("\r\n");
-    args.push(
-      "-headers",
-      headerStr,
-      "-reconnect",
-      "1",
-      "-reconnect_at_eof",
-      "1",
-      "-reconnect_streamed",
-      "1",
-      "-reconnect_delay_max",
-      "4294",
-    );
-  }
-
-  // Video
-  args.push("-map", "0:v:0");
-  if (mergedOptions.noTranscoding) {
-    args.push("-c:v", "copy");
-  } else {
-    args.push(`-vf`, `scale=${mergedOptions.width}:${mergedOptions.height}`);
-    if (mergedOptions.frameRate)
-      args.push("-r", String(mergedOptions.frameRate));
-    const enc = mergedOptions.encoder()[mergedOptions.videoCodec];
-    if (!enc)
-      throw new Error(
-        `Encoder settings not specified for ${mergedOptions.videoCodec}`,
-      );
-    // Encoder options are declared as single strings like "-forced-idr 1";
-    // spawn needs each flag and value as separate argv entries.
-    const encOptions = enc.options.flatMap((opt) =>
-      opt.split(/\s+/).filter(Boolean),
-    );
-    args.push(
-      "-b:v",
-      `${mergedOptions.bitrateVideo}k`,
-      "-maxrate:v",
-      `${mergedOptions.bitrateVideoMax}k`,
-      "-bufsize:v",
-      `${Math.round(mergedOptions.bitrateVideo / 2)}k`,
-      "-bf",
-      "0",
-      "-pix_fmt",
-      "yuv420p",
-      "-force_key_frames",
-      "expr:gte(t,n_forced*1)",
-      "-c:v",
-      enc.name,
-      ...encOptions,
-      ...(enc.globalOptions ?? []).flatMap((opt) =>
-        opt.split(/\s+/).filter(Boolean),
-      ),
-    );
-  }
-
-  // Audio
-  if (mergedOptions.includeAudio) {
-    args.push("-map", "0:a:0?");
-    args.push(
-      "-c:a",
-      "libopus",
-      "-b:a",
-      `${mergedOptions.bitrateAudio}k`,
-      "-ar",
-      "48000",
-      "-ac",
-      "2",
-    );
-  } else {
-    args.push("-an");
-  }
-
-  args.push(...mergedOptions.customFfmpegFlags);
-  args.push("-f", "h264", "pipe:1");
-
-  const isUrl = typeof input === "string";
-  const proc: ChildProcess = isUrl
-    ? spawn(FFMPEG_BIN, args, { stdio: ["ignore", "pipe", "pipe"] })
-    : spawn(FFMPEG_BIN, args, { stdio: ["pipe", "pipe", "pipe"] });
-
-  if (proc.stdin && !isUrl) {
-    input.on("data", (chunk: Buffer) => proc.stdin?.write(chunk));
-    input.on("end", () => proc.stdin?.end());
-    input.on("error", () => proc.stdin?.destroy());
-  }
-
-  proc.stdout?.pipe(output);
-  proc.stderr?.on("data", () => {
-    /* swallow ffmpeg stderr */
-  });
-  proc.on("error", (err) => {
-    // spawn failed (e.g. ffmpeg missing). If someone is consuming output
-    // (demux attaches an 'error' listener) propagate; otherwise just end.
-    if (output.listenerCount("error") > 0) {
-      output.destroy(err);
-    } else {
-      output.end();
-    }
-  });
-  proc.on("close", () => {
-    output.end();
-  });
-
-  return {
-    command: proc,
-    output,
-    encoder: mergedOptions.encoder,
-    options: mergedOptions,
-    videoCodec: mergedOptions.videoCodec,
-    width: mergedOptions.width,
-    height: mergedOptions.height,
-    frameRate: mergedOptions.frameRate,
-    includeAudio: !!mergedOptions.includeAudio,
-  };
-}
-
-export interface PlayStreamOptions {
-  type?: "go-live" | "video";
-  format?: string;
-  width?: number | ((v: unknown) => number);
-  height?: number | ((v: unknown) => number);
-  frameRate?: number | ((v: unknown) => number);
-  readrateInitialBurst?: number;
-  streamPreview?: boolean;
-}
-
-/**
- * playStream — demux the prepareStream output and pipe frames into the
- * WebRTC connection's video/audio streams. Resolves when the video stream
- * ends (natural EOF or the ffmpeg command is killed via cleanup/stop).
- */
-export async function playStream(
-  prepared: PrepareStreamResult,
-  streamer: { createStream: () => Promise<WebRtcConnWrapper> },
-  options: PlayStreamOptions = {},
-): Promise<void> {
-  const conn = await streamer.createStream();
-
-  const { video, close: demuxClose } = await demux(prepared.output, {
-    format: options.format ?? "nut",
-  });
-
-  if (!video) throw new Error("No video stream in media");
-
-  conn.setPacketizer(video.codecName);
-  conn.mediaConnection.setSpeaking(true);
-
-  const w =
-    typeof options.width === "function"
-      ? options.width(video)
-      : (options.width ?? video.width);
-  const h =
-    typeof options.height === "function"
-      ? options.height(video)
-      : (options.height ?? video.height);
-  const fr =
-    typeof options.frameRate === "function"
-      ? options.frameRate(video)
-      : (options.frameRate ??
-        (video.framerate_num / video.framerate_den || 30));
-
-  conn.mediaConnection.setVideoAttributes(true, {
-    width: Math.round(w),
-    height: Math.round(h),
-    fps: Math.round(fr),
-  });
-
-  const vStream = new VideoStream(conn);
-  video.stream.pipe(vStream);
-
-  const cleanup = () => {
-    try {
-      prepared.command.kill("SIGTERM");
-    } catch {
-      /* already dead */
-    }
-    demuxClose();
-    try {
-      conn.mediaConnection.setSpeaking(false);
-      conn.mediaConnection.setVideoAttributes(false);
-    } catch {
-      /* connection already torn down */
-    }
-  };
-
-  return new Promise<void>((resolve) => {
-    vStream.once("finish", () => {
-      cleanup();
-      resolve();
-    });
-    vStream.once("error", () => {
-      cleanup();
-      resolve();
-    });
-  });
-}
-
-export { Encoders };

services/discord-gateway/src/goLive/utils.ts

@@ -1,82 +0,0 @@
-/** GoLive helpers — ported from @dank074/discord-video-stream/utils.js. */
-
-export function normalizeVideoCodec(
-  codec: string,
-): "H264" | "H265" | "VP8" | "VP9" | "AV1" {
-  if (/H\.?264|AVC/i.test(codec)) return "H264";
-  if (/H\.?265|HEVC/i.test(codec)) return "H265";
-  if (/VP(8|9)/i.test(codec)) return codec.toUpperCase() as "VP8" | "VP9";
-  if (/AV1/i.test(codec)) return "AV1";
-  throw new Error(`Unknown codec: ${codec}`);
-}
-
-/**
- * The available video streams are sent by the client on connection to the
- * voice gateway using OpCode Identify (0); the server replies with the ssrc
- * and rtxssrc for each available stream using OpCode Ready (2). RID
- * distinguishes simulcast streams of the same video source — we only send one
- * quality stream, so a single entry is hardcoded.
- */
-export const STREAMS_SIMULCAST = [{ type: "screen", rid: "100", quality: 100 }];
-
-export const max_int16bit = 2 ** 16;
-export const max_int32bit = 2 ** 32;
-
-export function isFiniteNonZero(n: unknown): n is number {
-  return typeof n === "number" && !!n && Number.isFinite(n);
-}
-
-export interface ParsedStreamKey {
-  type: "guild" | "call";
-  channelId: string;
-  guildId: string | null;
-  userId: string;
-}
-
-export function parseStreamKey(streamKey: string): ParsedStreamKey {
-  const streamKeyArray = streamKey.split(":");
-  const type = streamKeyArray.shift();
-  if (type !== "guild" && type !== "call") {
-    throw new Error(`Invalid stream key type: ${type}`);
-  }
-  if (
-    (type === "guild" && streamKeyArray.length < 3) ||
-    (type === "call" && streamKey.length < 2)
-  ) {
-    throw new Error(`Invalid stream key: ${streamKey}`);
-  }
-  let guildId: string | null = null;
-  if (type === "guild") {
-    guildId = streamKeyArray.shift() ?? null;
-  }
-  const channelId = streamKeyArray.shift();
-  const userId = streamKeyArray.shift();
-  if (!channelId || !userId) {
-    throw new Error(`Invalid stream key: ${streamKey}`);
-  }
-  return { type, channelId, guildId, userId };
-}
-
-export function generateStreamKey(
-  type: "guild" | "call",
-  guildId: string | null,
-  channelId: string,
-  userId: string,
-): string {
-  return `${type}${type === "guild" ? `:${guildId}` : ""}:${channelId}:${userId}`;
-}
-
-export interface VoiceChannelLike {
-  type: string;
-  id: string;
-  guildId?: string | null;
-}
-
-export function isVoiceChannel(channel: VoiceChannelLike): boolean {
-  return (
-    channel.type === "DM" ||
-    channel.type === "GROUP_DM" ||
-    channel.type === "GUILD_STAGE_VOICE" ||
-    channel.type === "GUILD_VOICE"
-  );
-}

services/discord-gateway/src/modules/ai-moderation/ai-analysis-worker.ts

@@ -316,11 +316,13 @@ async function processBatch(job: {
   // The orchestrator handles text/media split + caching + parallel paths
   // internally, so a 20-message batch = 1 text LLM call (+1 media call
   // when media is present), not N per-message calls.
+  const analysisStart = Date.now();
   const moderationResult = await runModerationAnalysis({
     targets: readyMessages,
     contextBlock,
     attachments,
   });
+  const analysisDurationMs = Date.now() - analysisStart;
 
   const results = moderationResult.results.map((r) =>
     normalizeResult(
@@ -342,6 +344,7 @@ async function processBatch(job: {
       confidence: result.confidence,
       recommendedAction: result.recommendedAction,
       analyzedAt: Date.now(),
+      analysisDurationMs,
       error: result.status === "error" ? result.analysis : null,
     },
   }));

services/discord-gateway/src/modules/ai-moderation/aiAnalyzer.ts

@@ -136,9 +136,11 @@ export function startPendingAIAnalysisWorker(
   import("./cultureLearner.js")
     .then((m) => m.startCultureLearnerWorker())
     .catch(console.error);
-  import("./userProfileLearner.js")
-    .then((m) => m.startUserProfileLearnerWorker())
-    .catch(console.error);
+  if (config.AI_USER_PROFILE_LEARNING_ENABLED) {
+    import("./userProfileLearner.js")
+      .then((m) => m.startUserProfileLearnerWorker())
+      .catch(console.error);
+  }
 
   setInterval(() => {
     // [D] Periodic cache hygiene: purge expired moderation verdicts from

services/discord-gateway/src/modules/ai-moderation/autoDeleteManager.ts

@@ -10,6 +10,7 @@ import {
 } from "./autoDeleteEligibility.js";
 import { logDeletionToChannel } from "./autoDeleteLogger.js";
 import { sendDeletionNotification } from "./autoDeleteNotify.js";
+import { verdictToActionFields } from "./verdictToActionFields.js";
 
 const logger = createChildLogger("auto-delete-manager");
 
@@ -74,6 +75,23 @@ export async function resetOffensiveNickname(
       return false;
     }
     const member = await guild.members.fetch(userId);
+    // Discord rejects setNickname with "Missing Permissions" (code 50013)
+    // whenever the target's top role sits above the bot in the role
+    // hierarchy — even when the bot has MANAGE_NICKNAMES. Guard on
+    // `manageable` (hierarchy-aware) so we skip with a clear reason
+    // instead of hammering a doomed PATCH on every message.
+    if (!member.manageable) {
+      logger.debug(
+        {
+          messageId,
+          guildId,
+          userId,
+          reason: "target role above bot in hierarchy (Discord 50013)",
+        },
+        "Nick reset skipped: member not manageable by bot",
+      );
+      return false;
+    }
     // setNickname(null) = remove nickname → Discord shows global username
     await member.setNickname(null, "[auto] nickname melanggar aturan server");
     recentNicknameResets.set(cooldownKey, Date.now());
@@ -83,12 +101,17 @@ export async function resetOffensiveNickname(
     );
     return true;
   } catch (error) {
+    const errCode =
+      error instanceof Error && "code" in error
+        ? (error as { code?: number | string }).code
+        : undefined;
     logger.warn(
       {
         messageId,
         guildId,
         userId,
         error: error instanceof Error ? error.message : String(error),
+        code: errCode,
       },
       "Nick reset failed",
     );
@@ -152,6 +175,7 @@ async function logAutoDeleteAttempt(
       guild_id: message.guild_id,
       action_type: "delete_message",
       reason: result.reason,
+      ...verdictToActionFields(message),
       executed_by: "auto-delete-manager",
       status: result.deleted
         ? "executed"
@@ -216,6 +240,7 @@ export async function attemptAutoDeleteFlaggedMessage(
             action_type: "reset_nickname",
             reason:
               "nickname melanggar aturan server (offensive_username); pesan dibiarkan",
+            ...verdictToActionFields(message),
             executed_by: "auto-delete-manager",
             status: resetOk ? "executed" : "failed",
             error: resetOk ? null : "nickname_reset_failed",

services/discord-gateway/src/modules/ai-moderation/cacheStore.ts

@@ -0,0 +1,78 @@
+/**
+ * cacheStore.ts
+ *
+ * Shared Redis cache used by the AI-moderation modules (term glossary, etc.).
+ *
+ * Extracted when SearXNG was removed (replaced by the Wikipedia adapter in
+ * wikipediaClient.ts). The cache was never SearXNG-specific — it is a generic
+ * namespaced key/value store with graceful degradation when Redis is
+ * unavailable. Other modules import `makeCacheKey`, `cacheGet`, `cacheSet`,
+ * and `initCacheStore` instead of reaching into a search module.
+ */
+
+import Redis from "ioredis";
+import { createChildLogger } from "@/shared/logger/index";
+
+const log = createChildLogger("cache-store");
+
+const CACHE_PREFIX = "gmw:";
+const CACHE_TTL = 86400; // 24 hours (used as a sane default)
+
+let redis: Redis | null = null;
+
+/**
+ * Initialize the shared Redis connection for the moderation cache.
+ * Safe to call multiple times — only creates one connection.
+ * Degrades gracefully to `null` (no-cache) when Redis is unavailable.
+ */
+export function initCacheStore(redisUrl: string): void {
+  if (redis) return;
+  redis = new Redis(redisUrl, {
+    maxRetriesPerRequest: 3,
+    retryStrategy(times) {
+      const delay = Math.min(times * 200, 2000);
+      return delay;
+    },
+    lazyConnect: true,
+    enableReadyCheck: false,
+  });
+  redis.on("error", (err) => {
+    log.warn({ err: err.message }, "Cache Redis error");
+  });
+  redis.connect().catch(() => {
+    log.warn("Cache Redis unavailable — falling back to no-cache");
+    redis = null;
+  });
+  log.info("Cache Redis initialized");
+}
+
+/** Exposes the shared Redis connection; null when Redis is unavailable. */
+export function getCacheRedis(): Redis | null {
+  return redis;
+}
+
+/** Builds a namespaced cache key (shared across modules). */
+export function makeCacheKey(namespace: string, key: string): string {
+  return `${CACHE_PREFIX}${namespace}:${key.toLowerCase().trim()}`;
+}
+
+/** Reads a value from the cache; null on miss/unavailable. */
+export async function cacheGet(key: string): Promise<string | null> {
+  if (!redis) return null;
+  try {
+    return await redis.get(key);
+  } catch {
+    return null;
+  }
+}
+
+/** Writes a value to the cache, fire-and-forget. */
+export function cacheSet(key: string, value: string, ttlSeconds: number): void {
+  if (!redis) return;
+  redis.setex(key, ttlSeconds, value).catch(() => {
+    // Cache write failed silently
+  });
+}
+
+/** Default TTL (exposed for callers that want the standard window). */
+export const DEFAULT_CACHE_TTL = CACHE_TTL;

services/discord-gateway/src/modules/ai-moderation/llmCaller.ts

@@ -119,6 +119,7 @@ export async function callModerationLLM(
               {
                 error: state.lastParseError,
                 contentLength: rawContent.length,
+                contentPreview: rawContent.slice(0, 200),
                 targetIds,
                 model: config.AI_LLM_MODEL,
               },

services/discord-gateway/src/modules/ai-moderation/llmClient.ts

@@ -18,7 +18,20 @@ const log = createChildLogger("llm-client");
 // Concurrency limiter for LLM API calls (inlined from concurrencyLimiter.ts)
 // ---------------------------------------------------------------------------
 
-const llmSemaphore = pLimit(config.AI_LLM_MAX_CONCURRENT ?? 5);
+// The limiter is cached per configured concurrency value so it can be tuned
+// (env / BWS) without a code change and always reflects the current config —
+// a module-level `pLimit(config.X)` would freeze the cap at import time.
+let llmSemaphore = pLimit(config.AI_LLM_MAX_CONCURRENT ?? 5);
+let llmSemaphoreLimit = config.AI_LLM_MAX_CONCURRENT ?? 5;
+
+function getLlmSemaphore() {
+  const wanted = config.AI_LLM_MAX_CONCURRENT ?? 5;
+  if (wanted !== llmSemaphoreLimit) {
+    llmSemaphore = pLimit(wanted);
+    llmSemaphoreLimit = wanted;
+  }
+  return llmSemaphore;
+}
 
 let activeCount = 0;
 let pendingCount = 0;
@@ -30,7 +43,7 @@ export async function withLlmConcurrency<T>(fn: () => Promise<T>): Promise<T> {
     "Queuing LLM request",
   );
 
-  return llmSemaphore(async () => {
+  return getLlmSemaphore()(async () => {
     pendingCount--;
     activeCount++;
 
@@ -147,12 +160,78 @@ export interface LlmCallOpts {
   top_p?: number;
   /** Force JSON output via response_format: { type: "json_object" }. */
   jsonResponse?: { type: "json_object" };
+  /**
+   * Disable LLM chain-of-thought (reasoning/thinking) for faster analysis.
+   * Defaults to config.AI_LLM_DISABLE_THINKING when omitted.
+   */
+  disableThinking?: boolean;
   /** Extra retries beyond DEFAULT_RETRIES (default 2). */
   retries?: number;
   /** Whether to use streaming (if true, will consume stream and return aggregated result) */
   stream?: boolean;
   /** Optional AbortSignal to cancel the API request */
   signal?: AbortSignal;
+  /**
+   * Per-request timeout in ms. Falls back to the client-level default
+   * (60s) when omitted. Vision/image analysis passes a longer budget here
+   * so a single large-image call isn't killed early by the shared default.
+   */
+  timeout?: number;
+}
+
+/**
+ * Build the request params for an LLM chat completion. Pulled out of `llmChat`
+ * so the thinking-disable injection can be unit-tested without network access.
+ *
+ * Optional params (temperature/top_p/max_tokens) are only attached when
+ * explicitly provided, to maximise compatibility with various providers/local
+ * APIs. When `disableThinking` is set, we inject the common provider params
+ * used to switch OFF chain-of-thought reasoning. OpenAI-compatible routers
+ * ignore the variants their backend does not understand, so sending the
+ * OpenAI (`reasoning_effort`), OpenRouter (`reasoning.enabled`) and
+ * vLLM/Qwen/litellm (`chat_template_kwargs.enable_thinking`) forms together
+ * covers the popular reasoning backends behind a proxy.
+ */
+export function buildLlmParams(
+  opts: LlmCallOpts,
+  disableThinking: boolean,
+): OpenAI.Chat.Completions.ChatCompletionCreateParams {
+  const {
+    messages,
+    model = config.AI_LLM_MODEL,
+    max_tokens,
+    temperature,
+    top_p,
+    jsonResponse,
+    stream,
+  } = opts;
+
+  const params = {
+    model,
+    messages,
+    ...(stream !== undefined ? { stream } : {}),
+  } as OpenAI.Chat.Completions.ChatCompletionCreateParams;
+
+  if (temperature !== undefined) params.temperature = temperature;
+  if (top_p !== undefined) params.top_p = top_p;
+  if (max_tokens !== undefined) params.max_tokens = max_tokens;
+  if (jsonResponse) params.response_format = jsonResponse;
+
+  if (disableThinking) {
+    Object.assign(params, {
+      // OpenAI o-series
+      reasoning_effort: "none",
+      // OpenRouter
+      reasoning: { enabled: false },
+      // vLLM / Qwen / litellm
+      chat_template_kwargs: { enable_thinking: false },
+      // Anthropic / Claude-format (9router exposes thinkingFormat
+      // "claude-adaptive" / "claude-budget" on its reasoning models)
+      thinking: { type: "disabled" },
+    } as Record<string, unknown>);
+  }
+
+  return params;
 }
 
 /**
@@ -167,33 +246,12 @@ export async function llmChat(
   const client = getClient();
   if (!client) return null;
 
-  const {
-    messages,
-    model = config.AI_LLM_MODEL,
-    max_tokens,
-    temperature,
-    top_p,
-    jsonResponse,
-    retries = DEFAULT_RETRIES,
-    stream,
-    signal,
-  } = opts;
+  const { retries = DEFAULT_RETRIES, signal } = opts;
+  const disableThinking =
+    opts.disableThinking ?? config.AI_LLM_DISABLE_THINKING;
 
-  const params = {
-    model,
-    messages,
-    ...(stream !== undefined ? { stream } : {}),
-  } as OpenAI.Chat.Completions.ChatCompletionCreateParams;
-
-  // Attach optional parameters only if explicitly provided to maintain
-  // maximum compatibility with various LLM providers and local APIs.
-  if (temperature !== undefined) params.temperature = temperature;
-  if (top_p !== undefined) params.top_p = top_p;
-  if (max_tokens !== undefined) params.max_tokens = max_tokens;
-
-  if (jsonResponse) {
-    params.response_format = jsonResponse;
-  }
+  const params = buildLlmParams(opts, disableThinking);
+  const model = params.model;
 
   return retryWithBackoff(
     async () => {
@@ -203,6 +261,7 @@ export async function llmChat(
         ) => {
           const response = await client.chat.completions.create(currentParams, {
             signal,
+            ...(opts.timeout ? { timeout: opts.timeout } : {}),
           });
           if (currentParams.stream) {
             let content = "";
@@ -283,6 +342,12 @@ export async function llmChat(
  * Convenience for vision (image/sticker/emoji) analysis.
  * Returns the raw completion content (trimmed) or null.
  *
+ * Vision routes through the SAME router/base URL as text moderation
+ * (AI_LLM_BASE_URL) — the dedicated NVIDIA multimodal endpoint was removed.
+ * It uses AI_LLM_VISION_MODEL (a different model alias from the text combo)
+ * so image analysis stays on a vision-capable model. Thinking-disable from
+ * config.AI_LLM_DISABLE_THINKING applies automatically via buildLlmParams.
+ *
  * NOTE: retries are disabled here on purpose — visionAnalyzer.ts already
  * wraps this call in its own 3-attempt loop with exponential backoff.
  * A second retry layer would multiply worst-case API calls (3×3=9/image).
@@ -307,6 +372,7 @@ export async function llmVision(
     top_p: 0.9,
     retries: 0,
     stream: true, // router always streams SSE; non-stream waits for full body and times out
+    timeout: config.AI_LLM_VISION_ANALYSIS_TIMEOUT_MS ?? 60_000,
   });
 
   if (!completion) return null;

services/discord-gateway/src/modules/ai-moderation/mediaAnalysisClient.ts

@@ -6,7 +6,6 @@
  */
 export {
   acquireMediaAnalysisLock,
-  computeImagePhash,
   deleteCachedMediaAnalysis,
   getCachedMediaAnalysis,
   setCachedMediaAnalysis,

services/discord-gateway/src/modules/ai-moderation/mediaBatchProcessor.ts

@@ -16,10 +16,8 @@ import { getChannelCulture } from "./channelCultureStore.js";
 import type { RetryState } from "./llmCaller.js";
 import { callModerationLLM } from "./llmCaller.js";
 import { prepareMediaMessage } from "./mediaAnalysisClient.js";
-import { buildUserProfilesBlock } from "./moderationBuilders.js";
 import { buildSystemPrompt as buildSystemPromptModular } from "./moderationPrompt.js";
 import { buildCorrectedFewShotExamples } from "./textBatchProcessor.js";
-import { getUserProfile } from "./userProfileStore.js";
 
 const log = createChildLogger("mediaBatchProcessor");
 
@@ -65,32 +63,14 @@ export async function runMediaBatch(
     channelCulture,
   });
 
-  // Gather user profiles ONCE for the whole batch and emit a deduplicated
-  // <user_profiles> map (with last-generated timestamp); per-message blocks
-  // (from prepareMediaMessage) reference it via <user_profile_ref>.
-  const profileByUser = new Map<
-    string,
-    {
-      text: string;
-      asOf?: number | null;
-    }
-  >();
-  for (const t of targets) {
-    if (profileByUser.has(t.user_id)) continue;
-    const profile = await getUserProfile(t.user_id);
-    profileByUser.set(t.user_id, {
-      text: profile?.profile_summary ?? "",
-      asOf: profile?.last_analyzed_at ?? null,
-    });
-  }
-  const userProfilesBlock = buildUserProfilesBlock(profileByUser);
-
+  // Per-message blocks (from prepareMediaMessage) contain the message
+  // content + reference/reply context only — no per-user reputation or
+  // profile context is injected (kept minimal per user request).
   const messagesBlock = prepared.map((p) => p.messageBlock).join("\n");
   // Data/instruction separation: the system prompt is stable per mode — all
-  // per-batch context (profiles, conversation) lives in the USER payload,
-  // ordered oldest-first so targets come last.
+  // per-batch context (conversation) lives in the USER payload, ordered
+  // oldest-first so targets come last.
   const userBlocks = [
-    userProfilesBlock?.trimEnd() ?? "",
     contextBlock?.trimEnd() ?? "",
     `<messages_to_analyze>\n${messagesBlock}\n</messages_to_analyze>`,
   ].filter((b) => b.trim().length > 0);