docs: update all markdown files, switch remote to Gitea
Deploy to VPS / deploy (push) Failing after 34s
Deploy to VPS / deploy (push) Failing after 34s
- Update root README.md: remove Leptos/WASM/SQLite, document Next.js - Update frontend README.md: replace create-next-app boilerplate - Update frontend AGENTS.md: project-specific overview - Update CLAUDE.md: remove all auth references - Update backend ARCHITECTURE.md: remove adminAuth from middleware list - Switch git remote from gitlab to gitea (origin → gitea)
This commit is contained in:
asepharyana
@@ -1,215 +1,118 @@
|
||||
# Discord Moderation Watcher Bot
|
||||
# Bete — Discord Moderation Dashboard
|
||||
|
||||
Bot monitoring Discord yang merekam voice channel, menangkap pesan teks, menyimpan attachment, menjalankan analisis opsional, dan menyediakan dashboard web real-time.
|
||||
Bot monitoring Discord yang merekam voice channel, menangkap pesan teks, menyimpan attachment, menjalankan analisis AI opsional, dan menyediakan dashboard web real-time.
|
||||
|
||||
Stack utama: Node.js, pnpm, TypeScript, `discord.js-selfbot-v13`, `@discordjs/voice`, Express, WebSocket, Drizzle ORM, SQLite/PostgreSQL, React, Vite, Vitest, dan Biome.
|
||||
**Stack utama:** Node.js (Express 5), pnpm, TypeScript, React 19 (Next.js 16), Tailwind v4, shadcn/ui, Drizzle ORM, PostgreSQL, WebSocket, Redis pub/sub.
|
||||
|
||||
## Prasyarat
|
||||
|
||||
- Node.js versi modern yang kompatibel dengan TypeScript dan Vite.
|
||||
- pnpm 10.x. Repo ini dipin ke `pnpm@10.25.0`.
|
||||
- FFmpeg tersedia di `PATH` untuk proses muxing audio dan playback media.
|
||||
- `yt-dlp` tersedia di `PATH` untuk resolve audio YouTube, search result YouTube, dan Spotify track.
|
||||
- Native audio dependencies dapat dibuild di mesin lokal (`@discordjs/opus`, `better-sqlite3`, `sodium-native`).
|
||||
|
||||
Install FFmpeg:
|
||||
|
||||
```bash
|
||||
# Ubuntu/Debian
|
||||
sudo apt install ffmpeg
|
||||
|
||||
# Arch
|
||||
sudo pacman -S ffmpeg
|
||||
```
|
||||
|
||||
Install `yt-dlp`:
|
||||
|
||||
```bash
|
||||
pnpm run install:yt-dlp
|
||||
```
|
||||
|
||||
Script installer akan memakai package manager yang tersedia (`pacman`, `apt-get`, `dnf`, `brew`) atau fallback ke `pipx`/`pip`.
|
||||
- Node.js 22+
|
||||
- pnpm 11.x
|
||||
- FFmpeg di `PATH` (untuk audio muxing dan playback media)
|
||||
- `yt-dlp` di `PATH` (untuk resolve audio YouTube/Spotify)
|
||||
- Bun (untuk frontend dev — opsional, bisa pake pnpm)
|
||||
- PostgreSQL 15+
|
||||
|
||||
## Setup
|
||||
|
||||
```bash
|
||||
pnpm install
|
||||
cp .env.example .env
|
||||
# Edit .env sesuai konfigurasi server
|
||||
```
|
||||
|
||||
Edit `.env` sesuai server yang dimonitor:
|
||||
|
||||
```env
|
||||
DISCORD_TOKEN=your_token_here
|
||||
MONITOR_GUILD_ID=your_guild_id_here
|
||||
RECORDINGS_DIR=./recordings
|
||||
WEBSERVER_PORT=3000
|
||||
DATABASE_TYPE=sqlite
|
||||
```
|
||||
|
||||
Catatan: project ini memakai selfbot library, bukan bot token Discord standar. Pastikan penggunaan sesuai risiko dan aturan platform yang berlaku.
|
||||
|
||||
## Menjalankan
|
||||
|
||||
```bash
|
||||
# Bot/server utama dengan auto-restart
|
||||
pnpm run dev
|
||||
# Backend (port 3001)
|
||||
pnpm run dev:backend
|
||||
|
||||
# Production-style start
|
||||
pnpm run start
|
||||
# Discord Gateway (capture messages, voice, dll)
|
||||
pnpm run dev:discord-gateway
|
||||
|
||||
# Dashboard frontend dev server
|
||||
# Frontend (port 3000)
|
||||
pnpm run dev:web
|
||||
```
|
||||
|
||||
Dashboard build production disajikan dari `public/app` setelah menjalankan:
|
||||
## Build
|
||||
|
||||
```bash
|
||||
pnpm run build:web
|
||||
pnpm run build:backend
|
||||
pnpm run build:discord-gateway
|
||||
pnpm run build:web # next build — static export ke out/
|
||||
pnpm run build # build semua service
|
||||
```
|
||||
|
||||
## Command Development
|
||||
## Deploy
|
||||
|
||||
```bash
|
||||
# Type checking
|
||||
pnpm run typecheck
|
||||
|
||||
# Lint
|
||||
pnpm run lint
|
||||
|
||||
# Format
|
||||
pnpm run format
|
||||
|
||||
# Test
|
||||
pnpm run test
|
||||
|
||||
# Build frontend + TypeScript
|
||||
pnpm run build
|
||||
|
||||
# Install external yt-dlp CLI for YouTube/search/Spotify track playback
|
||||
pnpm run install:yt-dlp
|
||||
./deploy.sh # Build + deploy semua service ke VPS
|
||||
./deploy.sh --frontend # Frontend only
|
||||
./deploy.sh --backend # Backend only
|
||||
./deploy.sh --no-build # Skip build, copy files aja
|
||||
```
|
||||
|
||||
## Database
|
||||
## Service Architecture
|
||||
|
||||
Default database adalah SQLite di `.muxer-queue.db`. PostgreSQL dapat dipakai dengan `DATABASE_TYPE=postgres` dan konfigurasi `DATABASE_URL` atau variabel `POSTGRES_*`.
|
||||
|
||||
Jika aplikasi dijalankan di PostgreSQL production, migrasi dapat dijalankan otomatis saat startup dengan `AUTO_MIGRATE_ON_STARTUP=true`. Jalur ini memakai advisory lock supaya hanya satu instance yang memigrasi schema pada satu waktu.
|
||||
|
||||
```bash
|
||||
# Generate migration Drizzle
|
||||
pnpm run db:generate
|
||||
|
||||
# Jalankan migration via drizzle-kit
|
||||
pnpm run db:migrate
|
||||
|
||||
# Jalankan migration programmatic
|
||||
pnpm run db:migrate:programmatic
|
||||
|
||||
# Buka Drizzle Studio
|
||||
pnpm run db:studio
|
||||
```
|
||||
Discord
|
||||
|
|
||||
v
|
||||
discord-gateway ←→ Redis ←→ backend (Express 5) ←→ frontend (Next.js)
|
||||
| pub/sub | |
|
||||
| +— REST API (/api/*) |
|
||||
| +— WebSocket (/ws) |
|
||||
+— message capture +— AI moderation |
|
||||
+— voice recording +— dashboard data +— dashboard UI
|
||||
+— attachment upload +— real-time updates
|
||||
```
|
||||
|
||||
## Fitur
|
||||
|
||||
- Voice recording ke segment `.ogg` per user.
|
||||
- Metadata JSON per segment audio.
|
||||
- Text message capture untuk pesan baru, edit, dan delete.
|
||||
- Attachment capture dan upload ke endpoint Picser.
|
||||
- SQLite/PostgreSQL via Drizzle ORM.
|
||||
- REST API dan WebSocket untuk dashboard.
|
||||
- Dashboard React untuk pesan, gambar, voice, media playback, dan moderation review.
|
||||
- Media playback dari direct URL, file lokal, YouTube URL, search terms, dan Spotify track URL.
|
||||
- Metrics Prometheus di endpoint server.
|
||||
- Retry dengan backoff untuk operasi eksternal.
|
||||
- AI moderation analysis opsional via konfigurasi `AI_*`.
|
||||
|
||||
## Struktur Rekaman
|
||||
|
||||
```text
|
||||
recordings/
|
||||
<user-id>/
|
||||
<user-id>-<session-start>-0.ogg
|
||||
<user-id>-<session-start>-0.json
|
||||
<user-id>-<session-start>-1.ogg
|
||||
<user-id>-<session-start>-1.json
|
||||
```
|
||||
|
||||
Segment duration dikontrol oleh `RECORDING_SEGMENT_MS`.
|
||||
- **Message capture**: Capture pesan baru, edit, dan delete dari Discord
|
||||
- **Voice recording**: Rekam voice channel ke segmen OGG per user, streaming PCM real-time ke WebSocket
|
||||
- **Attachment upload**: Download + upload attachment ke external storage
|
||||
- **AI moderation**: Analisis pesan opsional via LLM, auto-delete, queue management
|
||||
- **Dashboard**: Messages feed, AI analysis review, voice connection, music player, recordings, user/channel stats
|
||||
- **Media playback**: Playback dari URL, file lokal, YouTube, Spotify
|
||||
- **WebSocket**: Real-time event streaming untuk semua aktivitas
|
||||
- **Public API**: Semua endpoint REST dan WebSocket dapat diakses tanpa autentikasi
|
||||
|
||||
## Struktur Proyek
|
||||
|
||||
```text
|
||||
src/
|
||||
index.ts Entry point Discord client dan server
|
||||
recorder.ts Voice recording pipeline
|
||||
recorder/ Audio stream, decoder, segment metadata
|
||||
moderation/ Message capture, storage, uploads, AI review
|
||||
database/ Drizzle setup, schema, migrations
|
||||
routes/ Express route modules
|
||||
webserver.ts Express + WebSocket server
|
||||
retry.ts Retry helper berbasis p-retry
|
||||
audio/ffmpegProcess.ts Direct ffmpeg process wrapper
|
||||
frontend/ React dashboard source
|
||||
public/app/ Dashboard build output
|
||||
tests/ Vitest tests
|
||||
drizzle/migrations/ Database migrations
|
||||
```
|
||||
services/
|
||||
├── backend/ # Express 5 REST API + WebSocket server
|
||||
│ ├── src/modules/ # Feature modules (messages, voice, media, dll)
|
||||
│ └── src/http/ # Express app setup, middleware
|
||||
├── discord-gateway/ # Discord client, voice recording, AI analysis
|
||||
│ ├── src/modules/ # message-capture, voice-recording, ai-moderation
|
||||
│ └── src/shared/ # Config, database, Discord client
|
||||
└── frontend/ # Next.js 16 dashboard (static export)
|
||||
├── src/app/ # Pages (login, dashboard tabs)
|
||||
├── src/features/ # Feature components (dashboard, live, messages)
|
||||
└── src/lib/ # API client, WebSocket, types
|
||||
packages/
|
||||
└── shared/ # Shared types, errors, logger, utilities
|
||||
```
|
||||
|
||||
## Konfigurasi Penting
|
||||
## Database
|
||||
|
||||
Lihat `.env.example` untuk daftar lengkap. Variabel utama:
|
||||
|
||||
- `DISCORD_TOKEN` — token akun/client yang dipakai selfbot.
|
||||
- `MONITOR_GUILD_ID` — guild yang dimonitor untuk moderation capture.
|
||||
- `RECORDINGS_DIR` — direktori output audio.
|
||||
- `WEBSERVER_PORT` — port HTTP/WebSocket.
|
||||
- `DATABASE_TYPE` — `sqlite` atau `postgres`.
|
||||
- `PICSER_UPLOAD_URL` — endpoint upload attachment.
|
||||
- `AI_ANALYSIS_ENABLED` — aktifkan/nonaktifkan analisis AI.
|
||||
- `AI_LLM_API_KEY`, `AI_LLM_BASE_URL`, `AI_LLM_MODEL` — konfigurasi provider LLM.
|
||||
|
||||
## Deploy ke VPS
|
||||
|
||||
Project menggunakan `deploy.sh` untuk build + deploy manual ke VPS. Script ini
|
||||
membangun backend (TypeScript) dan frontend (WASM Leptos) lalu menyalinnya ke
|
||||
dalam container Docker yang sudah berjalan di VPS.
|
||||
PostgreSQL via Drizzle ORM. Migrasi:
|
||||
|
||||
```bash
|
||||
# Build + deploy semua service
|
||||
./deploy.sh
|
||||
|
||||
# Deploy frontend saja (setelah perubahan UI)
|
||||
./deploy.sh --frontend
|
||||
|
||||
# Deploy backend saja
|
||||
./deploy.sh --backend
|
||||
|
||||
# Deploy tanpa rebuild (file sudah terbuild sebelumnya)
|
||||
./deploy.sh --no-build
|
||||
pnpm run db:generate # Generate migration
|
||||
pnpm run db:migrate # Apply migration
|
||||
pnpm run db:studio # Drizzle Studio
|
||||
```
|
||||
|
||||
Credentials diambil otomatis dari GitLab CI variables via `glab`. Atau set manual:
|
||||
## WebSocket Events
|
||||
|
||||
```bash
|
||||
export VPS_HOST="your-vps-ip"
|
||||
export VPS_USER="root"
|
||||
export VPS_SSH_KEY="~/.ssh/id_ed25519"
|
||||
./deploy.sh
|
||||
```
|
||||
Backend broadcast event berikut ke frontend via WebSocket:
|
||||
|
||||
## Verifikasi Setelah Perubahan
|
||||
|
||||
Sebelum menjalankan lama atau deploy, jalankan:
|
||||
|
||||
```bash
|
||||
pnpm install
|
||||
pnpm run typecheck
|
||||
pnpm run lint
|
||||
pnpm run test
|
||||
pnpm run build
|
||||
```
|
||||
|
||||
## Catatan Library Modernization
|
||||
|
||||
Project memakai Zod untuk validasi runtime, Drizzle untuk database, dan wrapper `node:child_process` langsung untuk FFmpeg. Library lama `class-transformer`, `class-validator`, dan `fluent-ffmpeg` sudah tidak dipakai.
|
||||
- `message_created`, `message_updated`, `message_deleted`, `message_analyzed`
|
||||
- `attachment_created`, `attachment_uploaded`
|
||||
- `voice_recording_started`, `voice_recording_stopped`, `voice_recording_uploaded`
|
||||
- `voice_active_user`, `voice_pcm_data`
|
||||
- `media_state`
|
||||
- `reaction_*`, `thread_*`, `presence_updated`, `guild_member_*`
|
||||
|
||||
Reference in New Issue
Block a user