- Delete infrastructure/browser/ directory entirely (browser pool is gone) - Remove browser pool initialization from bootstrap - Remove fetch_via_browserless fallback from proxy_fetch - perform_proxy_chain now only uses relay endpoints - Clean up log messages, README, and compose env var The proxy-bun service at https://git.imrnes.team/MythEclipse/proxy-bun handles all proxy needs now.
55 lines
967 B
Markdown
55 lines
967 B
Markdown
# Scraper API
|
|
|
|
Backend service berbasis Axum untuk scraping, image proxy/cache, dan endpoint API inti.
|
|
|
|
## Stack
|
|
|
|
- Rust + Axum
|
|
- SeaORM (MySQL)
|
|
- Redis (deadpool-redis)
|
|
- Utoipa + Swagger UI
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
cargo run
|
|
```
|
|
|
|
Server bind ke `0.0.0.0:${PORT}` dengan default port `4091`.
|
|
|
|
## Required Environment Variables
|
|
|
|
```env
|
|
DATABASE_URL=mysql://asephs:hunterz@localhost:3306/sosmed
|
|
JWT_SECRET=change-me
|
|
REDIS_URL=redis://localhost:6379
|
|
```
|
|
|
|
Optional yang sering dipakai:
|
|
|
|
```env
|
|
RUST_LOG=info
|
|
MINIO_ENDPOINT=
|
|
MINIO_BUCKET_NAME=
|
|
MINIO_ACCESS_KEY=
|
|
MINIO_SECRET_KEY=
|
|
```
|
|
|
|
## Useful Endpoints
|
|
|
|
- `GET /docs` - Swagger UI
|
|
- `GET /api-docs/openapi.json` - OpenAPI JSON
|
|
- `GET /api/anime2/*`
|
|
- `GET /api/komik/*`
|
|
- `POST /api/proxy/image-cache`
|
|
- `POST /api/proxy/image-cache/audit`
|
|
|
|
## Notes
|
|
|
|
- Database akan dicek/dibuat saat startup jika `DATABASE_URL` bertipe MySQL.
|
|
- Service ini juga menginisialisasi browser pool dan scheduler saat boot.
|
|
|
|
## License
|
|
|
|
MIT
|