Commit Graph

27 Commits

Author SHA1 Message Date
achmad e17de903b2 refactor: use flare client for sources with cloudflareClient in Kotlin
- Batch 5: mangawork, mangotheme, mccms, multichan → flare (Kotlin uses cloudflareClient)
- Batch 6: natsuid → flare (Kotlin uses cloudflareClient)
- Batch 7: gravureblogger → flare (Kotlin uses cloudflareClient)

All verified against Kotlin multisrc reference.
2026-05-13 21:57:34 +07:00
achmad 71ef2d24fa fix: update HTTP client to flare for Batch 4 sources
Based on Kotlin reference verification:
- madtheme, mangabox, mangacatalog, mangahub → flare

Also updated phase4-standalone.md with project requirement for
checking HTTP client type when porting sources from Kotlin
2026-05-13 21:35:10 +07:00
achmad 46f930718c fix: update HTTP client to flare for misclassified sources
Based on Kotlin reference verification:
- Batch 1: colorlibanime, eromuse, fansubscat → flare
- Batch 2: fmreader, galleryadults, greenshit, grouple → flare
- Batch 3: heancms, lectormoe → flare

Also renamed methods appropriately:
- get() for HTML scraping
- getJSON() for JSON APIs
2026-05-13 10:07:09 +07:00
achmad 9a42dd2ab1 refactor: use per-source HTTP client instead of global proxy
- Remove global ProxyEnabled() logic from httpclient
- Each source now explicitly chooses client at import time:
  - flare client: for JS-rendering/cloudflare sources
  - normal httpclient: for REST API sources
- Updated 29 base sources based on Kotlin reference (network.cloudflareClient)
2026-05-13 09:01:51 +07:00
Achmad b199bad30d refactor: separate httpclient packages for regular and FlareSolverr sources
- Add internal/httpclient/flare package for Cloudflare-protected sites
- Update 7 bases (madara, zmanga, mangaworld, mangathemesia, mangareader,
  libgroup, liliana) to use flare client
- Remove unused internal/config/source.go
2026-05-11 10:48:05 +00:00
Achmad 308d66bd36 update 2026-05-11 10:20:40 +00:00
Achmad 56e910b687 chore: rename compose files for dev/prod split
- compose.yml is now for development (default)
- compose-prod.yml is for production
2026-05-11 10:19:58 +00:00
Achmad 376fc0743a chore: update dev env config
- Add FLARESOLVERR_LOG_LEVEL and FLARESOLVERR_PROXY to .env.example
- Change default port to 3300 in dev.env
- Make compose-dev.yml use ADDR env var for host port
- Enable FLARESOLVERR_PROXY by default in dev.env for testing
2026-05-11 09:31:54 +00:00
Achmad b992080c95 feat: add FlareSolverr proxy support with DB-backed config
- Add config table for storing FlareSolverr proxy setting
- Add HTTP endpoints to get/set proxy status (GET/POST /api/config/flaresolverr)
- Refactor httpclient to support proxy mode (requests go through FlareSolverr)
- Add verbose logging for debugging
- Add POST support to FlareSolverr client

Usage:
  GET /api/config/flaresolverr - returns {flaresolverr_proxy: bool}
  POST /api/config/flaresolverr - body: {enabled: true/false}
2026-05-11 09:25:48 +00:00
Achmad 3741f4f696 change perms 2026-05-11 06:48:23 +00:00
Achmad 63b3f84464 change port for dev compose 2026-05-11 06:45:36 +00:00
achmad 1f7e229493 phase4: add standalone source wrappers and mark checklist progress
Register new all/en standalone wrappers from base sources and add initial smoke tests; several sources are still unverified in live environment.
2026-05-11 13:36:36 +07:00
achmad 90fd773ff1 dev: add make targets for standalone smoke tests 2026-05-11 13:35:58 +07:00
achmad 0c6ccc8a47 dev: add Docker compose development stack with Air reload 2026-05-11 08:39:54 +07:00
achmad 15d9d4225c phase3: add scanr, sinmh, spicytheme, stalkercms, uzaymanga, vercomics, yuyu, zeistmanga bases (68/68)
- Implement 8 remaining base sources
- All 68 bases now compile successfully
- Update TODO.md and phase3-bases.md checklist
2026-05-11 07:48:15 +07:00
achmad 4568edd32d phase3: add natsuid, oceanwp, paprika, peachscan, raijinscans bases (60/68) 2026-05-11 07:21:07 +07:00
achmad 97105640ce phase3: add manhwaz, masonry, mccms, monochrome, multichan bases (55/68) 2026-05-11 07:14:30 +07:00
achmad 409dd0bc5f phase3: add manga18, mangacatalog, mangabox, mangataro, mangawork bases (50/68) 2026-05-11 07:09:04 +07:00
achmad 50ac3f180a phase3: add gravureblogger, greenshit, hotcomics, initmanga, keyoapp bases (45/68) 2026-05-11 06:59:53 +07:00
achmad 224266ffe3 phase3: implement fansubscat, fuzzydoodle, galleryadults, gattsu, goda 2026-05-11 06:45:48 +07:00
achmad 1e6d72b046 phase3: implement colorlibanime, comicaso, comiciviewer, eromuse, ezmanhwa
5 bases: HTML scraping, static JSON index, Japanese viewer API,
album-stack crawl, and JSON REST. 35/68 bases done.
2026-05-10 22:20:17 +07:00
achmad ca609ccae7 phase3: implement first 20 base sources + shared util
Ports bases from previous session:
util (shared helpers), bakkin, fmreader, foolslide, gigaviewer,
gmanga, grouple, guya, heancms, hentaihand, kemono, madara,
madtheme, mangadventure, mangahub, mangathemesia, mangaworld,
mmrcms, senkuro, wpcomics.
2026-05-10 22:15:11 +07:00
achmad f0658472f3 phase3: implement 10 complex base sources
Ports all remaining ⚠️ annotated bases from the phase3 checklist:
zmanga, mangareader, liliana, lectormoe, iken, pizzareader,
mangotheme (AES/CBC decrypt), libgroup (bearer token auth),
scanreader (WP AJAX chapters), mmlook (CF + packed JS pages).

Updates docs/phase3-bases.md to mark all 10 as [x].
2026-05-10 22:14:04 +07:00
achmad 6d084d3df0 docs: move deferred Phase 2 tasks to Phase 5 where they belong 2026-05-10 21:37:58 +07:00
achmad be46add182 chore: add .env.example and wire compose.yml to env vars
- .env.example documents all env vars with defaults (postgres creds, DATABASE_URL, TTLs, pool sizes)
- compose.yml reads postgres credentials and app config from .env via env_file
- .gitignore: track .env.example, ignore .env
2026-05-10 21:35:31 +07:00
achmad 95cab106d8 feat: Phase 2 — database layer
- PostgreSQL schema: sources, manga, chapters, pages, source_meta with indexes
- golang-migrate runner with embedded SQL via go:embed (pgx5:// scheme)
- sqlc-generated type-safe queries for all tables (pgx/v5 native)
- Config package with all env vars including TTL durations
- Wire DB init and config into cmd/server/main.go
2026-05-10 21:32:40 +07:00
achmad 85d2ea6143 feat: initial Phase 1 implementation — core framework + Docker
- Data types (SManga, SChapter, Page, MangasPage, all Filter variants)
- Source interfaces (Source, CatalogueSource) with MD5-based ID generation matching Tachiyomi/Suwayomi
- HTTP client with per-host rate limiting, cookie jar, and 429 retry
- FlareSolverr v1 client (FLARESOLVERR_URL env)
- Generic GraphQL POST helper
- goquery HTML parser wrappers
- Source registry (panics on duplicate ID)
- Multi-stage Dockerfile (golang:1.26-alpine + distroless) and compose.yml (postgres, flaresolverr, app)
2026-05-10 21:24:38 +07:00