nianzhibai ec5a01b6aa feat(crawler): redesign crawler scripts and admin workflow ...

- add generic scriptcrawler backend runner using the crawler.v1 JSONL protocol

- support crawler script upload and HTTP(S) URL import from the admin crawler page

- simplify the user-facing crawler contract to title, media_url, optional thumbnail_url and optional source_id

- convert Spider91 into a normal script crawler and reject new Spider91 storage-drive configs

- keep legacy Spider91 storage rows visible only for cleanup/deletion

- add crawler protocol docs, example script, admin UI, tests and migration coverage

2026-06-09 23:51:12 +08:00

..

spider_91porn.py

feat(crawler): redesign crawler scripts and admin workflow

2026-06-09 23:51:12 +08:00