cd4803ed51
Pierwszy backfill po niszach przy ~3 zapytaniach/s po ~65 zapytaniach wpadl w trwale 429 (cialo: delay 1167 s, subject per IP i endpoint) i przemielil 40 kolejnych nisz w bledach. Teraz: 1/s, odstep z Retry-After albo error.delay, powyzej 5 min RateLimited i koniec przebiegu (wznowienie --skip). |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| browse_latest.py | ||
| bulk_dedup.py | ||
| clips_ingest.py | ||
| deep_crawl.py | ||
| duration_backfill.py | ||
| hetzner_monitor.py | ||
| ingest_watchdog.py | ||
| jobs.py | ||
| junk_performers.py | ||
| performer_driven.py | ||
| phash_backfill.py | ||
| phash_blacklist.py | ||
| source_stats.py | ||
| tag_tail_trim.py | ||
| taxonomy_counts.py | ||
| thumb_dedup.py | ||
| title_duration_dedup.py | ||
| worker.py | ||