User:Legoktm/parsoid re-parse
Appearance
Copy https://git.legoktm.com/legoktm/parsoid-reparse/raw/master/parsoid-reparse/__init__.py to somewhere on terbium, let's say ~/parsoid_reparse.py(This version is old and needs additional patches to be merged)- Copy ~ssastry/linter-reparse.py on terbium.eqiad.wmnet to somewhere else, say ~/parsoid_reparse.py
python3 parsoid_reparse.py http://parsoid.discovery.wmnet:8000 --sitematrix --linter-only --skip-closed https://aa.wikipedia.org/w/api.php --start https://ce.wikipedia.org/w/api.php
- Probably in a screen or via nohup
- If it dies you can use
--resume Last_Page_Name
in addition with--start
.
Additional useful arguments:
--numthreads N
to control number of threads (default is 2)--timeout N
to set request timeout to N seconds (default is 60)--numretries N
to set number of request retries to N (default is 3)