Marius Gedminas 4f3fe5e1c3 Make sure fetching robots.txt uses the configured timeout ... Closes #396.		2020-05-22 10:53:33 +03:00
..
__init__.py	Remove # -*- coding: lines	2020-05-08 10:45:31 +01:00
results.py	Remove inheriting object	2020-05-08 10:45:31 +01:00
robots_txt.py	Make sure fetching robots.txt uses the configured timeout	2020-05-22 10:53:33 +03:00
urlqueue.py	Remove spaces after names in class method definitions	2020-05-16 20:19:42 +01:00