Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-04 12:54:42 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Properly detect a callable object in robots.txt callback

Browse source
This commit is contained in:
Bastian Kleineidam 2009-03-06 20:10:26 +01:00
parent 6024f2e43e
commit 0afd5f7cc6
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
linkcheck/cache/robots_txt.py vendored
View file

@ -45,7 +45,7 @@ class RobotsTxt (object):
password=password)
rp.set_url(roboturl)
rp.read()
if callback is not None:
if hasattr(callback, '__call__'):
parts = urlutil.url_split(rp.url)
host = "%s:%d" % (parts[1], parts[2])
useragent = configuration.UserAgent