Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-25 06:33:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

re-add nofollow check

Browse source 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@2890 e7d03fd6-7b0d-0410-9947-9c21f3af8025
This commit is contained in:
calvin 2005-10-13 20:49:56 +00:00
parent 2d69003107
commit 8ce45149fa
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
linkcheck/checker/urlbase.py
View file

@ -481,6 +481,9 @@ class UrlBase (object):
if self.extern[0]:
linkcheck.log.debug(linkcheck.LOG_CHECK, "... no, extern.")
return False
if not self.content_allows_robots():
linkcheck.log.debug(linkcheck.LOG_CHECK, "... no, robots.")
return False
linkcheck.log.debug(linkcheck.LOG_CHECK, "... yes.")
return True