Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-03 04:14:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
linkchecker/linkcheck/ftests/data/norobots.html

3 lines
76 B
HTML
Raw Normal View History

added robots.txt test git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1583 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:45 +00:00
<meta name="robots" content="nofollow">
<a href="do_not_check.html">bla</a>
Reference in a new issue Copy permalink