Commit graph

2 commits

Author SHA1 Message Date
calvin
bb8bca1b70 Add non-ascii values to test robots.txt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3851 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2008-07-13 13:01:59 +00:00
calvin
4ec74f6f5c added robots.txt tests for the internal HTTP server
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3232 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2006-05-17 15:47:48 +00:00