14 commits

Author	SHA1	Message	Date
Chris Mayo	8678feaa59	Make TestRobotsTxt Python 3.7 compatible ... urllib.parse.quote() moved from RFC 2396 to RFC 3986 for quoting URL strings. "~" is now included in the set of reserved characters. https://docs.python.org/3/library/urllib.parse.html#urllib.parse.quote	2019-04-22 19:50:32 +01:00
Bastian Kleineidam	b17211f162	Set for release.	2014-03-04 21:36:24 +01:00
Bastian Kleineidam	6f205a2574	Support checking Sitemap: URLs in robots.txt files.	2014-03-01 20:25:19 +01:00
Bastian Kleineidam	0e4d6f6e1a	Parse sitemap urls in robots.txt files.	2014-03-01 19:57:57 +01:00
Bastian Kleineidam	cff97b9718	Updated copyright.	2012-09-21 21:13:00 +02:00
Bastian Kleineidam	f6b007f757	Fix useragent matching in robots.txt parser.	2012-09-21 21:12:13 +02:00
Bastian Kleineidam	c4c098bd83	pep8-ify the source a little more	2010-03-13 08:47:12 +01:00
Bastian Kleineidam	563b057a4d	Updated copyright year; fix nntp newsserver test	2010-03-05 12:49:54 +01:00
Bastian Kleineidam	92f8911d88	Use non-deprecated assert methods for unit testing	2010-03-05 10:00:34 +01:00
Bastian Kleineidam	5e06b6b8d4	Updated FSF address in GPL blurb	2009-07-24 23:58:20 +02:00
Bastian Kleineidam	84a6bb3464	Fix robotparser tests	2009-02-24 11:49:06 +01:00
calvin	1f803fd80c	Run tests with nosetests ... git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3941 e7d03fd6-7b0d-0410-9947-9c21f3af8025	2009-01-28 23:12:03 +00:00
calvin	e9805dbd8a	Updated copyright year to 2009 ... git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3887 e7d03fd6-7b0d-0410-9947-9c21f3af8025	2009-01-08 14:18:03 +00:00
calvin	9352dbf5e4	Move test files to separate module ... git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@3763 e7d03fd6-7b0d-0410-9947-9c21f3af8025	2008-05-20 17:01:16 +00:00

Renamed from linkcheck/tests/test_robotstxt.py (Browse further)