Petr Dlouhý
c1ab81627e
test of correct logging of all parts in url_data
2018-01-14 17:17:07 +01:00
Petr Dlouhý
0a13fae3b4
remove third party packages and use them as dependency
2018-01-09 23:25:27 +01:00
Philipp Hahn
1368643a50
Fix fragment identifier quoting
...
According to <https://tools.ietf.org/html/rfc3986 >:
fragment = *( pchar / "/" / "?" )
pchar = unreserved / pct-encoded / sub-delims / ":" / "@"
unreserved = ALPHA / DIGIT / "-" / "." / "_" / "~"
pct-encoded = "%" HEXDIG HEXDIG
sub-delims = "!" / "$" / "&" / "'" / "(" / ")" / "*" / "+" / "," / ";" / "="
Fixes #96
2017-11-10 08:03:03 -05:00
Petr Dlouhý
f5100138ff
fix tests that fail because of changed linkchecker output
2017-02-14 10:59:38 +01:00
Marius Gedminas
743a5f31cb
Crawl HTML attributes in deterministic order
...
Fixes #17 .
2017-02-01 19:19:53 +02:00
Marius Gedminas
a825b9d901
Mark the non-deterministic test as xfail
2017-02-01 18:57:40 +02:00
Marius Gedminas
02869ea076
Mark TestFile.test_directory_listing as known to fail
...
The test unzipps a zip file with a weird-looking non-ASCII filename in it.
I don't think zip files specify the encoding for filenames. Different
unzip utilities may interpret the filename differently. Plus, the byte
representation of the unzipped filename may be different depending on
the filesystem charset.
To me it looks as if the filename is garbage encoded as valid UTF-8, and
the test expectation is to get it in latin-1 or something.
2017-02-01 18:45:05 +02:00
Marius Gedminas
cffea5fcbd
Mark TestHttps.test_https as known to fail
...
This test depends on the way http://amazon.com/ works. I don't think
that's a good idea.
2017-02-01 18:44:21 +02:00
Marius Gedminas
f4ec7531c1
Fix TestHttp.test_html
...
The HTML tag has two attributes with URLs:
<applet archive="file.html" src="file.css">
It would appear that the order in which these attributes are crawled
does not match the order in the result file.
Possibly the crawling order is non-deterministic, although I cannot
reproduce that. If that's the case, the fix would be to sort the
attributes in the crawler before following them, which means we want the
expected results sorted as well (and since 'archive' comes before 'src',
so file.html should come before file.css).
2017-02-01 18:41:47 +02:00
Bastian Kleineidam
88c060699d
Fix tests
2016-01-19 22:05:15 +01:00
Bastian Kleineidam
914995b5fc
Use example.com for tests.
2016-01-19 12:17:08 +01:00
Vadim Khohlov
d4352fc828
Added plugin for parsing and checking links in Markdown files
2014-11-11 15:35:18 +02:00
Bastian Kleineidam
7239cd1b76
Add test for itms-services URL.
2014-09-05 21:37:33 +02:00
Bastian Kleineidam
0fa7ed2699
Fix empty URL handling.
2014-07-03 23:34:40 +02:00
Bastian Kleineidam
cde261c009
Parse Refresh: and Content-Location: header values for URLs.
2014-07-01 20:16:43 +02:00
Bastian Kleineidam
b152ce7a6e
Add PDF test and fix page number.
2014-04-29 18:53:24 +02:00
Bastian Kleineidam
7baa2f0b1b
Fix http_link check and add a basic auth check.
2014-04-10 18:06:15 +02:00
Bastian Kleineidam
6caf654031
Parse Link: heaaders.
2014-04-10 17:50:55 +02:00
Bastian Kleineidam
a8623bc0bc
Display SSL info on redirects.
2014-03-26 07:16:03 +01:00
Bastian Kleineidam
9cd67dfcb2
More SSL message work.
2014-03-20 20:24:57 +01:00
Bastian Kleineidam
9a7ad3a84f
Print SSL cipher info for https URLs.
2014-03-19 17:02:34 +01:00
Bastian Kleineidam
ce733ae76b
Don't check for robots.txt directives in local html files.
2014-03-19 16:33:22 +01:00
Bastian Kleineidam
9be667b52a
Do not warn about missing addresses on mailto links that have subjects.
2014-03-18 23:27:59 +01:00
Bastian Kleineidam
fc73c6ca6e
Log number of checked unique URLs.
2014-03-14 23:46:17 +01:00
Bastian Kleineidam
bca226c293
Fix assertion checking external links; fix tests
2014-03-10 18:23:44 +01:00
Bastian Kleineidam
6b334dc79b
Fix URL result caching.
2014-03-08 19:35:10 +01:00
Bastian Kleineidam
fab2c2da98
Improve content type setting.
2014-03-05 20:12:19 +01:00
Bastian Kleineidam
ef13a3fce1
Implement sitemap and sitemap index parsing.
2014-03-05 19:26:37 +01:00
Bastian Kleineidam
b17211f162
Set for release.
2014-03-04 21:36:24 +01:00
Bastian Kleineidam
978b24f2d7
Merge branch 'caching'
2014-03-04 07:21:42 +01:00
Bastian Kleineidam
f1076c8813
Increase url-too-long warning.
2014-03-03 23:31:04 +01:00
Bastian Kleineidam
82f81241fd
Check all links and add better caching.
2014-03-03 23:29:45 +01:00
Bastian Kleineidam
cc21f8f3d2
Add missing import.
2014-03-02 20:01:55 +01:00
Bastian Kleineidam
b8175e2357
Disable news test.
2014-03-02 20:01:36 +01:00
Bastian Kleineidam
924c6285d2
Fix some tests
2014-03-02 07:45:04 +01:00
Bastian Kleineidam
7b34be590b
Introduce check plugins, use Python requests for http/s connections, and some code cleanups and improvements.
2014-03-01 00:12:34 +01:00
Bastian Kleineidam
c806be5c15
Updated copyright
2014-01-08 22:33:04 +01:00
Bastian Kleineidam
e0a2558b2b
Updated copyright.
2013-12-24 07:13:16 +01:00
Bastian Kleineidam
5736987b60
Refactor output loggers.
2013-12-11 18:41:55 +01:00
Bastian Kleineidam
b363945052
Adjust example.com/org tests. This seems to change every now and then.
2013-12-04 19:13:18 +01:00
Bastian Kleineidam
023da7c993
Remove the duplicate URL content check.
2013-12-04 19:12:40 +01:00
Bastian Kleineidam
c966fe6b24
Remove the http-wrong-redirect warning
2013-04-11 18:33:19 +02:00
Bastian Kleineidam
35bc79dd90
Updated copyright.
2013-01-25 21:14:27 +01:00
Bastian Kleineidam
a86e36e5d3
Fix test cases for example.com redirection.
2013-01-23 19:42:29 +01:00
Bastian Kleineidam
e6ad32c028
Catch UnicodeError for invalid host names.
2013-01-23 19:42:29 +01:00
Bastian Kleineidam
4dad2aa33c
Support dns-prefetch URLs.
2013-01-17 20:41:09 +01:00
Bastian Kleineidam
03f2e19cfd
Fix html tests.
2013-01-17 20:40:51 +01:00
Bastian Kleineidam
aaf35c0f4a
Added Word test.
2013-01-09 23:02:47 +01:00
Bastian Kleineidam
e91c2edf7e
Test all http response codes.
2012-11-13 18:11:25 +01:00
Bastian Kleineidam
7bd58af106
Updated copyright.
2012-11-07 18:07:00 +01:00
