Commit graph

857 commits

Author SHA1 Message Date
calvin
7da6b5cd6c init i18n in tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1766 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 18:08:48 +00:00
calvin
d287959539 reinit logger after config file reading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1762 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 13:23:09 +00:00
calvin
4efe2eb8b4 set all text output colors to default
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1759 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 12:44:06 +00:00
calvin
d3cd17aec1 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1757 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 17:07:06 +00:00
calvin
ccd9784283 fix i18n init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1755 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 17:03:12 +00:00
calvin
52f1e901af pylint cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1752 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:38:30 +00:00
calvin
be4d10e450 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1751 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:19:59 +00:00
calvin
fb260882cb ensure that Python.h gets included before any system headers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:19:23 +00:00
calvin
e399999acb i18n init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1740 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-05 20:57:50 +00:00
calvin
228221fb85 install gettext method in default namespace
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1736 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-05 20:48:52 +00:00
calvin
17ce3f00b9 fix typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1732 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-04 23:23:20 +00:00
calvin
9fbf2253d0 handle case where url_data.url is None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-04 08:42:44 +00:00
calvin
bf4309220e remove anchors from cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1722 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 19:55:23 +00:00
calvin
26b3f1bcf3 strip quotes from css urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1721 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 19:55:05 +00:00
calvin
3385db2018 pylint cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 18:26:12 +00:00
calvin
79b0ef54f5 support url list parsing in text files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:54:59 +00:00
calvin
594797b5e2 content regex fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:43:11 +00:00
calvin
b1708fc725 get the complete content
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1707 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:29:07 +00:00
calvin
33f218d9a2 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1706 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:39:09 +00:00
calvin
a29240d868 do not error out on missing user/password of ftp link
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:38:46 +00:00
calvin
c79581fe31 adjust cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:30:24 +00:00
calvin
bacefcf242 separate cache keys for urls and recurions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1702 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 12:05:40 +00:00
calvin
1b4c190778 file output must honor verbose/quiet flag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1693 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 08:26:10 +00:00
calvin
751d60f924 fix variable typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1692 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 06:39:37 +00:00
calvin
40fad49126 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1674 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-01 10:25:32 +00:00
calvin
98144c5fb0 remove ccache incoming debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 22:23:09 +00:00
calvin
ce9dc6fbe9 increment robotparser version
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1655 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:45:34 +00:00
calvin
bc6bd34ffc fix password manager interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:42:34 +00:00
calvin
b257534a60 user/password authentication for robots.txt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:39:57 +00:00
calvin
68e1f03094 reset aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1650 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:31:07 +00:00
calvin
bffdfa68fd robots.txt password support
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:20:51 +00:00
calvin
6c97b96aa8 check cache for redirected urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:43:58 +00:00
calvin
fc1f5fc5bb fix cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1646 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:35:09 +00:00
calvin
5944aa0c88 adjusted cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1644 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:29:32 +00:00
calvin
66d78a3fa0 get cache_key attribute directory
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:48:02 +00:00
calvin
a1f9f2af2b remove some asserts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1642 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:28:12 +00:00
calvin
1979a410a9 write error/valid before result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1641 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:27:13 +00:00
calvin
3f9c9cdd84 do not append error/valid to result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:23:52 +00:00
calvin
e2875acea3 new cache logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1638 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:15:33 +00:00
calvin
fc65d8efb9 new in_progress cache, fix cache_key setting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:15:22 +00:00
calvin
a0970a62a0 cope with empty url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:14:46 +00:00
calvin
60dc606510 forgot some cache adds
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1634 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-30 15:54:31 +00:00
calvin
07f25c6429 more code documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1629 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-29 15:48:17 +00:00
calvin
bbba28f781 downgrade the 'outside of domain filter' warning to an info message since after all the user is in full control over extern/intern stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1626 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-29 12:45:03 +00:00
calvin
7a5bc30dda intify booleans
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 20:47:00 +00:00
calvin
62773dea21 recursionLevel -> recursion_level
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 20:41:39 +00:00
calvin
03086d7793 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 16:54:44 +00:00
calvin
fc1356d97e escape and repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1600 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:55:58 +00:00
calvin
9e76c8e70c key error url->uri
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1599 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:50:31 +00:00
calvin
a7a527b912 missing td
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1598 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:49:49 +00:00
calvin
137a5b96c5 rename html logger config args to colors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1596 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:39:12 +00:00
calvin
44f0e7c3b5 valign top and non-breaking fields
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1595 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:38:54 +00:00
calvin
08670b67d6 move self.errors var into base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1594 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:24:15 +00:00
calvin
41beea6ee3 fixed cgi check run
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1593 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:03:53 +00:00
calvin
d18de2a6fb dont quote AT sign in paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1587 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 10:46:03 +00:00
calvin
c266c7e5fd added robots.txt test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1583 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:45 +00:00
calvin
7fb8e33ab3 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:29 +00:00
calvin
6567ffbfbc debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1581 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:22 +00:00
calvin
8194034e93 text magic
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1580 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:24:13 +00:00
calvin
61a3cab286 library status default is False
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1568 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 07:59:40 +00:00
calvin
39a6c0aeb0 status prefix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1565 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 06:40:30 +00:00
calvin
b8f0ca1c92 strict rename to externstrictall
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 06:37:43 +00:00
calvin
74df7dd963 updated documentation, adjust login method for missing user or password
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1562 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 21:08:49 +00:00
calvin
388d25c949 dont connect with base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1561 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 21:08:20 +00:00
calvin
e4ee0f9cb8 rename --strict to --extern-strict-all
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:36:13 +00:00
calvin
c532adfd1c use new abort() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:22:55 +00:00
calvin
1100eabb62 rename finish to abort, and correct the abort state
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1553 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:22:17 +00:00
calvin
02a1c329e8 only send http: referers, and catch bad HEAD replies on redirections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1552 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:54:31 +00:00
calvin
3ba4314786 fix cookie cache method calls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:25:28 +00:00
calvin
80ce276942 use new absolute_url function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:21:26 +00:00
calvin
047bd4f28d fix absolute_url testing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1549 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:18:21 +00:00
calvin
bcffed778e pathnoquote chars adjusted
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1548 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 17:57:34 +00:00
calvin
507a3b3069 do not repr() the base_ref
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1545 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 15:34:05 +00:00
calvin
8e8eba71dc print redirection info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 15:32:40 +00:00
calvin
25f8f13a06 add query cache key test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 14:57:03 +00:00
calvin
587724ffdc ignore query of requests to test http server
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 14:52:41 +00:00
calvin
1539b2c639 suggest -Dall debug run in internal error message
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1540 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:56:21 +00:00
calvin
b13d2e2711 adjusted for new url repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1539 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:55:57 +00:00
calvin
548d941928 do not fix path of relative urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1538 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:50:41 +00:00
calvin
bd857d389f adjust to new repr() url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1537 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:58:55 +00:00
calvin
7a769024d8 adjust to new repr() url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:52:08 +00:00
calvin
fc7b2b4351 self.url should be normed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:47:29 +00:00
calvin
16e2048209 adjust to new base url quoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1534 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:47:03 +00:00
calvin
e1862f6321 print repr of logged url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1533 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:46:43 +00:00
calvin
09adff7cf6 javascript urls are less quoted for compatibility
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:03:49 +00:00
calvin
3d678d6d3b adjust test cases for new unquoted base_url and its new warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1531 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:44:36 +00:00
calvin
31233bb778 leave self.base_url unquoted
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1530 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:44:03 +00:00
calvin
50f7ea04df change debug color to white, use os.linesep
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1529 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:43:48 +00:00
calvin
ea2125c3f5 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:42:36 +00:00
calvin
e7b620052e documentation, and rstrip in url quote check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1527 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:40:27 +00:00
calvin
02767fed76 put flush method in base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1523 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:58:01 +00:00
calvin
c34abe18a2 set line/column always to int
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1520 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:30:12 +00:00
calvin
4a947d1e5a show css/html validation on errors, and split into functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1519 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:29:21 +00:00
calvin
6f41bce255 use colorize in text output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1517 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 11:52:06 +00:00
calvin
d9c9e3e8f8 write colors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1514 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 21:50:41 +00:00
calvin
0d6c2c52a9 imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1512 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 21:32:31 +00:00
calvin
108015d8be remove colored logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1508 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:10:01 +00:00
calvin
66ec6ba897 default logger is text
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1506 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:09:04 +00:00
calvin
324614ab18 default logger is text again, remove colored logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1505 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:08:53 +00:00
calvin
b4039684c3 got rid of urlconnect
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1501 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:53:08 +00:00
calvin
130b89f866 use urlbase and new is_safe url functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:51:38 +00:00
calvin
c904caa5c5 move self.is_cache(), and use urlunsplit to set self.url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:50:40 +00:00
calvin
d0b54018ee use urlbase and its modified url building
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1498 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:49:37 +00:00
calvin
9d49c37d57 fix telnet tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1497 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:48:43 +00:00
calvin
a2bb57d81f fix cache keys and url building
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1496 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:42:26 +00:00
calvin
45568c60f5 fix cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1495 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:41:58 +00:00
calvin
6074a6f345 add cache keys to test result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1494 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:02:31 +00:00
calvin
d2b68322d0 remove bad scheme from test since the logging order is confusing otherwise (the bad scheme is logged first)
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1493 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:41:28 +00:00
calvin
2e3315cb5f pretend to be the command line in file tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:35:21 +00:00
calvin
7b51ed57d2 use new is_safe url functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1490 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:29:26 +00:00
calvin
b3c9db06ef add new ignored url schemes, and only fall back to file:// with urls given on the command line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1489 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:25:41 +00:00
calvin
605cd63c7d log and cache invalid syntax urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1488 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:24:59 +00:00
calvin
e3af24186b remove whitespace check, it is not needed now the url is always quoted
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:24:07 +00:00
calvin
29ea22b9bc split directory slash tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1486 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:22:37 +00:00
calvin
c4ddf8f905 syntax formatting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1485 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:22:32 +00:00
calvin
95139bc0f9 added handler for invalid urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1484 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:21:12 +00:00
calvin
61caa9de13 added error tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1483 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:19:47 +00:00
calvin
706c3ab63e added more needs_quoting tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1482 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:19:05 +00:00
calvin
81f43fa48a rename is_valid to is_safe, and fix url_needs_quoting to cope with ending newline
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1481 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 18:18:40 +00:00
calvin
0de757b5eb documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1480 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-24 21:34:07 +00:00
calvin
0d28d0d335 add cache key to result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1471 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-24 15:00:18 +00:00
calvin
833201711d log cache keys, ignore empty and comment lines in result files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1470 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-24 14:59:38 +00:00
calvin
d24d8a512c do not use netrc
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-24 14:58:42 +00:00
calvin
d7cc2bc274 added new field for cache key
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1467 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-24 07:47:10 +00:00
calvin
0fe112ad4e better url joining
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1466 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 22:53:57 +00:00
calvin
311be4ac04 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1465 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 22:53:27 +00:00
calvin
01976e953b add trailing directory slash
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 22:27:24 +00:00
calvin
4e654e327b recursion of directories
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 22:20:11 +00:00
calvin
84b9c1ab2e set result for directories
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 22:15:59 +00:00
calvin
a2a1429b7e fix intern url setting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 21:34:16 +00:00
calvin
5bdea05dff fix endless loops with broken urls with a non-empty anchor
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 21:24:30 +00:00
calvin
83274d0cd3 validated html output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1456 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 21:13:12 +00:00
calvin
2964bce633 no os.linesep in translation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1455 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 20:56:41 +00:00
calvin
7669ef1b6b more case tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1452 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 20:18:30 +00:00
calvin
36db68852f errors and warnings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1451 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 20:16:53 +00:00
calvin
d1c432f146 add real url to test result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1449 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 20:04:54 +00:00
calvin
3f300f38e1 check resources
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1448 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 20:03:07 +00:00
calvin
e44354c3e2 fix timeout exception
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1446 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-23 15:20:49 +00:00
calvin
2bce376e61 log real url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1445 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 23:38:35 +00:00
calvin
614255a441 add intern url always on cmdline
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1444 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 23:24:25 +00:00
calvin
726aac7ac0 fix cache key
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1443 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 23:05:41 +00:00
calvin
c37d3acd50 move debug message for url queue adding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1442 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 23:05:31 +00:00
calvin
53e89e3b39 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1435 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 21:39:08 +00:00
calvin
c3100ef518 new consumer interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 21:36:17 +00:00
calvin
a66a8359d1 colored logger is default now
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1433 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 21:36:00 +00:00
calvin
f2e7ca6040 split off cache and url consumer routines into separate classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1432 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-19 21:35:47 +00:00
calvin
097624bc98 pylint
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1429 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 20:11:59 +00:00
calvin
7a0888b9eb fix mail parsing, and connection closing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1428 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 20:11:21 +00:00
calvin
60666f5abb removed unused import, changed adress to address
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1427 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 20:10:48 +00:00
calvin
e25ea13fa7 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1426 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:28:42 +00:00
calvin
4756641e1b source code restructuring
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:53 +00:00
calvin
1cf5a14352 functional tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1422 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:16 +00:00
calvin
14a9b5c426 unit tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1421 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:06 +00:00
calvin
9f7e3e67a9 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1420 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:17:36 +00:00
calvin
c9261c96c2 install_data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1403 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-30 08:09:18 +00:00
calvin
8a083287fb dns config
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1401 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 14:07:22 +00:00
calvin
213b9e3cec pycheck fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1400 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 13:54:32 +00:00
calvin
1f6670e8cd import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 13:47:19 +00:00
calvin
96dd6ef4b8 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 12:01:52 +00:00
calvin
3e56e96e14 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1397 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 11:43:11 +00:00
calvin
02b177017e fix getUrlDataFrom invocation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 11:18:12 +00:00
calvin
b674575de1 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 13:36:43 +00:00
calvin
6942fccb50 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 13:19:18 +00:00
calvin
82d2ec5d51 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1385 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 11:34:53 +00:00
calvin
32bc5cd292 more import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1383 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 10:54:47 +00:00
calvin
6c2c8f78b6 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 10:47:55 +00:00
calvin
b60070a922 bk movements
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:50:00 +00:00
calvin
5ad8c827b4 syntax updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1374 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:49:44 +00:00
calvin
c071230c1b removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1372 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:42:18 +00:00
calvin
a5204c56d5 resynced with newest upstream
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1371 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:32:04 +00:00
calvin
6d8ae43f37 moved
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1367 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-19 09:02:52 +00:00
calvin
6476c8675d more import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1364 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-19 08:58:59 +00:00
calvin
916f96cc0d checker module
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1357 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:15:17 +00:00
calvin
018cf945d1 new module layout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1356 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:04:40 +00:00
calvin
6f37e1961d added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1355 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:01:25 +00:00
calvin
5a644b35b3 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1354 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-06 22:08:05 +00:00
calvin
3bbfac47c7 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1353 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-06 20:34:00 +00:00
calvin
dc90faac9e renamed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1351 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-03 06:17:08 +00:00
calvin
bde88f9715 added string utils to parser, and sync with webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1350 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-02 18:25:00 +00:00
calvin
a4925830f6 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1345 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 21:16:14 +00:00
calvin
cf0ec06ef0 do not quote None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1343 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 21:05:14 +00:00
calvin
097bb8a143 mv contentAllowsRobots to end of recursion check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1339 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 20:43:41 +00:00
calvin
49e2b1f10d rework anchor fallback
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1336 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 20:27:59 +00:00
calvin
715a80afff ignore flush errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1335 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 17:31:05 +00:00
calvin
7556d4e72c correctly quote request url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1331 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 09:05:46 +00:00
calvin
58fab5a44f updated from webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1330 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 08:29:43 +00:00
calvin
04e0a9448d updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1325 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 00:30:37 +00:00
calvin
4353d97854 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1324 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 00:18:04 +00:00
calvin
1f28911a23 actually fallback to GET with Zope servers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1321 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:54:47 +00:00
calvin
ce68bb782a cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1320 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:48:28 +00:00
calvin
e9341590d4 better err msg on bad status line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1318 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:02:47 +00:00
calvin
abccff16ea fall back to GET on bad status line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1317 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:00:21 +00:00
calvin
37b69e16e4 uri regex url added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1314 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-03 08:53:38 +00:00
calvin
8dcd8f408a copyright
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1313 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-05 09:55:14 +00:00
calvin
ca081c2168 also check robots allowance of HTML files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1304 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 10:48:31 +00:00
calvin
50bc463bb1 check cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1303 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 10:42:15 +00:00
calvin
2ffb97a855 get new urls from top of queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1302 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 09:45:33 +00:00
calvin
e78a8ea539 full css parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1300 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 09:30:10 +00:00
calvin
f4802fd467 pychecker
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1299 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:41:30 +00:00
calvin
fa46757bd7 fix import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1298 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:34:21 +00:00