Commit graph

857 commits

Author SHA1 Message Date
calvin
97b8972bd8 fix fileoutput flag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1877 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-27 12:22:10 +00:00
calvin
c7603d6797 configuration and storage of output encoding for loggers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1873 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-27 09:25:05 +00:00
calvin
2e32594467 close all opened log files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1871 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-26 21:43:55 +00:00
calvin
a57b7c0924 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1867 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-26 11:07:15 +00:00
calvin
290281974b search list is a set, SIOCGIFCONF only tested under linux
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-26 11:07:05 +00:00
calvin
ba438508f4 fix ftp test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1865 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 22:17:59 +00:00
calvin
18d42179d9 fix unquote test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1864 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 21:54:02 +00:00
calvin
9f09600ff1 do not coerce to empty string in unquote()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1863 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 21:47:03 +00:00
calvin
5f0660d1f4 unicode fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1861 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 21:24:11 +00:00
calvin
64f3df05f4 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1859 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 21:19:25 +00:00
calvin
65188d735c check for SSL support when generating https connection objects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-25 21:18:22 +00:00
calvin
94c605d476 decode input strings, and return unicode strings
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1854 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-07 15:47:09 +00:00
calvin
10209ae499 emit unicode data, store encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1853 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-06 19:05:48 +00:00
calvin
f2e2288f4b store interfaces list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1852 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-06 19:05:12 +00:00
calvin
c9162a0d54 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1851 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-10-06 19:04:25 +00:00
calvin
8a539c782a cgi param fix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1850 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-25 12:18:58 +00:00
calvin
81c0fa70c1 improved documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1848 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-23 18:18:18 +00:00
calvin
5950df2473 improved the documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-22 15:53:10 +00:00
calvin
6752070eba unused import cgi removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1844 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-21 06:34:55 +00:00
calvin
b0f366dffd added missing gettext import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1843 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-21 06:31:22 +00:00
calvin
97d6f02135 better missing trailing dir slash check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1842 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 19:40:57 +00:00
calvin
5405c2844b use FTP connection cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 19:22:32 +00:00
calvin
304bdda3bf added ftp connectin cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1840 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 19:21:35 +00:00
calvin
5201de5cb6 recurse into ftp links
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 18:30:44 +00:00
calvin
ee71260815 use new get_index_html utility function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 17:49:26 +00:00
calvin
6bb7a08eb5 added get_index_html utility function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 17:48:52 +00:00
calvin
0ab639242b search given filename in file list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1833 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 14:43:10 +00:00
calvin
d5972aaa8d use plural forms
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1831 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-20 12:11:32 +00:00
calvin
ff23bbf53d simplify incoming_get_url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1812 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 21:40:03 +00:00
calvin
2a5d2eac61 add question mark to url_needs_quoting charset
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1810 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 21:16:42 +00:00
calvin
0dcd6a8425 assertion message
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 21:14:59 +00:00
calvin
d174276fd8 also display info in repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1807 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 20:33:30 +00:00
calvin
f31407d2b4 remove cached urls from progress queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1806 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 20:33:14 +00:00
calvin
62b2784ebc python 2.4 compat
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1805 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-16 20:11:38 +00:00
calvin
d2f7955f2c cookie warning msg fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1804 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 20:06:06 +00:00
calvin
fda2392fc6 do not catch cookie error on check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1802 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 20:01:35 +00:00
calvin
3f9e2646fe documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1801 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 20:01:22 +00:00
calvin
5c4662499c catch cookie errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1800 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 20:00:51 +00:00
calvin
00d2b6d96e added CookieError to error list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1799 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 19:54:46 +00:00
calvin
1a6f476ec7 allow / in cgi param values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1797 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-14 17:06:12 +00:00
calvin
b1901a3e32 init cleanup and translator method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1794 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 19:56:43 +00:00
calvin
9b83851177 also collapse redundant path segements of relative paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1790 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 12:40:50 +00:00
calvin
081f21f83f js allows path fragments
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1786 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 08:55:51 +00:00
calvin
4dc05df09c updated test cases for now cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1785 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 08:43:16 +00:00
calvin
ff000a8c5c documentation for cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1784 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 08:37:14 +00:00
calvin
f66c780a0c prevent collapsing of relative parent dir paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1780 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 07:05:58 +00:00
calvin
9ba12eb7f2 init i18n
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1779 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-10 07:02:56 +00:00
calvin
14890f7ee7 syntax cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1777 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-09 16:57:55 +00:00
calvin
76e7dc1697 import os
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1772 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 19:30:47 +00:00
calvin
146fa6b1bb only import ifconfig on POSIX systems
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1771 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 19:30:17 +00:00
calvin
7da6b5cd6c init i18n in tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1766 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 18:08:48 +00:00
calvin
d287959539 reinit logger after config file reading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1762 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 13:23:09 +00:00
calvin
4efe2eb8b4 set all text output colors to default
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1759 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-08 12:44:06 +00:00
calvin
d3cd17aec1 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1757 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 17:07:06 +00:00
calvin
ccd9784283 fix i18n init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1755 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 17:03:12 +00:00
calvin
52f1e901af pylint cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1752 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:38:30 +00:00
calvin
be4d10e450 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1751 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:19:59 +00:00
calvin
fb260882cb ensure that Python.h gets included before any system headers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-06 15:19:23 +00:00
calvin
e399999acb i18n init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1740 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-05 20:57:50 +00:00
calvin
228221fb85 install gettext method in default namespace
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1736 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-05 20:48:52 +00:00
calvin
17ce3f00b9 fix typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1732 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-04 23:23:20 +00:00
calvin
9fbf2253d0 handle case where url_data.url is None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-04 08:42:44 +00:00
calvin
bf4309220e remove anchors from cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1722 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 19:55:23 +00:00
calvin
26b3f1bcf3 strip quotes from css urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1721 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 19:55:05 +00:00
calvin
3385db2018 pylint cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 18:26:12 +00:00
calvin
79b0ef54f5 support url list parsing in text files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1709 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:54:59 +00:00
calvin
594797b5e2 content regex fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:43:11 +00:00
calvin
b1708fc725 get the complete content
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1707 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 14:29:07 +00:00
calvin
33f218d9a2 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1706 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:39:09 +00:00
calvin
a29240d868 do not error out on missing user/password of ftp link
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1705 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:38:46 +00:00
calvin
c79581fe31 adjust cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1704 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 13:30:24 +00:00
calvin
bacefcf242 separate cache keys for urls and recurions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1702 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 12:05:40 +00:00
calvin
1b4c190778 file output must honor verbose/quiet flag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1693 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 08:26:10 +00:00
calvin
751d60f924 fix variable typo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1692 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-03 06:39:37 +00:00
calvin
40fad49126 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1674 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-09-01 10:25:32 +00:00
calvin
98144c5fb0 remove ccache incoming debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 22:23:09 +00:00
calvin
ce9dc6fbe9 increment robotparser version
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1655 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:45:34 +00:00
calvin
bc6bd34ffc fix password manager interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:42:34 +00:00
calvin
b257534a60 user/password authentication for robots.txt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:39:57 +00:00
calvin
68e1f03094 reset aliases
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1650 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:31:07 +00:00
calvin
bffdfa68fd robots.txt password support
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1649 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 21:20:51 +00:00
calvin
6c97b96aa8 check cache for redirected urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:43:58 +00:00
calvin
fc1f5fc5bb fix cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1646 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:35:09 +00:00
calvin
5944aa0c88 adjusted cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1644 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 20:29:32 +00:00
calvin
66d78a3fa0 get cache_key attribute directory
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1643 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:48:02 +00:00
calvin
a1f9f2af2b remove some asserts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1642 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:28:12 +00:00
calvin
1979a410a9 write error/valid before result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1641 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:27:13 +00:00
calvin
3f9c9cdd84 do not append error/valid to result
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:23:52 +00:00
calvin
e2875acea3 new cache logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1638 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:15:33 +00:00
calvin
fc65d8efb9 new in_progress cache, fix cache_key setting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:15:22 +00:00
calvin
a0970a62a0 cope with empty url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1636 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-31 19:14:46 +00:00
calvin
60dc606510 forgot some cache adds
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1634 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-30 15:54:31 +00:00
calvin
07f25c6429 more code documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1629 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-29 15:48:17 +00:00
calvin
bbba28f781 downgrade the 'outside of domain filter' warning to an info message since after all the user is in full control over extern/intern stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1626 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-29 12:45:03 +00:00
calvin
7a5bc30dda intify booleans
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 20:47:00 +00:00
calvin
62773dea21 recursionLevel -> recursion_level
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1622 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 20:41:39 +00:00
calvin
03086d7793 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 16:54:44 +00:00
calvin
fc1356d97e escape and repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1600 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:55:58 +00:00
calvin
9e76c8e70c key error url->uri
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1599 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:50:31 +00:00
calvin
a7a527b912 missing td
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1598 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:49:49 +00:00
calvin
137a5b96c5 rename html logger config args to colors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1596 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:39:12 +00:00
calvin
44f0e7c3b5 valign top and non-breaking fields
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1595 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:38:54 +00:00
calvin
08670b67d6 move self.errors var into base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1594 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:24:15 +00:00
calvin
41beea6ee3 fixed cgi check run
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1593 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 12:03:53 +00:00
calvin
d18de2a6fb dont quote AT sign in paths
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1587 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 10:46:03 +00:00
calvin
c266c7e5fd added robots.txt test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1583 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:45 +00:00
calvin
7fb8e33ab3 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:29 +00:00
calvin
6567ffbfbc debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1581 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:27:22 +00:00
calvin
8194034e93 text magic
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1580 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 09:24:13 +00:00
calvin
61a3cab286 library status default is False
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1568 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 07:59:40 +00:00
calvin
39a6c0aeb0 status prefix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1565 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 06:40:30 +00:00
calvin
b8f0ca1c92 strict rename to externstrictall
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-28 06:37:43 +00:00
calvin
74df7dd963 updated documentation, adjust login method for missing user or password
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1562 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 21:08:49 +00:00
calvin
388d25c949 dont connect with base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1561 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 21:08:20 +00:00
calvin
e4ee0f9cb8 rename --strict to --extern-strict-all
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1558 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:36:13 +00:00
calvin
c532adfd1c use new abort() method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:22:55 +00:00
calvin
1100eabb62 rename finish to abort, and correct the abort state
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1553 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 19:22:17 +00:00
calvin
02a1c329e8 only send http: referers, and catch bad HEAD replies on redirections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1552 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:54:31 +00:00
calvin
3ba4314786 fix cookie cache method calls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:25:28 +00:00
calvin
80ce276942 use new absolute_url function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:21:26 +00:00
calvin
047bd4f28d fix absolute_url testing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1549 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 18:18:21 +00:00
calvin
bcffed778e pathnoquote chars adjusted
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1548 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 17:57:34 +00:00
calvin
507a3b3069 do not repr() the base_ref
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1545 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 15:34:05 +00:00
calvin
8e8eba71dc print redirection info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 15:32:40 +00:00
calvin
25f8f13a06 add query cache key test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 14:57:03 +00:00
calvin
587724ffdc ignore query of requests to test http server
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 14:52:41 +00:00
calvin
1539b2c639 suggest -Dall debug run in internal error message
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1540 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:56:21 +00:00
calvin
b13d2e2711 adjusted for new url repr()
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1539 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:55:57 +00:00
calvin
548d941928 do not fix path of relative urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1538 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 13:50:41 +00:00
calvin
bd857d389f adjust to new repr() url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1537 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:58:55 +00:00
calvin
7a769024d8 adjust to new repr() url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1536 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:52:08 +00:00
calvin
fc7b2b4351 self.url should be normed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:47:29 +00:00
calvin
16e2048209 adjust to new base url quoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1534 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:47:03 +00:00
calvin
e1862f6321 print repr of logged url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1533 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:46:43 +00:00
calvin
09adff7cf6 javascript urls are less quoted for compatibility
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 12:03:49 +00:00
calvin
3d678d6d3b adjust test cases for new unquoted base_url and its new warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1531 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:44:36 +00:00
calvin
31233bb778 leave self.base_url unquoted
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1530 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:44:03 +00:00
calvin
50f7ea04df change debug color to white, use os.linesep
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1529 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:43:48 +00:00
calvin
ea2125c3f5 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1528 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:42:36 +00:00
calvin
e7b620052e documentation, and rstrip in url quote check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1527 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-27 08:40:27 +00:00
calvin
02767fed76 put flush method in base class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1523 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:58:01 +00:00
calvin
c34abe18a2 set line/column always to int
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1520 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:30:12 +00:00
calvin
4a947d1e5a show css/html validation on errors, and split into functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1519 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 18:29:21 +00:00
calvin
6f41bce255 use colorize in text output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1517 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-26 11:52:06 +00:00
calvin
d9c9e3e8f8 write colors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1514 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 21:50:41 +00:00
calvin
0d6c2c52a9 imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1512 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 21:32:31 +00:00
calvin
108015d8be remove colored logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1508 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:10:01 +00:00
calvin
66ec6ba897 default logger is text
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1506 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:09:04 +00:00
calvin
324614ab18 default logger is text again, remove colored logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1505 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 20:08:53 +00:00
calvin
b4039684c3 got rid of urlconnect
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1501 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-25 19:53:08 +00:00