Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-04-13 10:51:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1506 commits 1 branch 0 tags 24 MiB
Commit graph

65 commits

Author SHA1 Message Date
calvin
98144c5fb0 remove ccache incoming debug 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 22:23:09 +00:00
calvin
b257534a60 user/password authentication for robots.txt 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1653 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 21:39:57 +00:00
calvin
68e1f03094 reset aliases 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1650 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 21:31:07 +00:00
calvin
6c97b96aa8 check cache for redirected urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1648 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 20:43:58 +00:00
calvin
a1f9f2af2b remove some asserts 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1642 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:28:12 +00:00
calvin
3f9c9cdd84 do not append error/valid to result 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:23:52 +00:00
calvin
fc65d8efb9 new in_progress cache, fix cache_key setting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-31 19:15:22 +00:00
calvin
60dc606510 forgot some cache adds 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1634 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-30 15:54:31 +00:00
calvin
07f25c6429 more code documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1629 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-29 15:48:17 +00:00
calvin
bbba28f781 downgrade the 'outside of domain filter' warning to an info message since after all the user is in full control over extern/intern stuff 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1626 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-29 12:45:03 +00:00
calvin
03086d7793 documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 16:54:44 +00:00
calvin
7fb8e33ab3 cleanup 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1582 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:27:29 +00:00
calvin
6567ffbfbc debugging 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1581 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:27:22 +00:00
calvin
8194034e93 text magic 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1580 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 09:24:13 +00:00
calvin
39a6c0aeb0 status prefix 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1565 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 06:40:30 +00:00
calvin
b8f0ca1c92 strict rename to externstrictall 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1564 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-28 06:37:43 +00:00
calvin
74df7dd963 updated documentation, adjust login method for missing user or password 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1562 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 21:08:49 +00:00
calvin
388d25c949 dont connect with base class 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1561 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 21:08:20 +00:00
calvin
c532adfd1c use new abort() method 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 19:22:55 +00:00
calvin
1100eabb62 rename finish to abort, and correct the abort state 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1553 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 19:22:17 +00:00
calvin
02a1c329e8 only send http: referers, and catch bad HEAD replies on redirections 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1552 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:54:31 +00:00
calvin
3ba4314786 fix cookie cache method calls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:25:28 +00:00
calvin
80ce276942 use new absolute_url function 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1550 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 18:21:26 +00:00
calvin
8e8eba71dc print redirection info 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1544 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 15:32:40 +00:00
calvin
1539b2c639 suggest -Dall debug run in internal error message 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1540 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 13:56:21 +00:00
calvin
fc7b2b4351 self.url should be normed 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1535 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 12:47:29 +00:00
calvin
31233bb778 leave self.base_url unquoted 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1530 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-27 08:44:03 +00:00
calvin
c34abe18a2 set line/column always to int 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1520 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-26 18:30:12 +00:00
calvin
b4039684c3 got rid of urlconnect 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1501 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:53:08 +00:00
calvin
130b89f866 use urlbase and new is_safe url functions 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1500 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:51:38 +00:00
calvin
c904caa5c5 move self.is_cache(), and use urlunsplit to set self.url 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1499 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:50:40 +00:00
calvin
d0b54018ee use urlbase and its modified url building 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1498 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:49:37 +00:00
calvin
a2bb57d81f fix cache keys and url building 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1496 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 19:42:26 +00:00
calvin
b3c9db06ef add new ignored url schemes, and only fall back to file:// with urls given on the command line 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1489 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:25:41 +00:00
calvin
605cd63c7d log and cache invalid syntax urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1488 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:24:59 +00:00
calvin
e3af24186b remove whitespace check, it is not needed now the url is always quoted 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1487 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:24:07 +00:00
calvin
95139bc0f9 added handler for invalid urls 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1484 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-25 18:21:12 +00:00
calvin
0de757b5eb documentation 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1480 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-24 21:34:07 +00:00
calvin
d24d8a512c do not use netrc 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1469 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-24 14:58:42 +00:00
calvin
0fe112ad4e better url joining 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1466 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:53:57 +00:00
calvin
01976e953b add trailing directory slash 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1463 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:27:24 +00:00
calvin
4e654e327b recursion of directories 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1462 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:20:11 +00:00
calvin
84b9c1ab2e set result for directories 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1461 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 22:15:59 +00:00
calvin
a2a1429b7e fix intern url setting 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1460 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 21:34:16 +00:00
calvin
5bdea05dff fix endless loops with broken urls with a non-empty anchor 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1458 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 21:24:30 +00:00
calvin
36db68852f errors and warnings 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1451 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-23 20:16:53 +00:00
calvin
614255a441 add intern url always on cmdline 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1444 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:24:25 +00:00
calvin
726aac7ac0 fix cache key 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1443 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:05:41 +00:00
calvin
c37d3acd50 move debug message for url queue adding 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1442 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 23:05:31 +00:00
calvin
53e89e3b39 added 
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1435 e7d03fd6-7b0d-0410-9947-9c21f3af8025
 2004-08-19 21:39:08 +00:00