Commit graph

857 commits

Author SHA1 Message Date
calvin
4756641e1b source code restructuring
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1423 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:53 +00:00
calvin
1cf5a14352 functional tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1422 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:16 +00:00
calvin
14a9b5c426 unit tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1421 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:20:06 +00:00
calvin
9f7e3e67a9 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1420 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-08-16 19:17:36 +00:00
calvin
c9261c96c2 install_data
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1403 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-30 08:09:18 +00:00
calvin
8a083287fb dns config
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1401 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 14:07:22 +00:00
calvin
213b9e3cec pycheck fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1400 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 13:54:32 +00:00
calvin
1f6670e8cd import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1399 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 13:47:19 +00:00
calvin
96dd6ef4b8 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1398 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 12:01:52 +00:00
calvin
3e56e96e14 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1397 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 11:43:11 +00:00
calvin
02b177017e fix getUrlDataFrom invocation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1396 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-26 11:18:12 +00:00
calvin
b674575de1 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1388 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 13:36:43 +00:00
calvin
6942fccb50 import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1386 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 13:19:18 +00:00
calvin
82d2ec5d51 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1385 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 11:34:53 +00:00
calvin
32bc5cd292 more import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1383 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 10:54:47 +00:00
calvin
6c2c8f78b6 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1382 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-22 10:47:55 +00:00
calvin
b60070a922 bk movements
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1375 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:50:00 +00:00
calvin
5ad8c827b4 syntax updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1374 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:49:44 +00:00
calvin
c071230c1b removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1372 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:42:18 +00:00
calvin
a5204c56d5 resynced with newest upstream
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1371 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-20 14:32:04 +00:00
calvin
6d8ae43f37 moved
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1367 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-19 09:02:52 +00:00
calvin
6476c8675d more import fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1364 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-19 08:58:59 +00:00
calvin
916f96cc0d checker module
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1357 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:15:17 +00:00
calvin
018cf945d1 new module layout
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1356 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:04:40 +00:00
calvin
6f37e1961d added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1355 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-07 18:01:25 +00:00
calvin
5a644b35b3 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1354 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-06 22:08:05 +00:00
calvin
3bbfac47c7 removed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1353 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-06 20:34:00 +00:00
calvin
dc90faac9e renamed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1351 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-03 06:17:08 +00:00
calvin
bde88f9715 added string utils to parser, and sync with webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1350 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-07-02 18:25:00 +00:00
calvin
a4925830f6 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1345 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 21:16:14 +00:00
calvin
cf0ec06ef0 do not quote None
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1343 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 21:05:14 +00:00
calvin
097bb8a143 mv contentAllowsRobots to end of recursion check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1339 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 20:43:41 +00:00
calvin
49e2b1f10d rework anchor fallback
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1336 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 20:27:59 +00:00
calvin
715a80afff ignore flush errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1335 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 17:31:05 +00:00
calvin
7556d4e72c correctly quote request url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1331 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 09:05:46 +00:00
calvin
58fab5a44f updated from webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1330 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 08:29:43 +00:00
calvin
04e0a9448d updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1325 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 00:30:37 +00:00
calvin
4353d97854 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1324 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-27 00:18:04 +00:00
calvin
1f28911a23 actually fallback to GET with Zope servers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1321 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:54:47 +00:00
calvin
ce68bb782a cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1320 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:48:28 +00:00
calvin
e9341590d4 better err msg on bad status line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1318 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:02:47 +00:00
calvin
abccff16ea fall back to GET on bad status line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1317 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-26 23:00:21 +00:00
calvin
37b69e16e4 uri regex url added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1314 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-05-03 08:53:38 +00:00
calvin
8dcd8f408a copyright
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1313 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-05 09:55:14 +00:00
calvin
ca081c2168 also check robots allowance of HTML files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1304 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 10:48:31 +00:00
calvin
50bc463bb1 check cache
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1303 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 10:42:15 +00:00
calvin
2ffb97a855 get new urls from top of queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1302 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 09:45:33 +00:00
calvin
e78a8ea539 full css parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1300 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 09:30:10 +00:00
calvin
f4802fd467 pychecker
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1299 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:41:30 +00:00
calvin
fa46757bd7 fix import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1298 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:34:21 +00:00
calvin
68451e65dd O3
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1297 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:31:57 +00:00
calvin
93253954a8 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1296 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:30:48 +00:00
calvin
672e118d9b use sorted dict
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1295 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:30:38 +00:00
calvin
8e4e92dddd minor improvements
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1294 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:30:21 +00:00
calvin
1b148b0b4e sorted dict
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1293 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:30:01 +00:00
calvin
e183ac84dc handle missing startquotes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1292 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-04 08:29:31 +00:00
calvin
52609e4399 pychecker
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1291 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-03 18:10:38 +00:00
calvin
6b1d124d35 no sys.path fiddling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1290 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-03 17:59:31 +00:00
calvin
8584d5bc8e only check robots.txt for http
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1285 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-04-03 16:34:58 +00:00
calvin
67fabd5d8e addd contact email and url to user-agent string
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1284 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-03-11 11:01:00 +00:00
calvin
d8e738c60b check syntax and cache before putting url objects in the queue
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1277 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-03-04 12:17:38 +00:00
calvin
d79aee3a2c xml prefix for attr var
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1272 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-03-01 15:49:32 +00:00
calvin
af5be26d2c use XmlUtils instead of xmlify for quoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1271 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-03-01 15:38:56 +00:00
calvin
b63fb15986 hmmmm
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1267 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-21 15:06:22 +00:00
calvin
b7e54260b0 also quote parent url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1265 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-21 14:54:10 +00:00
calvin
033a0873be better error msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1261 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-21 11:56:24 +00:00
calvin
58057bd07f better err msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1260 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-21 11:48:39 +00:00
calvin
85115c2039 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1257 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-20 14:17:49 +00:00
calvin
bd628b7de7 use new url.py
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1256 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-20 14:14:31 +00:00
calvin
5187dbc4c2 quote url in output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1255 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-20 14:13:42 +00:00
calvin
ab9092d7a0 catch errors earlier in recursion check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1253 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-19 23:27:21 +00:00
calvin
fefba0036d catch ValueError, raise IncompleteRead on invalid chunk length
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1250 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-02-19 23:13:30 +00:00
calvin
a02d8ae2a4 fallback in redirections
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1239 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 23:47:21 +00:00
calvin
83b7ef7ff9 break cycles
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1238 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 23:46:13 +00:00
calvin
4e8c8547ec fix typos
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1237 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 21:39:15 +00:00
calvin
7121f81aff language
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1236 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 21:37:06 +00:00
calvin
967cadaa26 fallback to GET
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1231 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 21:20:28 +00:00
calvin
76452953f8 use file instead of open
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1226 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 19:04:49 +00:00
calvin
669866a7ab add NoneLogger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1223 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 19:02:50 +00:00
calvin
fa9023d9f8 fix file parsing, ignore comments and empty lines
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1222 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 19:02:31 +00:00
calvin
8a474914f3 added NOneLogger, adjust blacklist default file and handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1221 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 19:02:06 +00:00
calvin
d78d96dd0e added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1220 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 19:01:24 +00:00
calvin
7216e582fe nicer host not found error msg
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1213 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 14:36:21 +00:00
calvin
2c119a027a added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1211 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-29 14:10:35 +00:00
calvin
4df200a2d2 merged from webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1205 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 23:38:00 +00:00
calvin
f4dde29117 parse fixes merged from webcleaner
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1204 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 23:04:39 +00:00
calvin
44f5941552 use new parser interface
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1203 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 22:49:20 +00:00
calvin
66ecc466b7 resolve entities
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1202 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 22:48:50 +00:00
calvin
26072afd92 new style parser object class
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1200 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 22:33:34 +00:00
calvin
aa64775892 added setdefault function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1196 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 09:03:21 +00:00
calvin
c62de8c0d5 gc debug functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1195 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-28 09:03:11 +00:00
calvin
ad7689ee02 documentation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1183 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-07 21:37:10 +00:00
calvin
23eb7efc89 less aggressive thread aqcuiring
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1182 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-07 21:27:49 +00:00
calvin
fce225826b honor nofollow robots.txt param in html meta tag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1177 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-07 20:50:07 +00:00
calvin
78d969cd47 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1175 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-04 09:35:43 +00:00
calvin
ed563ee2e6 cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1173 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-04 09:23:00 +00:00
calvin
17d79f45f3 fix mime-type checking to allow parsing of external stylesheets
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1172 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-04 09:19:12 +00:00
calvin
96243c3047 restructure lock functions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1164 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 19:44:49 +00:00
calvin
977cc8ae9d add strduration imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1155 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 15:16:32 +00:00
calvin
2398ee2aa3 copyright updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1153 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 15:12:04 +00:00
calvin
fef96392d6 updated copyright
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1150 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 14:59:33 +00:00
calvin
da786040ef path join with list
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1149 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 14:57:54 +00:00
calvin
6a09ab9e22 increase cache limits
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1146 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 13:59:18 +00:00
calvin
20b8f0dbc5 active threads function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1145 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 13:41:53 +00:00
calvin
1f9ce630aa new --status option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1142 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 13:30:00 +00:00
calvin
a7607f3858 new --status option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1141 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 13:27:47 +00:00
calvin
45620a8453 strduration helper
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1140 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 13:26:30 +00:00
calvin
a954c1d998 use setThreads
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1138 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-03 12:31:59 +00:00
calvin
a17bf11f4b updated caching
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1132 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-02 23:30:22 +00:00
calvin
c0c91b17d5 updated threading
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1131 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2004-01-02 23:30:11 +00:00
calvin
06ddaf2bab debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1128 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-29 19:13:20 +00:00
calvin
83a8c945dd only cache needed info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1127 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-29 19:12:51 +00:00
calvin
0ae492c0ee leak debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1126 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-29 19:12:33 +00:00
calvin
02f42652fe cosmetic fix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1125 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-29 19:11:48 +00:00
calvin
d13f779d74 fix nt dns init and remove apply() use
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1123 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-28 23:01:51 +00:00
calvin
95611de5c3 replace backticks with repr
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1121 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-20 11:28:55 +00:00
calvin
fbfa5ee64e more robust registry indexing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1120 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-20 11:27:54 +00:00
calvin
fe62a76aa0 fix safe_url pattern, it was too strict
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1119 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-19 19:16:21 +00:00
calvin
0357b1237e fix https support test
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1107 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-19 10:23:18 +00:00
calvin
d000aa3d21 missing import
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1104 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-18 14:21:53 +00:00
calvin
b5023d14c4 update nameserver parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1103 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-18 14:20:37 +00:00
calvin
1e198a3b4d print last-modified date in infos
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1100 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-10 20:40:56 +00:00
calvin
7d87f007d4 do not add automatic filters with --strict when there are already some
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1090 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-07 10:14:18 +00:00
calvin
f39d0ef56e rename noanchorcaching to anchorcaching
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1087 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-05 00:38:30 +00:00
calvin
519c000cd5 fix inifinite recursion option
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1086 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-05 00:38:11 +00:00
calvin
3bc1816eb1 initialize self.urlparts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1084 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-12-02 15:46:21 +00:00
calvin
f741df2bfa catch httplib errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1081 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-11-15 15:30:22 +00:00
calvin
f73f78d7ac do not hardcode Accept-Encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1074 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-31 16:31:22 +00:00
calvin
765f30fbb1 use internal debug logger
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1073 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-31 16:31:05 +00:00
calvin
a1440c7997 add zope to servers without HEAD support
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1071 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-31 16:28:32 +00:00
calvin
3a973eb1a9 oops
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1064 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-21 21:56:02 +00:00
calvin
0de34a7675 ignore decompression errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1062 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-21 10:11:46 +00:00
calvin
e0a063104e parse css files recursively
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1058 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-17 10:53:48 +00:00
calvin
160237bd52 match multiple css urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1057 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-17 06:36:22 +00:00
calvin
8f9e0d7a97 check CSS background image urls
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1052 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-16 20:39:59 +00:00
calvin
7f3fc94dc1 accept more windows path specifications
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1046 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-10 13:30:44 +00:00
calvin
771d327f15 secure url pattern for cgi checking
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1044 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-10-05 15:47:07 +00:00
calvin
c744aa56fc use new robotparser2
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1042 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-23 22:00:14 +00:00
calvin
c4d243dfc7 re-added robotparser2.py, updated it
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1041 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-23 21:59:17 +00:00
calvin
8da038d3ef rebuild parser, ignore invalid leading attr backslash
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1031 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-09-11 21:54:36 +00:00
calvin
654b1007f5 umask setting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1028 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-29 13:03:29 +00:00
calvin
3fef6f6023 fix js script comment line parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1026 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-29 11:58:59 +00:00
calvin
7ff1edcd90 fix parsing of trailing end tag garbage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1023 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-19 11:48:49 +00:00
calvin
7e5970d256 remove unused imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1020 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-18 22:14:47 +00:00
calvin
c03e824438 use new-style classes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1008 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 13:19:39 +00:00
calvin
15a073de00 typo fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1007 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 13:01:33 +00:00
calvin
d648290705 csv logging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1002 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:41:55 +00:00
calvin
cbaebd7999 boolean stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1001 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:29:11 +00:00
calvin
d464c8ba15 check for python2.3
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@1000 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 12:03:36 +00:00
calvin
3fb419154a more boolean stuff
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@999 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:54:26 +00:00
calvin
8c1deec0c9 use boolean values, timeout changes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@998 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:49:30 +00:00
calvin
b2d6226b79 remove robotstxt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@997 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:31:29 +00:00
calvin
ad54ca88a4 use boolean values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@996 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:31:00 +00:00
calvin
648df944b0 updated for python2.3
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@995 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:19:38 +00:00
calvin
d14a47ed1c use startswith method, updated re usage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@993 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-11 11:18:33 +00:00
calvin
119d8e2ea7 fix cgi output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@990 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-08 00:49:48 +00:00
calvin
e560a650cf updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@988 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 22:36:32 +00:00
calvin
5fdf81c56c fix proxy scheme
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@983 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 10:30:26 +00:00
calvin
6d724d04a4 handle http redirections to non-http url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@981 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-07 10:18:39 +00:00
calvin
72aeaf8e6e rename column name to col
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@975 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-05 12:59:24 +00:00
calvin
d25b0d51ce fix denyllow match for intern patterns
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@972 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-05 12:20:55 +00:00
calvin
cfb7937ed9 allow colon in attr names for namespaces
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@970 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-08-01 00:49:16 +00:00
calvin
307e57ba0d redirection fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@961 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 12:05:24 +00:00
calvin
09d916058a also accept a list of cache keys
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@960 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:25:40 +00:00
calvin
087eb8f3b6 restructuring
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@959 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:13:11 +00:00
calvin
33070b0923 do not warn missing backslash on .html files
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@958 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 11:08:35 +00:00
calvin
cf17757fae check cache again on redirects
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@957 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-28 10:55:16 +00:00
calvin
2be119e899 quote url before request submit, previous map() call was useless
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@950 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-23 23:26:39 +00:00
calvin
9343fe7cd8 accept broken comment begin
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@947 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-10 12:20:44 +00:00
calvin
a4bcfca88e fix bug in strict check domain guessing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@942 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-09 20:36:44 +00:00
calvin
1d9a192f0e getRobotsTxtUrl function
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@938 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 15:06:35 +00:00
calvin
308ceb45c5 add coding line
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@933 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 14:24:44 +00:00
calvin
56a80ee9d1 add double quotes around all attributes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@930 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-07-04 14:21:20 +00:00
calvin
a3c938b8ae add domain colon for -s
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@927 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-25 20:03:17 +00:00
calvin
0dbf0949bd remove unused reges
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@926 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:57 +00:00
calvin
a3c0a2a9c6 cleanup, minor text parsing glitch
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@924 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:24 +00:00
calvin
6ef38e8454 fix thread option, minor cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@923 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-24 20:57:03 +00:00
calvin
9e9a8c63b7 enable automatic intern link config for -s
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@911 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-18 09:03:51 +00:00
calvin
ec4c6a0c81 inifinite recursion
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@907 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-18 07:50:08 +00:00
calvin
5680daff09 fix entity resolving
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@899 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-06 09:34:20 +00:00
calvin
3c78149f48 fix tag parsing with missing >
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@898 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-06-05 13:50:19 +00:00
calvin
98a0c329d8 also get id attributes on anchor check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@891 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-21 22:25:03 +00:00
calvin
94748e855f support link parsing with default None tag
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@890 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-21 22:21:17 +00:00
calvin
ae789de052 rebuilt
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@889 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-15 15:27:17 +00:00
calvin
5bde7e75cd parser cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@888 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-09 18:43:02 +00:00
calvin
fddaa53b2f cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@887 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-09 08:52:54 +00:00
calvin
8dab1292b8 correct C syntax glitches
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@886 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-08 23:36:34 +00:00
calvin
284e6984cd fix variable definitions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@882 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-05 06:30:29 +00:00
calvin
f88d0d39d7 quote not yet
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@878 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-01 13:44:32 +00:00
calvin
10ddb75519 fix quoting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@877 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-01 13:39:52 +00:00
calvin
d0c3d124d0 quote urls before request or html output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@875 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-05-01 13:21:23 +00:00
calvin
979a8b5d42 fix getattr
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@874 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 15:03:47 +00:00
calvin
a973d6e49c sync with WebCleaner parser, minor cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@872 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 13:57:28 +00:00
calvin
5e4034a76c safe parse info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@871 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 13:56:51 +00:00
calvin
b5ebd56f2b display parse info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@870 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 13:56:31 +00:00
calvin
6a9d1cbcf0 use __getattr__ to delegate calls to parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@869 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 13:56:07 +00:00
calvin
c260d30cc8 add debug
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@868 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 12:46:13 +00:00
calvin
7b521da086 display errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@866 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 01:22:00 +00:00
calvin
a795fd19db display parse errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@865 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 01:21:24 +00:00
calvin
7f4591a112 display errors, minor cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@864 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 01:15:24 +00:00
calvin
592967ea5c propagate errors, minor cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@863 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 01:14:30 +00:00
calvin
0f96206a1b PyObject* error type
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@862 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-30 01:14:04 +00:00
calvin
7097cd85ef fix gettext call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@860 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-29 09:50:36 +00:00
calvin
fc35e1f97f fix the anchor fix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@858 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-29 09:40:33 +00:00
calvin
63d3f241ce fix redirect bug using non-absolute url
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@855 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-29 01:09:05 +00:00
calvin
703abd1ca7 remove anchor from HEAD and GET requests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@853 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-28 13:08:00 +00:00
calvin
b2a87961d7 convert urlparts to list on redirect
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@845 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-27 14:32:40 +00:00
calvin
373898d38b no interactive password questions
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@841 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-18 13:04:28 +00:00
calvin
f2d97ecdc3 use urllib2
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@839 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-18 01:03:03 +00:00
calvin
e0f26a8994 rebuilt with flex 2.5.31
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@838 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-17 13:16:34 +00:00
calvin
85b93170fc updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@837 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-17 13:09:33 +00:00
calvin
6300d08cfd use urllib2
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@836 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-17 13:06:14 +00:00
calvin
1382aebcc7 more imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@835 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-17 11:36:12 +00:00
calvin
558e06b574 catch httplib.error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@834 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-04-17 11:06:22 +00:00
calvin
ccd3acc31c updated link
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@817 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-16 14:21:21 +00:00
calvin
a29957d345 quote empty attr values
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@816 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-16 14:18:39 +00:00
calvin
13d41d290b new option --no-anchor-caching
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@813 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-16 14:12:21 +00:00
calvin
9676d14c89 only cache anchor urls with -a
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@809 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-05 11:34:40 +00:00
calvin
ecd040e687 resolve entities
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@802 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-05 01:30:19 +00:00
calvin
aed11c9d17 oops
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@800 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-05 01:16:18 +00:00
calvin
11b662858a resolve number entity refs in unhtmlify
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@799 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-05 01:08:01 +00:00
calvin
fc82bc9362 clarify keyboard interrupt warning
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@798 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-05 01:07:32 +00:00
calvin
6ea6666b5e reorder includes to fix compiler warning about stpcpy
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@797 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-04 19:23:21 +00:00
calvin
734ac24a5c remove stpcpy declaration
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@795 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-03-04 17:42:14 +00:00
calvin
d88dfdfaa3 recompile with bison 1.875a
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@793 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-02-13 18:32:49 +00:00
calvin
cb5c9ec700 cgi access checking
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@786 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-02-11 23:59:41 +00:00
calvin
b570df925b fix amazon timeouts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@785 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-02-06 01:23:36 +00:00
calvin
6e812c5844 use python 2.2 headers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@780 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-02-02 10:59:13 +00:00
calvin
379bb9e342 style
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@777 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-28 23:55:43 +00:00
calvin
1c80cb6287 use included robotparser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@773 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-26 14:57:18 +00:00
calvin
36bec12b1e added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@772 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-26 14:51:12 +00:00
calvin
b85e492fda rebuild with flex 2.5.27
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@767 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-24 16:20:51 +00:00
calvin
6f22336c1b oopsie
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@763 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-22 22:38:27 +00:00
calvin
fdc9f040e6 fix linkchecker exception
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@761 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-22 19:50:13 +00:00
calvin
38c3d905c3 recognize broken html comments
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@760 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-22 00:12:29 +00:00
calvin
a9e93d3752 fix warn call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@757 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-20 21:18:05 +00:00
calvin
5ceb7ce4d6 rebuild with flex 2.5.26
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@756 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-20 14:26:25 +00:00
calvin
46d28029c6 fix debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@750 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-11 12:48:14 +00:00
calvin
412b389894 fix cvs errors, recommit
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@749 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-11 12:38:18 +00:00
calvin
69fd92b885 copyright, and fix some missing CVS lines hopefully
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@748 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-11 12:28:31 +00:00
calvin
a79162d945 rebuild with bison 1.875
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@747 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-11 12:27:18 +00:00
calvin
cba7bf30eb updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@746 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-09 21:36:52 +00:00
calvin
6f68e972d3 msg fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@745 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-09 20:42:19 +00:00
calvin
6f4b29cd23 improve error message on failed module load
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@744 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-09 19:20:43 +00:00
calvin
340c1af352 fix DebugLevel
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@739 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-09 01:53:05 +00:00
calvin
4c7acdcb3f added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@737 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 20:08:43 +00:00
calvin
c8af1e5330 fix debug/warn/error usage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@735 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 20:05:53 +00:00
calvin
f92c2ca4c2 fix build on 64bit architectures
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@733 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 16:36:29 +00:00
calvin
6d40be35e2 debug fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@732 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 09:27:15 +00:00
calvin
da86b44f6b added debug.py utils and use it
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@731 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 08:47:49 +00:00
calvin
291b5a2c9d added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@730 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 08:10:40 +00:00
calvin
e236796f1e -a implies -w
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@729 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-08 08:04:15 +00:00
calvin
2f6806c3e6 cope with malformed html comments
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@728 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-06 02:33:43 +00:00
calvin
5425aa45da imports fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@725 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 23:20:59 +00:00
calvin
8db3062748 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@724 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 23:07:46 +00:00
calvin
fbcb63c705 fix init
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@722 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 22:57:34 +00:00
calvin
70586ae6c1 fix i18n
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@721 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 22:55:48 +00:00
calvin
a21af42394 po updates
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@719 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 21:00:32 +00:00
calvin
735ebda254 defer i18n of log field names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@717 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 20:35:41 +00:00
calvin
4b3c59a0fc fix
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@715 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 17:52:53 +00:00
calvin
0f046374b6 pychecker fixes
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@714 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 17:39:19 +00:00
calvin
8b8c7a5e49 code cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@712 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 16:18:06 +00:00
calvin
ceea0e4bac use LogFields
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@711 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 15:58:42 +00:00
calvin
3dde7f6f18 code cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@708 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-05 12:38:34 +00:00
calvin
330ae45cfa fix debug level
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@699 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-04 23:18:19 +00:00
calvin
ea9ce7fcfe add missing StringUtil imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@698 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2003-01-04 23:17:28 +00:00
calvin
c42fe507ce fix telnet url parsing
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@690 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-31 00:31:22 +00:00
calvin
5fa5b589f8 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@689 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-31 00:00:21 +00:00
calvin
12828a3850 add linebreaks in html output
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@688 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-30 23:55:24 +00:00
calvin
34b7aa8172 fix cgi imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@687 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-30 23:23:16 +00:00
calvin
23bece96a0 updated cgi scripts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@686 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-30 22:58:51 +00:00
calvin
d5836865d0 updated tests
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@684 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-28 20:59:34 +00:00
calvin
3a22f0e59f fix quoting in parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@683 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-28 20:51:46 +00:00
calvin
2075df8c08 catch invalid chars
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@681 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-28 17:22:49 +00:00
calvin
a0ac71384c build with flex 2.5.25
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@680 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-28 17:22:07 +00:00
calvin
c47cb54dc0 init checktime to 0
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@677 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-11 23:41:44 +00:00
calvin
5b2df85c67 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@673 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-07 00:45:31 +00:00
calvin
17e1785b31 log size field
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@671 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 19:10:03 +00:00
calvin
36fb2e9a36 fix download size reporting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@668 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 18:21:39 +00:00
calvin
80c178682a beautify strsize
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@667 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 18:16:46 +00:00
calvin
51a9cc3e9b print size info if available
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@666 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 18:07:26 +00:00
calvin
ee472c87dd check ftp path
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@662 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 17:57:57 +00:00
calvin
47f312e5a5 oops
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@661 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 17:27:32 +00:00
calvin
a9358ce493 add size checking
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@660 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 17:26:34 +00:00
calvin
930641b13d also check path info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@659 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 17:21:16 +00:00
calvin
eea60506b5 fix indices
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@658 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 16:10:00 +00:00
calvin
a81cb0835c use userinfo
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@657 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 10:33:10 +00:00
calvin
5a9729c1b8 rename urlTuple to urlparts
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@656 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-06 01:36:19 +00:00
calvin
42be9153da oopsie floopsie, forgot function call
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@654 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-12-05 02:39:38 +00:00
calvin
fd329334cc fix csv logging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@644 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-27 18:46:17 +00:00
calvin
6e4414104c remove skip_host check
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@640 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-27 14:23:01 +00:00
calvin
33518d2fda ansi color code names
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@637 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-27 01:06:47 +00:00
calvin
113460f503 update to Python >= 2.2.1
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@631 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-26 23:27:43 +00:00
calvin
b888038754 log columns
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@627 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-26 01:13:10 +00:00
calvin
7fcb70aef1 add column tracking
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@626 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-26 01:11:57 +00:00
calvin
501037a21e fix column counting
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@625 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-26 01:06:49 +00:00
calvin
f4c774a50d added column tracking, use custom line tracking in parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@624 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-25 22:29:07 +00:00
calvin
1423bd99d0 plug memory leak in flushing parser
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@623 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-25 00:11:32 +00:00
calvin
d3a0d91975 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@619 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-24 22:13:45 +00:00
calvin
7abd63ad3b base parsing fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@618 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-24 22:13:05 +00:00
calvin
33e25d4a39 fix flushing error handling
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@617 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-24 19:53:37 +00:00
calvin
7633e60235 added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@616 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-23 23:10:11 +00:00
calvin
bd1e7c158a parser added
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@615 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-23 23:09:11 +00:00
calvin
1a2ae7ad63 better error reporting on externX syntax errors
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@612 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-22 19:29:35 +00:00
calvin
3f59c6b6d4 use local httplib
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@611 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-22 19:29:31 +00:00
calvin
9c18143066 added httplib.py
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@610 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-22 19:28:14 +00:00
calvin
89d2d18e8d new base test, other tests updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@602 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-18 19:48:28 +00:00
calvin
88008d5470 only skip_host if supported
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@599 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-12 01:14:51 +00:00
calvin
06b60017b0 fix stupid typos
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@593 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-07 23:53:08 +00:00
calvin
203558d357 use new HTTPConnection and HTTPResponse object interface of httplib
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@590 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-11-07 23:41:23 +00:00
calvin
6a84115517 fix ctrl-c
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@576 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-10-19 11:48:33 +00:00
calvin
5be54dab72 catch max recusion limit error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@573 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-10-19 11:46:41 +00:00
calvin
07da7a92b6 support for ftp proxies
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@569 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-10-15 00:59:12 +00:00
calvin
4e6ae8e953 correct proxy info
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@566 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 20:06:52 +00:00
calvin
6e03bd2e8a updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@554 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 15:48:13 +00:00
calvin
08e3379b39 _ call fixed
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@551 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 15:25:44 +00:00
calvin
22291c1c0c add info about proxy usage
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@549 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 15:08:37 +00:00
calvin
3f6dab7d4e move dns import test to correct place
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@548 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 15:03:11 +00:00
calvin
c593d9795d fix extern argument creation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@546 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-26 14:50:50 +00:00
calvin
409b7a89eb cleanup
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@545 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-25 21:46:40 +00:00
calvin
536bcd9fd0 str method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@543 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-25 21:43:59 +00:00
calvin
a5aafd83b2 str method
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@542 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-25 21:34:07 +00:00
calvin
d1fc7278ac use startswith instead of regexs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@532 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-20 20:49:26 +00:00
calvin
053c63a308 identity encoding
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@525 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-10 23:55:04 +00:00
calvin
0579ba6988 support content-encoding: deflate
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@524 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-10 23:36:07 +00:00
calvin
2537721402 warn about unknown encodings,
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@521 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-10 20:20:44 +00:00
calvin
db33ab2b97 debugging
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@517 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-07 16:19:38 +00:00
calvin
1d5cdd3ffd User-Agent
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@510 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-07 11:54:57 +00:00
calvin
7f28a54bd3 updated with newest upstream
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@505 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-09-04 21:29:12 +00:00
calvin
254c3d0f5e dont recurse into plain text files, this is error prone
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@494 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-08-21 21:59:25 +00:00
calvin
a0b5ad1bc1 ignore other meta contents
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@492 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-08-02 11:12:58 +00:00
calvin
4186169edf fix meta matcher var
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@491 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-08-02 11:07:38 +00:00
calvin
53264c1fc9 enable meta refresh url parsing again
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@489 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-08-02 08:56:19 +00:00
calvin
ffaa1b01df pychecker cleanups
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@485 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-26 20:46:42 +00:00
calvin
a8217caf80 uses linkcheck.StringUtil
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@483 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-25 15:30:46 +00:00
calvin
311ab1bbc5 use external DNS lib
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@478 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-23 17:00:40 +00:00
calvin
94a5fb8ea3 tests, linkname
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@475 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-09 15:32:14 +00:00
calvin
e779eaa12f linkcheck/__init__.py: use getLinkPat function for all config entries, not just commandline
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@464 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-07 20:47:35 +00:00
calvin
40000306a6 fix linkname regexs
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@459 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-07 19:50:56 +00:00
calvin
a142b79488 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@456 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-02 14:11:11 +00:00
calvin
c15a65c360 ISO 8601
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@455 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-06-02 14:10:57 +00:00
calvin
b300080297 import Error
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@452 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-24 18:55:28 +00:00
calvin
1a403ac0b7 add missing imports
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@443 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-15 17:11:41 +00:00
calvin
d779fa0b78 import time
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@442 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-15 16:06:20 +00:00
calvin
11a6532906 new log package with all the loggers
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@438 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-14 23:01:48 +00:00
calvin
5b47fd707d updated translation
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@437 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-14 21:19:38 +00:00
calvin
66552c69b9 updated
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@436 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-14 21:04:12 +00:00
calvin
f727fbd1bf remove non-greedy *? matcher
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@434 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-14 20:45:49 +00:00
calvin
3675c1ebef replace empty paths with a slash
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@433 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-14 20:44:59 +00:00
calvin
fd0b4d2bcb glitches
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@419 e7d03fd6-7b0d-0410-9947-9c21f3af8025
2002-05-05 15:02:58 +00:00