mirror of
https://github.com/Hopiu/linkchecker.git
synced 2026-04-09 17:10:58 +00:00
457fdeaadb
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@925 e7d03fd6-7b0d-0410-9947-9c21f3af8025
14 lines
647 B
Text
14 lines
647 B
Text
- all threads should regularly poll a status variable
|
|
this can be used to make ctrl-c working faster, and to print messages
|
|
|
|
possible Python 2.3 improvements (ie needs Python >= 2.3)
|
|
- get rid of timeoutsocket.py, the default socket has timeouts
|
|
- use optparse instead of getopt with more flexible commandline help
|
|
- replace the debug() function with the logging module
|
|
we'll see how we can insert multiple debug levels into this thing
|
|
- use Bool object type
|
|
- get rid of the patched robotparser.py
|
|
|
|
include some web check and/or spider features:
|
|
- warn if overall size of page (including images/flash/etc.) is too big
|
|
- save downloaded pages
|