mirror of
https://github.com/Hopiu/linkchecker.git
synced 2026-04-22 15:14:44 +00:00
f279608f52
git-svn-id: https://linkchecker.svn.sourceforge.net/svnroot/linkchecker/trunk/linkchecker@861 e7d03fd6-7b0d-0410-9947-9c21f3af8025
14 lines
593 B
Text
14 lines
593 B
Text
- check and define where urls are encoded
|
|
- before sending the request, urls need to be encoded
|
|
|
|
possible Python 2.3 improvements:
|
|
- get rid of timeoutsocket.py, the default socket has timeouts
|
|
- use optparse instead of getopt with more flexible commandline help
|
|
- replace the debug() function with the logging module
|
|
we'll see how we can insert multiple debug levels into this thing
|
|
- use Bool object type
|
|
- get rid of the patched robotparser.py
|
|
|
|
include some web check and/or spider features:
|
|
- warn if overall size of page (including images/flash/etc.) is too big
|
|
- save downloaded pages
|