Commit graph

1936 commits

Author SHA1 Message Date
Bastian Kleineidam
dfc4e97371 Fix content reading function. 2010-10-03 12:11:59 +02:00
Bastian Kleineidam
a68329329f Fix get_content() function. 2010-10-03 12:11:25 +02:00
Bastian Kleineidam
59b54730de Make the Start button the default button. 2010-10-03 10:27:53 +02:00
Bastian Kleineidam
e494d6bbb6 Move MIME type detection into fileutil.py module, and use mimetools for detection. 2010-10-03 08:47:48 +02:00
Bastian Kleineidam
61bb42174d Updated copyright 2010-10-03 08:47:07 +02:00
Bastian Kleineidam
9e54bbfa57 Move URL retreiving functions into url.py module. 2010-10-03 08:46:49 +02:00
Bastian Kleineidam
d079cd07c2 Read GUI default options from configuration file. 2010-09-30 19:08:20 +02:00
Bastian Kleineidam
3b9be3fece Check if geoip DB is a real file. 2010-09-30 18:44:30 +02:00
Bastian Kleineidam
782b8adfc6 Added patches from Python2.6 httplib.py 2010-09-30 17:43:18 +02:00
Bastian Kleineidam
a4b6d48d90 Fix printing of active URLs on Ctrl-C. 2010-09-30 17:42:52 +02:00
Bastian Kleineidam
46a3cbf47d Enable cancel button in the next run after it has been clicked and disabled. 2010-09-30 07:36:50 +02:00
Bastian Kleineidam
b06638c769 Add more GUI context menu actions. 2010-09-30 07:32:39 +02:00
Bastian Kleineidam
2bae9e8679 Updated copyright 2010-09-29 19:26:16 +02:00
Bastian Kleineidam
e0f4097eb0 Ensure HttpUrl.set_title_from_content() is only called when the content is allowed to be retrieved. 2010-09-29 19:26:03 +02:00
Bastian Kleineidam
840538d12a Remove uneeded check for HTML content. 2010-09-29 19:25:14 +02:00
Bastian Kleineidam
279a1eae70 Only add geoip info for non-empty hostnames. 2010-09-29 15:59:57 +02:00
Bastian Kleineidam
cc848cdb33 Fix import for moved geoip module. 2010-09-29 15:17:27 +02:00
Bastian Kleineidam
c59bbae587 Remove unused import and move geoip module from the cache module into base linkcheck module. 2010-09-29 15:15:21 +02:00
Bastian Kleineidam
6292ec54fa Catch GeoIP lookup errors; ensure GeoIP information is Unicode. 2010-09-29 15:04:37 +02:00
Bastian Kleineidam
3795a91a99 Fix compatibility problem with logging.StreamHandler in Python 2.7 2010-09-29 14:41:38 +02:00
Bastian Kleineidam
473c834f0c Do not crash when geoip information is None. 2010-09-29 14:19:28 +02:00
Bastian Kleineidam
8995be1739 Support city-level geoip lookup; remove the geoip cache since lookup is fast enough; remove the duplicated geoip country name map. 2010-09-29 14:10:36 +02:00
Bastian Kleineidam
5a32bf4a21 Updated copyright 2010-09-29 08:25:00 +02:00
Bastian Kleineidam
1446797020 Support pygeoip 2010-09-29 08:24:30 +02:00
Bastian Kleineidam
5576440f10 Add context menu item to copy URL to system clipboard. 2010-09-28 20:34:20 +02:00
Bastian Kleineidam
d202661ff7 Give example binary path for QT designer. 2010-09-28 20:20:33 +02:00
Bastian Kleineidam
b90c832ab1 Clarify documentation. 2010-09-28 20:20:08 +02:00
Bastian Kleineidam
5fd8ea1d92 Use explicit variable for URL string. 2010-09-28 20:19:19 +02:00
Bastian Kleineidam
e996f0d98e Enable list widget items, making them selectable. 2010-09-28 20:18:39 +02:00
Bastian Kleineidam
d5707ef205 Change registry base string to avoid false spyware alarms. 2010-09-12 18:49:57 +02:00
Bastian Kleineidam
ffcd274087 Updated copyright 2010-09-05 21:02:51 +02:00
Bastian Kleineidam
8a1ac26c85 Warn about obfuscated IP numbers. 2010-09-05 20:11:02 +02:00
Bastian Kleineidam
5284017d67 Only fallback to HTTP GET when robots.txt sallows it. 2010-09-04 18:09:59 +02:00
Bastian Kleineidam
fb67df662c Use repr() for robotparser debug. 2010-09-04 18:01:12 +02:00
Bastian Kleineidam
8a074aeea9 Work around Python 2.6+ urljoin bug. 2010-08-31 09:16:24 +02:00
Bastian Kleineidam
c3b8ff00b3 Check content and recursion in one try/except to avoid multiple errors when getting page content. 2010-08-31 06:52:08 +02:00
Bastian Kleineidam
60f7af4598 Allow redirections to external URLs with same domain. 2010-08-13 01:22:18 +02:00
Bastian Kleineidam
1faedafb33 Fix data size for HTTP requests. 2010-08-04 00:06:25 +02:00
Bastian Kleineidam
851e1121e9 Use semicolon as default CSV separator. 2010-07-31 22:30:11 +02:00
Bastian Kleineidam
76f7f6b6a3 Prefer anchor element content as name instead of title attribute. 2010-07-30 21:03:04 +02:00
Bastian Kleineidam
c086f49cea Catch KeyError when quoting URLs of index.html. 2010-07-30 20:12:52 +02:00
Bastian Kleineidam
4678802a81 Do not truncate UNC filepaths 2010-07-30 20:07:11 +02:00
Bastian Kleineidam
761b292e37 Added skype: to list of recognized but ignored URL schemes. 2010-07-29 20:26:04 +02:00
Bastian Kleineidam
0f92b76290 Remove the unnormed URL warning. 2010-07-29 20:20:59 +02:00
Bastian Kleineidam
7ad4f7c220 Compare size from meta info and content data. 2010-07-29 19:53:41 +02:00
Bastian Kleineidam
8413b427e9 Rename some warnings, and add size unequality warning. 2010-07-29 19:53:15 +02:00
Bastian Kleineidam
7d076e7129 Add get_size() method for local files. 2010-07-29 19:52:26 +02:00
Bastian Kleineidam
7536472797 Send correct host header when using http proxy. 2010-07-29 06:50:35 +02:00
Bastian Kleineidam
41e2e1a448 Add new warning to warning list. 2010-07-28 13:47:58 +02:00
Bastian Kleineidam
d9bfd25a68 Add warning if content size is zero 2010-07-28 08:19:55 +02:00