Hopiu/linkchecker
1
0
Fork 0
mirror of https://github.com/Hopiu/linkchecker.git synced 2026-05-15 18:13:09 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
4423 commits 1 branch 0 tags 24 MiB
Commit graph

2135 commits

Author SHA1 Message Date
Bastian Kleineidam
03034ddc1c Updated copyright 2010-11-21 11:25:07 +01:00
Bastian Kleineidam
fb44f6b775 Updated httplib. 2010-11-21 11:24:53 +01:00
Bastian Kleineidam
7302f4bc22 Use the builtin set type. 2010-11-21 10:55:10 +01:00
Bastian Kleineidam
350c952a1f Use new textwrap feature to not break on hyphens. 2010-11-21 10:48:40 +01:00
Bastian Kleineidam
017a1087ba Remove unneeded __future__ import 2010-11-21 10:45:30 +01:00
Bastian Kleineidam
b24086f1a0 Remove tests for old Python versions. 2010-11-21 10:44:27 +01:00
Bastian Kleineidam
fcc3e6dc03 Remove copy of namedtuple implementation. 2010-11-21 10:44:11 +01:00
Bastian Kleineidam
04f9c1b854 Use urlparse.parse_qs() instead of cgi.parse_qs() 2010-11-21 10:43:47 +01:00
Bastian Kleineidam
6dcb0e10de Require Python 2.6 2010-11-21 10:42:44 +01:00
Bastian Kleineidam
ffcb6017ba Store column widths in registry settings. 2010-11-20 20:25:27 +01:00
Bastian Kleineidam
c0c8f83827 Start checking when return is pressed in the URL label. 2010-11-20 19:58:17 +01:00
Bastian Kleineidam
167f2bf5a9 Add name for option dialog. 2010-11-20 19:53:05 +01:00
Bastian Kleineidam
d51ee5e61e Updated copyright. 2010-11-20 12:02:35 +01:00
Bastian Kleineidam
d246b8718f Use new style signals. 2010-11-18 23:30:50 +01:00
Bastian Kleineidam
8f20ea94fb Remove unnecessary variable setting. 2010-11-18 21:10:14 +01:00
Bastian Kleineidam
cf7be13776 Save GUI options in QSettings. 2010-11-17 21:25:13 +01:00
Bastian Kleineidam
2a1658a1d3 Refactor QSettings 2010-11-17 20:28:43 +01:00
Bastian Kleineidam
147bf31e1e Check for allowed HTTP GET method before parsing anchors in HTML file contents. 2010-11-17 19:13:26 +01:00
Bastian Kleineidam
17ce930611 Ignore irc:// URLs. 2010-11-10 19:56:31 +01:00
Bastian Kleineidam
59ac6ffb5c Set maximum length of URL textinput. 2010-11-06 20:29:36 +01:00
Bastian Kleineidam
45ff41c6c5 Minor layout changes. 2010-11-06 20:13:15 +01:00
Bastian Kleineidam
4fa2452d34 Do not override status text. 2010-11-06 20:03:26 +01:00
Bastian Kleineidam
2fde5bea8c Updated copyright 2010-11-06 18:02:56 +01:00
Bastian Kleineidam
4f5c957e43 Fix check of external domain after HTTP redirect. 2010-11-06 18:00:49 +01:00
Bastian Kleineidam
57ffa6bf97 Allow both redirection www.example.com -> example.com and vice versa. 2010-11-06 17:55:49 +01:00
Bastian Kleineidam
280b7892ef Remove unused NNTP warning. 2010-11-06 17:39:22 +01:00
Bastian Kleineidam
1188e0be2e Retry NNTP connections on temporary errors. 2010-11-06 17:26:40 +01:00
Bastian Kleineidam
3ecfb4a67b Updated support URL. 2010-11-06 17:00:09 +01:00
Bastian Kleineidam
51086eadac Updated translation strings. 2010-11-06 16:46:22 +01:00
Bastian Kleineidam
411f3f340a Fix copying to clipboard. 2010-11-06 16:44:49 +01:00
Bastian Kleineidam
dd5ff4706a Remove timeout and threads GUI options. 2010-11-06 16:41:14 +01:00
Bastian Kleineidam
dd18c11cd1 Do not write node ID to label 2010-11-06 16:08:05 +01:00
Bastian Kleineidam
9d88a7117d Fix GML comment format. 2010-11-06 15:47:00 +01:00
Bastian Kleineidam
e7dff74cf9 Quote quote edge labels and strip leading and trailing whitespace from node and egde labels. 2010-11-06 15:36:21 +01:00
Bastian Kleineidam
2c93319a8e Improved options layout and main window layout. 2010-11-06 14:02:52 +01:00
Bastian Kleineidam
bee72b712b Regenerate GUI files. 2010-11-06 13:45:49 +01:00
Bastian Kleineidam
0e5d76617e Added some more icons. 2010-11-06 13:43:34 +01:00
Bastian Kleineidam
c5e6d9f6eb Fix text result color and calls to index.isValid() 2010-11-06 13:42:30 +01:00
Bastian Kleineidam
5b518264fe Let properties use the URL data model. 2010-11-06 11:34:44 +01:00
Bastian Kleineidam
df9022a459 Merge urlproperties branch 2010-11-06 10:05:39 +01:00
Bastian Kleineidam
d0c357d007 Fix context menu 2010-11-06 08:40:46 +01:00
Bastian Kleineidam
45226cc652 Merge branch 'master' into uimvc 2010-11-06 07:10:48 +01:00
Bastian Kleineidam
cd1984a25f Fix debug setting. 2010-11-06 07:10:40 +01:00
Bastian Kleineidam
7b6f0e78ca Use TreeView and a custom model to display data. 2010-11-06 07:04:35 +01:00
Bastian Kleineidam
f3037b2fa3 Added property dialog. 2010-11-05 15:21:19 +01:00
Bastian Kleineidam
885ce223a4 Modified logger output strings. 2010-11-05 12:53:57 +01:00
Bastian Kleineidam
06dcf13629 Updated copyright. 2010-11-05 12:27:29 +01:00
Bastian Kleineidam
add1838dc6 Add readonly marker to editor dialog title if the file is readonly. 2010-11-05 12:26:43 +01:00
Bastian Kleineidam
b264ff8742 Check files before loading and saving in editor. 2010-11-05 01:39:04 +01:00
Bastian Kleineidam
46757777fd Allow editing of config files in GUI. 2010-11-05 01:13:37 +01:00
Bastian Kleineidam
cc3eea535f Save parent URL source in local file. 2010-11-05 01:11:28 +01:00
Bastian Kleineidam
d47aa6335f Refactor standard configuration file generation. 2010-11-05 01:09:13 +01:00
Bastian Kleineidam
ca395e7d82 Avoid error when intro or outro logging fields are configured. 2010-11-03 20:35:45 +01:00
Bastian Kleineidam
166969f3a4 Remove duplicate logger code. 2010-11-01 09:58:03 +01:00
Bastian Kleineidam
23b20306e9 Remove duplicate HTTP response codes. 2010-11-01 09:27:53 +01:00
Bastian Kleineidam
c5f93a561d Fix debug message formatting. 2010-11-01 05:59:04 +01:00
Bastian Kleineidam
e429dbcc13 Do not parse URL CGI part recursively. 2010-10-27 20:55:21 +02:00
Bastian Kleineidam
f14340a0a8 Do not check content of already cached URLs. 2010-10-27 19:52:48 +02:00
Bastian Kleineidam
1f81124dfa Fix typo. 2010-10-27 19:23:14 +02:00
Bastian Kleineidam
23403f09bb Do not print warning for HTTP to HTTPS or HTTPS to HTTP redirects. 2010-10-27 14:44:05 +02:00
Bastian Kleineidam
b2cf40151f Improved redirection warning text. 2010-10-27 09:15:46 +02:00
Bastian Kleineidam
d9e981e497 Don't log a warning if commandline URL has been redirected. 2010-10-26 16:24:27 +02:00
Bastian Kleineidam
4375d35328 Add warning about unsupported HTTP authentication, and revert the realm changes. 2010-10-25 22:41:31 +02:00
Bastian Kleineidam
332fa4f8f9 Prepare multi-realm auth configuration. 2010-10-25 22:07:16 +02:00
Bastian Kleineidam
a8c1c28066 Prevent off-screen GUI window position. 2010-10-25 21:06:13 +02:00
Bastian Kleineidam
3121cc6617 Reset debug log window on startup. 2010-10-25 19:02:21 +02:00
Bastian Kleineidam
8e7d7a23c2 Search CGI formname for login. 2010-10-25 18:11:07 +02:00
Bastian Kleineidam
a74f8371e6 Updated copyright 2010-10-25 18:10:32 +02:00
Bastian Kleineidam
90c2cbc6da Remove old checkloginresult config. 2010-10-25 17:47:31 +02:00
Bastian Kleineidam
1d07ff3350 Add console encoding function to encode Unicode strings in the preferred encoding for the console. 2010-10-25 17:33:47 +02:00
Bastian Kleineidam
b6ec28c68e Make password entries in authentication configuration optional. 2010-10-25 17:33:13 +02:00
Bastian Kleineidam
5f9c11b794 Tune timeout values to close threads faster on exit. 2010-10-24 01:47:57 +02:00
Bastian Kleineidam
5bb222b1df Updated copyright 2010-10-24 01:02:39 +02:00
Bastian Kleineidam
3834e56496 Updated dnspython. 2010-10-24 01:02:26 +02:00
Bastian Kleineidam
cb724616c0 Remove registered log handler when the main window closes. 2010-10-24 00:25:57 +02:00
Bastian Kleineidam
3305e5c92c Add functions to add and remove a root log handler. 2010-10-24 00:25:27 +02:00
Bastian Kleineidam
e8c4304ab7 Remove some old commented out code. 2010-10-23 23:22:12 +02:00
Bastian Kleineidam
ced1b42124 Use separate debug log window. 2010-10-16 19:26:46 +02:00
Bastian Kleineidam
dcff139d04 Add debuglevel setter function. 2010-10-14 22:14:25 +02:00
Bastian Kleineidam
85c44d1478 Added extra debug dialog. 2010-10-14 21:13:28 +02:00
Bastian Kleineidam
25d75bd4a2 Added login URL posting. 2010-10-14 18:36:11 +02:00
Bastian Kleineidam
4483635552 Add debuglevel, log errors and remove default handlers that are added by urllib2 for get_opener(). 2010-10-14 07:51:29 +02:00
Bastian Kleineidam
e6a1c2faf9 Added some documentation about exception handling. 2010-10-13 22:42:43 +02:00
Bastian Kleineidam
fb4689dbe1 Fix previous commit. 2010-10-13 22:40:55 +02:00
Bastian Kleineidam
415efe262e Added equality check for Cookies, and use that to augment the retrieved cookies. 2010-10-13 22:35:36 +02:00
Bastian Kleineidam
2a7292845c Improved info message about sent cookies; do not report the retrieved cookie information. 2010-10-13 22:32:50 +02:00
Bastian Kleineidam
1ce1521a9f Improved debug message and cleaned up some syntax. 2010-10-13 22:29:44 +02:00
Bastian Kleineidam
c03111475c Remove unused import. 2010-10-13 22:27:11 +02:00
Bastian Kleineidam
a8aa3bdb00 Another fix to ensure get_content() is only called when allowed. 2010-10-13 22:14:43 +02:00
Bastian Kleineidam
4acf79c641 Add configuration file option for the --cookies commandline option. 2010-10-12 00:41:14 +02:00
Bastian Kleineidam
61e611e4bf Prevent unallowed content read when checking for robots.txt allowance in HTML files. 2010-10-12 00:40:34 +02:00
Bastian Kleineidam
25cde6775b Sanitize cookie configuration. 2010-10-11 23:55:58 +02:00
Bastian Kleineidam
8ef2979905 Refactor configuration.sanitize() function. 2010-10-11 23:50:59 +02:00
Bastian Kleineidam
1d0db02192 Refactor getting user and password for an URL. 2010-10-11 20:11:15 +02:00
Bastian Kleineidam
388ea0e7ff Add ability to pass POST data to url content function. 2010-10-11 19:54:06 +02:00
Bastian Kleineidam
3775f18621 Fix Linkchecker URL list detection. 2010-10-03 17:58:56 +02:00
Bastian Kleineidam
133b4f53fd Fix typos and remove unneeded functions. 2010-10-03 12:57:42 +02:00
Bastian Kleineidam
d71ee990d3 Use Consolas as debug font 2010-10-03 12:46:29 +02:00
Bastian Kleineidam
1d5482c3bd Added parent URL source viewer 2010-10-03 12:12:57 +02:00
Bastian Kleineidam
dfc4e97371 Fix content reading function. 2010-10-03 12:11:59 +02:00
Bastian Kleineidam
a68329329f Fix get_content() function. 2010-10-03 12:11:25 +02:00
Bastian Kleineidam
59b54730de Make the Start button the default button. 2010-10-03 10:27:53 +02:00
Bastian Kleineidam
e494d6bbb6 Move MIME type detection into fileutil.py module, and use mimetools for detection. 2010-10-03 08:47:48 +02:00
Bastian Kleineidam
61bb42174d Updated copyright 2010-10-03 08:47:07 +02:00
Bastian Kleineidam
9e54bbfa57 Move URL retreiving functions into url.py module. 2010-10-03 08:46:49 +02:00
Bastian Kleineidam
d079cd07c2 Read GUI default options from configuration file. 2010-09-30 19:08:20 +02:00
Bastian Kleineidam
3b9be3fece Check if geoip DB is a real file. 2010-09-30 18:44:30 +02:00
Bastian Kleineidam
782b8adfc6 Added patches from Python2.6 httplib.py 2010-09-30 17:43:18 +02:00
Bastian Kleineidam
a4b6d48d90 Fix printing of active URLs on Ctrl-C. 2010-09-30 17:42:52 +02:00
Bastian Kleineidam
46a3cbf47d Enable cancel button in the next run after it has been clicked and disabled. 2010-09-30 07:36:50 +02:00
Bastian Kleineidam
b06638c769 Add more GUI context menu actions. 2010-09-30 07:32:39 +02:00
Bastian Kleineidam
2bae9e8679 Updated copyright 2010-09-29 19:26:16 +02:00
Bastian Kleineidam
e0f4097eb0 Ensure HttpUrl.set_title_from_content() is only called when the content is allowed to be retrieved. 2010-09-29 19:26:03 +02:00
Bastian Kleineidam
840538d12a Remove uneeded check for HTML content. 2010-09-29 19:25:14 +02:00
Bastian Kleineidam
279a1eae70 Only add geoip info for non-empty hostnames. 2010-09-29 15:59:57 +02:00
Bastian Kleineidam
cc848cdb33 Fix import for moved geoip module. 2010-09-29 15:17:27 +02:00
Bastian Kleineidam
c59bbae587 Remove unused import and move geoip module from the cache module into base linkcheck module. 2010-09-29 15:15:21 +02:00
Bastian Kleineidam
6292ec54fa Catch GeoIP lookup errors; ensure GeoIP information is Unicode. 2010-09-29 15:04:37 +02:00
Bastian Kleineidam
3795a91a99 Fix compatibility problem with logging.StreamHandler in Python 2.7 2010-09-29 14:41:38 +02:00
Bastian Kleineidam
473c834f0c Do not crash when geoip information is None. 2010-09-29 14:19:28 +02:00
Bastian Kleineidam
8995be1739 Support city-level geoip lookup; remove the geoip cache since lookup is fast enough; remove the duplicated geoip country name map. 2010-09-29 14:10:36 +02:00
Bastian Kleineidam
5a32bf4a21 Updated copyright 2010-09-29 08:25:00 +02:00
Bastian Kleineidam
1446797020 Support pygeoip 2010-09-29 08:24:30 +02:00
Bastian Kleineidam
5576440f10 Add context menu item to copy URL to system clipboard. 2010-09-28 20:34:20 +02:00
Bastian Kleineidam
d202661ff7 Give example binary path for QT designer. 2010-09-28 20:20:33 +02:00
Bastian Kleineidam
b90c832ab1 Clarify documentation. 2010-09-28 20:20:08 +02:00
Bastian Kleineidam
5fd8ea1d92 Use explicit variable for URL string. 2010-09-28 20:19:19 +02:00
Bastian Kleineidam
e996f0d98e Enable list widget items, making them selectable. 2010-09-28 20:18:39 +02:00
Bastian Kleineidam
d5707ef205 Change registry base string to avoid false spyware alarms. 2010-09-12 18:49:57 +02:00
Bastian Kleineidam
ffcd274087 Updated copyright 2010-09-05 21:02:51 +02:00
Bastian Kleineidam
8a1ac26c85 Warn about obfuscated IP numbers. 2010-09-05 20:11:02 +02:00
Bastian Kleineidam
5284017d67 Only fallback to HTTP GET when robots.txt sallows it. 2010-09-04 18:09:59 +02:00
Bastian Kleineidam
fb67df662c Use repr() for robotparser debug. 2010-09-04 18:01:12 +02:00
Bastian Kleineidam
8a074aeea9 Work around Python 2.6+ urljoin bug. 2010-08-31 09:16:24 +02:00
Bastian Kleineidam
c3b8ff00b3 Check content and recursion in one try/except to avoid multiple errors when getting page content. 2010-08-31 06:52:08 +02:00
Bastian Kleineidam
60f7af4598 Allow redirections to external URLs with same domain. 2010-08-13 01:22:18 +02:00
Bastian Kleineidam
1faedafb33 Fix data size for HTTP requests. 2010-08-04 00:06:25 +02:00
Bastian Kleineidam
851e1121e9 Use semicolon as default CSV separator. 2010-07-31 22:30:11 +02:00
Bastian Kleineidam
76f7f6b6a3 Prefer anchor element content as name instead of title attribute. 2010-07-30 21:03:04 +02:00
Bastian Kleineidam
c086f49cea Catch KeyError when quoting URLs of index.html. 2010-07-30 20:12:52 +02:00
Bastian Kleineidam
4678802a81 Do not truncate UNC filepaths 2010-07-30 20:07:11 +02:00
Bastian Kleineidam
761b292e37 Added skype: to list of recognized but ignored URL schemes. 2010-07-29 20:26:04 +02:00
Bastian Kleineidam
0f92b76290 Remove the unnormed URL warning. 2010-07-29 20:20:59 +02:00
Bastian Kleineidam
7ad4f7c220 Compare size from meta info and content data. 2010-07-29 19:53:41 +02:00
Bastian Kleineidam
8413b427e9 Rename some warnings, and add size unequality warning. 2010-07-29 19:53:15 +02:00
Bastian Kleineidam
7d076e7129 Add get_size() method for local files. 2010-07-29 19:52:26 +02:00
Bastian Kleineidam
7536472797 Send correct host header when using http proxy. 2010-07-29 06:50:35 +02:00
Bastian Kleineidam
41e2e1a448 Add new warning to warning list. 2010-07-28 13:47:58 +02:00
Bastian Kleineidam
d9bfd25a68 Add warning if content size is zero 2010-07-28 08:19:55 +02:00
Bastian Kleineidam
7802bbbbc4 Use _WIN32 instead of WIN32 to detect Windows systems. 2010-03-31 08:45:21 +02:00