Commit graph

6957 commits

Author SHA1 Message Date
Chris Mayo
f8e2faa6b4 Documentation for release 10.2.0 2022-11-14 19:34:36 +00:00
Chris Mayo
f0c03b129a
Merge pull request #690 from cjmayo/pyupgrade37
pyupgrade --py37-plus
2022-11-14 19:28:45 +00:00
Chris Mayo
b87d26f992 Fix translatability of AnchorCheck directory warning 2022-11-08 19:21:29 +00:00
Chris Mayo
8065c75c4e Convert some printf-style strings 2022-11-08 19:21:29 +00:00
Chris Mayo
b6bc366af0 Run pyupgrade --py37-plus x 2 2022-11-08 19:21:29 +00:00
Chris Mayo
fd6c960ace Make more messages translatable 2022-11-08 19:21:29 +00:00
Chris Mayo
55c13f0834 Remove deprecated aliases for OSError 2022-11-08 19:21:29 +00:00
Chris Mayo
0bb1576887 Run pyupgrade --py37-plus --keep-percent-format 2022-11-08 19:21:29 +00:00
Chris Mayo
ea2cb6c597
Merge pull request #689 from cjmayo/html
Turn all warnings into errors when building website
2022-11-07 19:22:25 +00:00
Chris Mayo
353909bacc
Merge pull request #688 from cjmayo/de
Some German application translations
2022-11-07 19:21:13 +00:00
Chris Mayo
04e2b0379d Fix make -C doc/src/Makefile gettext with SPHINXOPTS
build.py: error: unrecognized arguments: man/linkchecker.rst man/linkcheckerrc.rst
2022-11-03 19:20:56 +00:00
Chris Mayo
c7989eb058 Turn all warnings into errors when building website
Drop code target, sphinx-autogen is not using conf.py, and since Sphinx
4.0 autosummary is generating stub pages by default anyway.

Mock ctypes and linkcheck.__main__: colorama.py imports MS Windows
libraries, autosummary executes __main__.py.
2022-11-02 19:24:35 +00:00
Chris Mayo
0a8c29ffcc Add docstring for AnchorCheckFileUrl 2022-11-02 19:24:35 +00:00
Chris Mayo
9bdfd52ec9 Some German application translations 2022-11-01 19:25:12 +00:00
Chris Mayo
d8b6d77706
Merge pull request #687 from cjmayo/man-updates
Update application translation catalogs
2022-11-01 19:21:09 +00:00
LinkChecker
b2ba5830c6 Update application translation catalogs 2022-10-31 19:45:56 +00:00
LinkChecker
eeef12cbb7 Update man pages 2022-10-31 19:45:56 +00:00
LinkChecker
4246d919df Update doc translation catalogs 2022-10-31 19:45:38 +00:00
Chris Mayo
614e84b554
Merge pull request #686 from cjmayo/xgettext
Specify source encoding to xgettext
2022-10-31 19:44:30 +00:00
Chris Mayo
189cd35fdf Specify source encoding to xgettext
Default is ASCII.

xgettext: Non-ASCII string at ../linkcheck/htmlutil/srcsetparse.py:39.
          Please specify the source encoding through --from-code or through a comment
          as specified in http://www.python.org/peps/pep-0263.html.
2022-10-31 19:39:15 +00:00
Chris Mayo
b796cec346
Merge pull request #683 from cjmayo/anchorcheckfileurl
Move AnchorCheck local file handling into a new class
2022-10-31 19:23:27 +00:00
Chris Mayo
740fce4df5
Merge pull request #682 from cjmayo/node16
Update Actions to Node16 versions
2022-10-31 19:22:50 +00:00
Chris Mayo
b2fd7b30c5
Merge pull request #684 from cjmayo/python311
Add Python 3.11
2022-10-26 19:31:16 +01:00
Chris Mayo
169e327d50 Add Python 3.11 2022-10-25 19:21:39 +01:00
Chris Mayo
16bee50068 Move AnchorCheck local file handling into a new class
When checking local files with AnchorCheck, anchors in URLs
like "example/#anchor" are not supported.

Without AnchorCheck enabled, the Real URL reported for such URLs
was changed to include the anchor when local file checking was added to
AnchorCheck, but it is the directory that is checked.
The same URL was also then used as the Parent URL for the check of each
of the contents of that directory.

For FileUrl this is a revert of:
c221afda ("Enable AnchorCheck to be used with local files", 2022-10-03)
2022-10-24 19:30:56 +01:00
Chris Mayo
776f2980bc Update 3rd-party Actions to Node16 versions 2022-10-24 19:26:52 +01:00
Chris Mayo
a3bedadfb6 Update GitHub Actions to Node16 versions 2022-10-24 19:26:52 +01:00
Chris Mayo
b66ca30e84
Merge pull request #680 from cjmayo/misc
Collection of independent small improvements
2022-10-24 19:26:13 +01:00
Chris Mayo
e32c76aa5c Make text logger outro "checked" translatable 2022-10-18 19:24:08 +01:00
Chris Mayo
9631c314dd Use \d in regexp in TestDecorators.test_timeit2() 2022-10-18 19:24:08 +01:00
Chris Mayo
deac09d2c1 Clarify note in TestConfig 2022-10-18 19:24:08 +01:00
Chris Mayo
ef2d571761 Support building wheel from sdist
Build hook is also called for the wheel since:
38dea6b7 ("Fix install with pip git+https", 2022-09-13)
2022-10-18 19:24:08 +01:00
Chris Mayo
a0eb6d5187 Align documentation of debug in man pages
Linked to:
b3967f75 ("Correct documentation of --debug in linkchecker(1)", 2022-09-30)
2022-10-18 19:24:08 +01:00
Chris Mayo
0f36153f69
Merge pull request #679 from cjmayo/pytest
Fix tests failing when run with pytest
2022-10-18 19:22:09 +01:00
Chris Mayo
78536c578a Fix tests failing when run with pytest
TypeError: 'NoneType' object is not callable

As per:
2cbff492 ("Fix http tests failing with pytest due to missing _()", 2022-10-03)
2022-10-17 19:26:53 +01:00
Chris Mayo
b6eea83f63
Merge pull request #676 from cjmayo/robotmap
Document sitemaps in linkchecker(1)
2022-10-17 19:25:57 +01:00
Chris Mayo
96c3336013
Merge pull request #677 from cjmayo/maxrate
Enable average HTTP request rate to be above 4 per second
2022-10-17 19:24:49 +01:00
Chris Mayo
afccdb9608
Merge pull request #675 from cjmayo/mx
Replace deprecated dns.resolver.query()
2022-10-17 19:23:33 +01:00
Chris Mayo
93f1d3f4ac Document sitemaps in linkchecker(1) 2022-10-17 19:21:03 +01:00
Chris Mayo
689557d9af Add logging of MIME types and improve docstrings 2022-10-17 19:21:03 +01:00
Chris Mayo
eab2fa410e Log robots.txt as the sitemap parent URL
This is the location the sitemap URL was found in. The line being
reported is the line in robots.txt.
2022-10-17 19:21:03 +01:00
Chris Mayo
7367e6e865 Skip incomplete Sitemap in robots.txt and warn
Sitemap values should be fully qualified URLs; LinkChecker may not
resolve relative paths correctly.
2022-10-17 19:21:03 +01:00
Chris Mayo
8bc849dfde Make --cookiefile description in linkchecker(1) a bit clearer 2022-10-17 19:21:03 +01:00
Chris Mayo
0c5db040c8 Support maxrequestspersecond less than one 2022-10-05 19:28:01 +01:00
Chris Mayo
e88cf49c8f Enable average HTTP request rate to be above 4 per second 2022-10-05 19:28:01 +01:00
Chris Mayo
f2be98b8ad Replace deprecated dns.resolver.query()
Missed in:
26c15c5e ("Fix deprecation warning for resolver.query()", 2020-09-14)
2022-10-05 19:27:13 +01:00
Chris Mayo
bbb8096df5 Add @need_network to test_no_error() in test_ignoreerrors.py
Needs network access for DNS:

warning No MX mail host for example.com found.
2022-10-05 19:27:13 +01:00
Chris Mayo
354ea933ca
Merge pull request #673 from cjmayo/sitemap
Fix sitemap output with multiple threads
2022-10-05 19:20:40 +01:00
Chris Mayo
d9265bb71c
Merge pull request #669 from cjmayo/anchorcheck
Re-enable AnchorCheck plugin
2022-10-03 19:36:08 +01:00
Nathan Arthur
2d1bf6ef98 Add tests for encoded anchors for file: and http:
I started with a test of urlencoded anchors, assuming at the URL might
have a urlencoded anchor, but the actual anchor in the HTML would NOT be
urlencoded.
2022-10-03 19:33:05 +01:00