Commit graph

6895 commits

Author SHA1 Message Date
Chris Mayo
033dcf89f9
Merge pull request #671 from cjmayo/example
Fix formatting of ignoreerrors example in linkcheckerrc(5)
2022-10-03 19:22:36 +01:00
Chris Mayo
d6d5e918dc
Merge pull request #672 from cjmayo/encoding
Separate URL encoding and content encoding
2022-10-03 19:22:03 +01:00
Chris Mayo
52b9881820 Separate URL encoding and content encoding
Ensure users of url_data.encoding are using the URL encoding.

Combined since:
5fc01455 ("Decode content when retrieved, use bs4 to detect encoding if non-Unicode", 2019-09-30)
2022-09-29 19:21:11 +01:00
Chris Mayo
61071fc5dc
Merge pull request #668 from cjmayo/defaults
Clarify default values in initial linkcheckerrc and elsewhere
2022-09-28 19:36:44 +01:00
Chris Mayo
001212b915 Fix formatting of ignoreerrors example in linkcheckerrc(5)
Introduced in:
8c959589 ("add option to ignore specific errors for specific URLs", 2022-07-21)
2022-09-28 19:23:04 +01:00
Chris Mayo
2c3aa5ebb9
Merge pull request #629 from lpirl/ignoreerrors
add option to ignore specific errors for specific URLs
2022-09-27 19:43:57 +01:00
Lukas Pirl
8c959589c3
add option to ignore specific errors for specific URLs 2022-09-25 22:52:04 +02:00
Chris Mayo
e5168f44ea Clarify defaults and examples in initial linkcheckerrc 2022-09-22 19:24:55 +01:00
Chris Mayo
4962a302b3 Document default frequency of sitemap logger 2022-09-22 19:24:55 +01:00
Chris Mayo
b8d0928969 Document dialect option of csv logger 2022-09-22 19:24:55 +01:00
Chris Mayo
130347f223 Remove unused WARN_IGNORE_URL
URL ignored was changed to an info message in:
7b34be59 ("Introduce check plugins, use Python requests for http/s
connections, and some code cleanups and improvements.", 2014-03-01)
2022-09-22 19:24:55 +01:00
Chris Mayo
36a45b0f96
Merge pull request #666 from cjmayo/gemini
Add gemini scheme
2022-09-22 19:23:20 +01:00
Chris Mayo
61792cb879
Merge pull request #667 from cjmayo/resultcachesize
Fixed a bug where the resultcachesize setting was ignored.
2022-09-22 19:23:03 +01:00
Chris Mayo
0c59cd5c1e Don't use default values in configuration tests 2022-09-20 19:36:42 +01:00
Nathan Arthur
6dc5ade29d Fixed a bug where the resultcachesize setting was ignored. 2022-09-20 19:36:23 +01:00
Chris Mayo
0d36b69536
Merge pull request #650 from cjmayo/metadata
Write all metadata used to _release.py
2022-09-20 19:24:15 +01:00
Chris Mayo
ed8e17137c Add gemini scheme 2022-09-16 19:21:32 +01:00
Chris Mayo
25ce4b854c Update IANA schemes 2022-09-16 19:21:32 +01:00
Chris Mayo
29807ed832 Add yamllint to make check 2022-09-13 19:32:06 +01:00
Chris Mayo
16fa5beda8 Install create.sql to examples
Creates database table for SQL logger output.

Fixes Ubuntu bug:
https://bugs.launchpad.net/ubuntu/+source/linkchecker/+bug/323123
2022-09-13 19:32:06 +01:00
Chris Mayo
38dea6b7f4 Fix install with pip git+https
pip only uses the wheel target.

Save building the metadata twice as a result in GitHub workflows and
update documentation.md.
2022-09-13 19:32:06 +01:00
Chris Mayo
b6a7f2d313 Don't need hatch to build documentation
This is a partial revert of:
47d1015e ("Replace setuptools and setup.py with hatch and pyproject.toml", 2022-09-05)

Also hatch is an option to run tests.
2022-09-13 19:32:06 +01:00
Chris Mayo
af265f3d52 Write all metadata used to _release.py
Enables running without installing.
Removes use of importlib.metadata.
2022-09-13 19:32:06 +01:00
Chris Mayo
30e8cfad77
Merge pull request #651 from cjmayo/rate
Rename url-rate-limited to http-rate-limited
2022-09-12 19:25:52 +01:00
Chris Mayo
84443b14cf
Merge pull request #647 from cjmayo/devdocs
Bring Developer Documentation and Tools up to date
2022-09-12 19:25:10 +01:00
Chris Mayo
fd6f4a0160
Merge pull request #657 from pacenathan/MacTimingTest
Make timing test more tolerant
2022-09-10 17:24:56 +01:00
Chris Mayo
d60b52658c
Merge pull request #654 from stefanfisk/issue/631-minimal
Fix srcset parsing
2022-09-10 17:13:03 +01:00
Nathan Arthur
47a83cbb27 Make timing test more tolerant
On my M1 Mac, this was taking 1.01 seconds rather than the expected 1.00
seconds. This is OK, because sleep() is not guaranteed to be precise.
2022-09-08 09:15:29 -04:00
Stefan Fisk
d2b9723612 Fix srcset parsing
Resolves #631
2022-09-07 21:24:23 +02:00
Chris Mayo
de40321b57
Merge pull request #652 from cjmayo/issue_xdg
Update path to linkcheckerrc in ISSUE_TEMPLATE.md
2022-09-06 19:42:42 +01:00
Chris Mayo
1b9b276d3a Update path to linkcheckerrc in ISSUE_TEMPLATE.md
Changed in:
a03e2e4a ("use xdg dirs for config & data", 2017-10-17)
2022-09-06 19:34:53 +01:00
Chris Mayo
a0b28cc0ff Rename url-rate-limited to http-rate-limited
Make consistent with the other warnings:

- The first part of the name represents the checker class in which the
  warning is raised

- Update initial comment
2022-09-06 19:32:24 +01:00
Chris Mayo
579c767d28 .gitignore cannot be excluded from sdist 2022-09-06 19:23:52 +01:00
Chris Mayo
595ce32e55
Merge pull request #646 from cjmayo/unidir
Fix checking directory containing Unicode filenames
2022-09-06 19:23:07 +01:00
Chris Mayo
fdc4a2eeca Bring development.md up to date 2022-09-05 19:30:38 +01:00
Chris Mayo
ed1e3b874f Update Makefile 2022-09-05 19:30:38 +01:00
Chris Mayo
728d826eb3 Fix typo makefiles in doc/Makefile 2022-09-05 19:30:38 +01:00
Chris Mayo
833802657f Add .coverage and .pytest_cache to .gitignore 2022-09-05 19:30:38 +01:00
Chris Mayo
931f86848e Remove obsolete doc/dot-travis-osx.yml 2022-09-05 19:30:38 +01:00
Chris Mayo
f55919b667 Remove defunct entries from .gitattributes 2022-09-05 19:30:38 +01:00
Chris Mayo
6a02c5605e Remove unused dev-requirements.txt 2022-09-05 19:30:38 +01:00
Chris Mayo
0a809af162 Remove old windows build scripts 2022-09-05 19:30:38 +01:00
Chris Mayo
3c7fb5b571 Fix checking directory containing Unicode filenames
Non-Unicode filenames are not supported.

sys.platform has not returned "linux2" since Python 3.3.
2022-09-05 19:28:40 +01:00
Chris Mayo
1abd9ea10e Skip tests in TestFile rather than silently returning 2022-09-05 19:28:40 +01:00
Chris Mayo
c627b00755
Merge pull request #639 from cjmayo/hatch
Replace setuptools and setup.py with hatch and pyproject.toml
2022-09-05 19:27:48 +01:00
Chris Mayo
d5058ecd7c
Merge pull request #643 from cjmayo/altname
Replace deprecated urllib3.contrib.pyopenssl.get_subj_alt_name()
2022-09-05 19:26:12 +01:00
Chris Mayo
e91f9b4100 Add hatch test environment 2022-09-05 19:24:01 +01:00
Chris Mayo
84c241ef95 Rename setup.cfg to .flake8 2022-09-05 19:24:01 +01:00
Chris Mayo
a214531030 Remove check-python-versions that needs setup.py 2022-09-05 19:24:01 +01:00
Chris Mayo
1975613b44 Remove MANIFEST.in
All files stored in Git are included in the sdist, unless excluded with
tool.hatch.build.exclude.

Build artifacts listed in tool.hatch.build.artifacts are also included.
2022-09-05 19:24:01 +01:00