Hopiu/lychee
1
0
Fork 0
mirror of https://github.com/Hopiu/lychee.git synced 2026-04-06 06:20:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
lychee/Cargo.lock

3647 lines
86 KiB
Text
Raw Normal View History

Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
# This file is automatically @generated by Cargo.
# It is not intended for manual editing.
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
version = 3
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "adler"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "1.0.2"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "f26201604c87b1e01bd3d98f8d5d9a8fcbb815e8cedb41ffccbeb4bf593a35fe"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "ahash"
version = "0.3.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e8fd72866655d1904d6b0997d0b07ba561047d070fbe29de039031c641b61217"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "aho-corasick"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.7.18"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1e37cfd5e7657ada45f742d6e99ca5788580b5c529dc78faf11ece6dc702656f"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"memchr",
]
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "ansi_term"
version = "0.11.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ee49baf6cb617b853aa8d93bf420db2383fab46d314482ca2803b40d5fde979b"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
]
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
[[package]]
name = "ansi_term"
version = "0.12.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d52a9bb7ec0cf484c551830a7ce27bd20d67eac647e1befb56b0be4ee39a55d2"
dependencies = [
"winapi",
]
Clean up error handling and configure reqwests
2020-08-07 22:06:17 +00:00
[[package]]
name = "anyhow"
Bump anyhow from 1.0.51 to 1.0.52 (#434) Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.51 to 1.0.52. - [Release notes](https://github.com/dtolnay/anyhow/releases) - [Commits](https://github.com/dtolnay/anyhow/compare/1.0.51...1.0.52) --- updated-dependencies: - dependency-name: anyhow dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-26 19:25:23 +00:00
version = "1.0.52"
Clean up error handling and configure reqwests
2020-08-07 22:06:17 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump anyhow from 1.0.51 to 1.0.52 (#434) Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.51 to 1.0.52. - [Release notes](https://github.com/dtolnay/anyhow/releases) - [Commits](https://github.com/dtolnay/anyhow/compare/1.0.51...1.0.52) --- updated-dependencies: - dependency-name: anyhow dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-26 19:25:23 +00:00
checksum = "84450d0b4a8bd1ba4144ce8ce718fbc5d071358b1e5384bace6536b3d1f2d5b3"
Clean up error handling and configure reqwests
2020-08-07 22:06:17 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "arrayvec"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.5.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "23b62fc65de8e4e7f52534fb52b0f3ed04746ae267519eef2a83941e8085068b"
Add connection timeout
2020-08-21 22:36:03 +00:00
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "ascii_utils"
version = "0.9.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "71938f30533e4d95a6d17aa530939da3842c2ab6f4f84b9dae68447e4129f74a"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "assert_cmd"
Bump assert_cmd from 2.0.1 to 2.0.2 (#357) Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 2.0.1 to 2.0.2. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.1...v2.0.2) --- updated-dependencies: - dependency-name: assert_cmd dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-10 00:40:57 +00:00
version = "2.0.2"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump assert_cmd from 2.0.1 to 2.0.2 (#357) Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 2.0.1 to 2.0.2. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v2.0.1...v2.0.2) --- updated-dependencies: - dependency-name: assert_cmd dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-10 00:40:57 +00:00
checksum = "e996dc7940838b7ef1096b882e29ec30a3149a3a443cdc8dba19ed382eca1fe2"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
dependencies = [
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
"bstr",
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
"doc-comment",
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
"predicates",
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
"predicates-core",
"predicates-tree",
"wait-timeout",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "async-channel"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "1.6.1"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "2114d64672151c0c5eaa5e131ec84a74f06e1e559830dabba01ca30605d66319"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"concurrent-queue",
"event-listener",
"futures-core",
]
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "async-compression"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.8"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "5443ccbb270374a2b1055fc72da40e1f237809cd6bb0e97e66d264cd138473a6"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
dependencies = [
"flate2",
"futures-core",
"memchr",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
"tokio",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "async-executor"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.4.1"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "871f9bb5e0a22eeb7e8cf16641feb87c9dc67032ccf8ff49e772eb9941d3a965"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
dependencies = [
"async-task",
"concurrent-queue",
"fastrand",
"futures-lite",
"once_cell",
Update deps
2021-11-03 22:45:42 +00:00
"slab",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
]
[[package]]
name = "async-global-executor"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "2.0.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "9586ec52317f36de58453159d48351bc244bc24ced3effc1fce22f3d48664af6"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"async-channel",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"async-executor",
Add connection timeout
2020-08-21 22:36:03 +00:00
"async-io",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"async-mutex",
"blocking",
Add connection timeout
2020-08-21 22:36:03 +00:00
"futures-lite",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"num_cpus",
"once_cell",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
[[package]]
name = "async-io"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.6.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a811e6a479f2439f0c04038796b5cfb3d2ad56c230e0f2d3f7b04d68cfee607b"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"concurrent-queue",
"futures-lite",
"libc",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"log",
Add connection timeout
2020-08-21 22:36:03 +00:00
"once_cell",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"parking",
Add connection timeout
2020-08-21 22:36:03 +00:00
"polling",
Update deps
2021-11-03 22:45:42 +00:00
"slab",
"socket2 0.4.2",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"waker-fn",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
[[package]]
name = "async-lock"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.4.0"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "e6a8ea61bf9947a1007c5cada31e647dbc77b103c679858150003ba697ea798b"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
dependencies = [
"event-listener",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "async-mutex"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.4.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "479db852db25d9dbf6204e6cb6253698f175c15726470f78af0d918e99d6156e"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"event-listener",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "async-native-tls"
version = "0.3.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "9e9e7a929bd34c68a82d58a4de7f86fffdaf97fb2af850162a7bb19dd7269b33"
dependencies = [
"async-std",
"native-tls",
"thiserror",
"url",
]
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
[[package]]
name = "async-process"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.2.0"
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "b21b63ab5a0db0369deb913540af2892750e42d949faacc7a61495ac418a1692"
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
dependencies = [
"async-io",
"blocking",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
"event-listener",
"futures-lite",
Update deps
2021-11-03 22:45:42 +00:00
"libc",
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
"once_cell",
"signal-hook",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
]
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
[[package]]
name = "async-rwlock"
version = "1.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "261803dcc39ba9e72760ba6e16d0199b1eef9fc44e81bffabbebb9f5aea3906c"
dependencies = [
"async-mutex",
"event-listener",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "async-smtp"
Bump check-if-email-exists to latest (#203)
2021-04-01 08:43:50 +00:00
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "472a081e9e3a92f9201237f07b51c0bab657336ca6600fd2f243c9cc3c9c81ff"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"async-native-tls",
"async-std",
"async-trait",
Bump check-if-email-exists to latest (#203)
2021-04-01 08:43:50 +00:00
"base64 0.13.0",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"bufstream",
"fast-socks5",
"fast_chemail",
"hostname 0.1.5",
"log",
Disable tokio console-subscriber as it is not published yet
2021-10-28 01:15:44 +00:00
"nom",
Bump check-if-email-exists to latest (#203)
2021-04-01 08:43:50 +00:00
"pin-project",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"pin-utils",
"serde",
"serde_derive",
"serde_json",
"thiserror",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "async-std"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
version = "1.10.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
checksum = "f8056f1455169ab86dd47b47391e4ab0cbd25410a70e9fe675544f49bafaf952"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
"async-channel",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"async-global-executor",
Add connection timeout
2020-08-21 22:36:03 +00:00
"async-io",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"async-lock",
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
"async-process",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"crossbeam-utils 0.8.5",
Add connection timeout
2020-08-21 22:36:03 +00:00
"futures-channel",
"futures-core",
"futures-io",
"futures-lite",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"gloo-timers",
Add connection timeout
2020-08-21 22:36:03 +00:00
"kv-log-macro",
"log",
"memchr",
"num_cpus",
"once_cell",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Add connection timeout
2020-08-21 22:36:03 +00:00
"pin-utils",
"slab",
"wasm-bindgen-futures",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "async-std-resolver"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
version = "0.20.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
checksum = "ed4e2c3da14d8ad45acb1e3191db7a918e9505b6f155b218e70a7c9a1a48c638"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"async-std",
"async-trait",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"futures-io",
"futures-util",
"pin-utils",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"trust-dns-resolver",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "async-stream"
version = "0.3.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "171374e7e3b2504e0e5236e3b59260560f9fe94bfe9ac39ba5e4e929c5590625"
dependencies = [
"async-stream-impl",
"futures-core",
]
[[package]]
name = "async-stream-impl"
version = "0.3.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "648ed8c8d2ce5409ccd57453d9d1b214b342a0d69376a6feda1fd6cae3299308"
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "async-task"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
version = "4.0.3"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
checksum = "e91831deabf0d6d7ec49552e489aed63b7456a7a3c46cff62adad428110b0af0"
Add connection timeout
2020-08-21 22:36:03 +00:00
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "async-trait"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.51"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "44318e776df68115a881de9a8fd1b9e53368d7a4a5ce4cc48517da3393233a5e"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "atomic-waker"
version = "1.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "065374052e7df7ee4047b1160cca5e1467a12351a40b3da123c870ba0b8eda2a"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "atty"
version = "0.2.14"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d9b39be18770d11421cdb1b9947a45dd3f37e93092cbf377614828a319d5fee8"
dependencies = [
"hermit-abi",
"libc",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "autocfg"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.0.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "cdb031dd78e28731d87d56cc8ffef4a8f36ca26c38fe2de700543e627f8a464a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "base64"
version = "0.12.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3441f0f7b02788e948e47f457ca01f1d7e6d92c693bc132c22b087d3141c03ff"
Bump reqwest from 0.10.8 to 0.10.9 (#50) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.10.8 to 0.10.9. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.8...v0.10.9) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:31 +00:00
[[package]]
name = "base64"
version = "0.13.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "904dfeac50f3cdaba28fc6f57fdcddb75f49ed61346676a78c4ffe55877802fd"
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "benches"
version = "0.0.0"
dependencies = [
"criterion",
"lychee-lib",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "bitflags"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.3.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "bef38d45163c2f1dde094a7dfd33ccf595c92905c8f8f4fdc18d06fb1037718a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
[[package]]
name = "block-buffer"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
version = "0.9.0"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
checksum = "4152116fd6e9dadb291ae18fc1ec3575ed6d84c29642d97890f4b4a3417297e4"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
dependencies = [
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"generic-array",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "blocking"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
version = "1.0.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
checksum = "c5e170dbede1f740736619b776d7251cb1b9095c435c34d8ca9f57fcd2f335e9"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"async-channel",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"async-task",
Add connection timeout
2020-08-21 22:36:03 +00:00
"atomic-waker",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"fastrand",
Add connection timeout
2020-08-21 22:36:03 +00:00
"futures-lite",
"once_cell",
]
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
[[package]]
name = "bstr"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.17"
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "ba3569f383e8f1598449f1a423e72e99569137b47740b1da11ef19af3d5c3223"
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
dependencies = [
"lazy_static",
"memchr",
"regex-automata",
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
"serde",
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "bufstream"
version = "0.1.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "40e38929add23cdf8a366df9b0e088953150724bcbe5fc330b0d8eb3b328eec8"
Add example folder (#241)
2021-04-30 11:33:24 +00:00
[[package]]
name = "builder"
version = "0.1.0"
dependencies = [
"http",
"lychee-lib",
"regex",
"reqwest",
"tokio",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "bumpalo"
Update deps
2021-11-03 22:45:42 +00:00
version = "3.8.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8f1e260c3a9040a7c19a12468758f4c16f31a81a1fe087482be9570ec864bb6c"
Add connection timeout
2020-08-21 22:36:03 +00:00
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "by_address"
version = "1.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e245704f60eb4eb45810d65cf14eb54d2eb50a6f3715fe2d7cd01ee905c2944f"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "bytes"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.1.0"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "c4872d67bab6358e59559027aa3b9157c53d9358c51423c17554809a8858e0f8"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "cache-padded"
version = "1.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "631ae5198c9be5e753e5cc215e1bd73c2b466a3565173db433f52bb9d3e66dba"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
[[package]]
name = "cached"
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
version = "0.26.2"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
checksum = "c2bc2fd249a24a9cdd4276f3a3e0461713271ab63b0e9e656e200e8e21c8c927"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
dependencies = [
"async-mutex",
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
"async-rwlock",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"async-trait",
"cached_proc_macro",
"cached_proc_macro_types",
"futures",
Update deps
2021-11-03 22:45:42 +00:00
"hashbrown",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"once_cell",
]
[[package]]
name = "cached_proc_macro"
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
version = "0.7.1"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.1 to 0.26.2 (#366) Bumps [cached](https://github.com/jaemk/cached) from 0.25.1 to 0.26.2. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:17:37 +00:00
checksum = "ac3531903b39df48a378a7ed515baee7c1fff32488489c7d0725eb1749b22a91"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
dependencies = [
"cached_proc_macro_types",
"darling",
"quote",
"syn",
]
[[package]]
name = "cached_proc_macro_types"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3a4f925191b4367301851c6d99b09890311d74b0d43f274c0b34c86d308a3663"
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "cast"
version = "0.2.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "4c24dab4283a142afa2fdca129b80ad2c6284e073930f964c3a1293c225ee39a"
dependencies = [
"rustc_version",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "cc"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.71"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "79c2681d6594606957bbb8631c4b90a7fcaaa72cdb714743a437b156d6a7eedd"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "cfg-if"
version = "0.1.10"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "4785bdd1c96b2a846b2bd7cc02e86b6b3dbf14e7e53446c4f54c92a361040822"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "cfg-if"
version = "1.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "baf1de4339761588bc0619e3cbc0120ee582ebb74b53b4efbf79117bd2da40fd"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "check-if-email-exists"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
version = "0.8.25"
Bump check-if-email-exists to latest (#203)
2021-04-01 08:43:50 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
checksum = "e8fbaa7cd916f5000cd377f60ab4333dd6a4ee970364637f7ceaa18e5faf9be1"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
"async-native-tls",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"async-smtp",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"async-std",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"async-std-resolver",
"fast-socks5",
"futures",
"log",
"mailchecker",
Update deps
2021-11-03 22:45:42 +00:00
"rand 0.8.4",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"regex",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"reqwest",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"serde",
"serde_json",
"trust-dns-proto",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "chrono"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.4.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "670ad68c9088c2a963aaa298cb369688cf3f9465ce5e2d4ca10e6e0098a1ce73"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"libc",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"num-integer",
"num-traits",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"time",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "clap"
version = "2.33.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "37e58ac78573c40708d45522f0d80fa2f01cc4f9b4e2bf749807255454312002"
dependencies = [
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
"ansi_term 0.11.0",
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
"atty",
"bitflags",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"strsim 0.8.0",
Bump wiremock from 0.5.2 to 0.5.7 (#313) Bumps [wiremock](https://github.com/LukeMathWalker/wiremock-rs) from 0.5.2 to 0.5.7. - [Release notes](https://github.com/LukeMathWalker/wiremock-rs/releases) - [Changelog](https://github.com/LukeMathWalker/wiremock-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/LukeMathWalker/wiremock-rs/compare/v0.5.2...v0.5.7) --- updated-dependencies: - dependency-name: wiremock dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-06 13:04:08 +00:00
"textwrap",
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
"unicode-width",
"vec_map",
]
Add example folder (#241)
2021-04-30 11:33:24 +00:00
[[package]]
name = "client_pool"
version = "0.1.0"
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"futures",
Add example folder (#241)
2021-04-30 11:33:24 +00:00
"lychee-lib",
"tokio",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"tokio-stream",
]
[[package]]
name = "cloudabi"
version = "0.0.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ddfc5b9aa5d4507acaf872de71051dfd0e309860e88966e1051e462a077aac4f"
dependencies = [
"bitflags",
Add example folder (#241)
2021-04-30 11:33:24 +00:00
]
[[package]]
name = "collect_links"
version = "0.1.0"
dependencies = [
"http",
"lychee-lib",
"regex",
"reqwest",
"tokio",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"tokio-stream",
Add example folder (#241)
2021-04-30 11:33:24 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "concurrent-queue"
version = "1.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "30ed07550be01594c6026cff2a1d7fe9c8f683caa798e12b68694ac9e88286a3"
dependencies = [
"cache-padded",
]
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "config"
version = "0.10.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "19b076e143e1d9538dde65da30f8481c2a6c44040edb8e02b9bf1351edb92ce3"
dependencies = [
"lazy_static",
Disable tokio console-subscriber as it is not published yet
2021-10-28 01:15:44 +00:00
"nom",
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
"serde",
]
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "console"
Bump console from 0.14.1 to 0.15.0 (#360)
2021-10-16 16:03:33 +00:00
version = "0.15.0"
Add progress bar
2020-10-10 04:31:28 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump console from 0.14.1 to 0.15.0 (#360)
2021-10-16 16:03:33 +00:00
checksum = "a28b32d32ca44b70c3e4acd7db1babf555fa026e385fb95f18028f88848b3c31"
Add progress bar
2020-10-10 04:31:28 +00:00
dependencies = [
"encode_unicode",
"libc",
Bump console from 0.14.1 to 0.15.0 (#360)
2021-10-16 16:03:33 +00:00
"once_cell",
Add progress bar
2020-10-10 04:31:28 +00:00
"regex",
"terminal_size",
"unicode-width",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "core-foundation"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.9.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "6888e10551bb93e424d8df1d07f1a8b4fceb0001a3a4b048bfc47554946f47b3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"core-foundation-sys",
"libc",
]
[[package]]
name = "core-foundation-sys"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "5827cebf4670468b8772dd191856768aedcb1b0278a04f989f7766351917b9dc"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
[[package]]
Update deps
2021-11-03 22:45:42 +00:00
name = "cpufeatures"
version = "0.2.1"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "95059428f66df56b63431fdb4e1947ed2190586af5c5a8a8b71122bdf5a7f469"
dependencies = [
"libc",
]
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "crc32fast"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.2.1"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "81156fece84ab6a9f2afdb109ce3ae577e42b1228441eded99bd77f627953b1a"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "criterion"
version = "0.3.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "1604dafd25fba2fe2d5895a9da139f8dc9b319a5fe5354ca137cbbce4e178d10"
dependencies = [
"atty",
"cast",
"clap",
"criterion-plot",
"csv",
"itertools",
"lazy_static",
"num-traits",
"oorandom",
"plotters",
"rayon",
"regex",
"serde",
"serde_cbor",
"serde_derive",
"serde_json",
"tinytemplate",
"walkdir",
]
[[package]]
name = "criterion-plot"
version = "0.4.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d00996de9f2f7559f7f4dc286073197f83e92256a59ed395f9aac01fe717da57"
dependencies = [
"cast",
"itertools",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "crossbeam"
version = "0.8.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "4ae5588f6b3c3cb05239e90bd110f257254aecd01e4635400391aeae07497845"
dependencies = [
"cfg-if 1.0.0",
"crossbeam-channel",
"crossbeam-deque",
"crossbeam-epoch 0.9.5",
"crossbeam-queue",
"crossbeam-utils 0.8.5",
]
[[package]]
name = "crossbeam-channel"
version = "0.5.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "06ed27e177f16d65f0f0c22a213e17c696ace5dd64b14258b52f9417ccb52db4"
dependencies = [
"cfg-if 1.0.0",
"crossbeam-utils 0.8.5",
]
[[package]]
name = "crossbeam-deque"
version = "0.8.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6455c0ca19f0d2fbf751b908d5c55c1f5cbc65e03c4225427254b46890bdde1e"
dependencies = [
"cfg-if 1.0.0",
"crossbeam-epoch 0.9.5",
"crossbeam-utils 0.8.5",
]
[[package]]
name = "crossbeam-epoch"
version = "0.8.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "058ed274caafc1f60c4997b5fc07bf7dc7cca454af7c6e81edffe5f33f70dace"
dependencies = [
"autocfg",
"cfg-if 0.1.10",
"crossbeam-utils 0.7.2",
"lazy_static",
"maybe-uninit",
"memoffset 0.5.6",
"scopeguard",
]
[[package]]
name = "crossbeam-epoch"
version = "0.9.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "4ec02e091aa634e2c3ada4a392989e7c3116673ef0ac5b72232439094d73b7fd"
dependencies = [
"cfg-if 1.0.0",
"crossbeam-utils 0.8.5",
"lazy_static",
"memoffset 0.6.4",
"scopeguard",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "crossbeam-queue"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.2"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "9b10ddc024425c88c2ad148c1b0fd53f4c6d38db9697c9f1588381212fa657c9"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
"crossbeam-utils 0.8.5",
]
[[package]]
name = "crossbeam-utils"
version = "0.7.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "c3c7c73a2d1e9fc0886a08b93e98eb643461230d5f1925e4036204d5f2e261a8"
dependencies = [
"autocfg",
"cfg-if 0.1.10",
"lazy_static",
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
]
[[package]]
name = "crossbeam-utils"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.5"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d82cfc11ce7f2c3faef78d8a684447b40d503d9681acebed6cb728d45940c4db"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Add connection timeout
2020-08-21 22:36:03 +00:00
"lazy_static",
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "csv"
version = "1.1.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "22813a6dc45b335f9bade10bf7271dc477e81113e89eb251a0bc2a8a81c536e1"
dependencies = [
"bstr",
"csv-core",
"itoa 0.4.8",
"ryu",
"serde",
]
[[package]]
name = "csv-core"
version = "0.1.10"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "2b2466559f260f48ad25fe6317b3c8dac77b5bdb5763ac7d9d6103530663bc90"
dependencies = [
"memchr",
]
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
[[package]]
name = "ctor"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.21"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "ccc0a48a9b826acdf4028595adc9db92caea352f7af011a3034acd172a52a0aa"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
dependencies = [
"quote",
"syn",
]
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
[[package]]
name = "darling"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
version = "0.13.0"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
checksum = "757c0ded2af11d8e739c4daea1ac623dd1624b06c844cf3f5a39f1bdbd99bb12"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
dependencies = [
"darling_core",
"darling_macro",
]
[[package]]
name = "darling_core"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
version = "0.13.0"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
checksum = "2c34d8efb62d0c2d7f60ece80f75e5c63c1588ba68032740494b0b9a996466e3"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
dependencies = [
"fnv",
"ident_case",
"proc-macro2",
"quote",
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
"strsim 0.10.0",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"syn",
]
[[package]]
name = "darling_macro"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
version = "0.13.0"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
checksum = "ade7bff147130fe5e6d39f089c6bd49ec0250f35d70b2eebf72afdfc919f15cc"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
dependencies = [
"darling_core",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "data-encoding"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "2.3.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "3ee2393c4a91429dffb4bedf19f4d6abf27d8a732c8ce4980305d782e5426d57"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "deadpool"
Bump deadpool from 0.6.0 to 0.7.0 (#88) Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.6.0 to 0.7.0. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.6.0...deadpool-v0.7.0) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-01-04 12:26:07 +00:00
version = "0.7.0"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump deadpool from 0.6.0 to 0.7.0 (#88) Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.6.0 to 0.7.0. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.6.0...deadpool-v0.7.0) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-01-04 12:26:07 +00:00
checksum = "3d126179d86aee4556e54f5f3c6bf6d9884e7cc52cef82f77ee6f90a7747616d"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
dependencies = [
"async-trait",
"config",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"crossbeam-queue",
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
"num_cpus",
"serde",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
]
Bump deadpool from 0.7.0 to 0.9.1 (#371) * Bump deadpool from 0.7.0 to 0.9.1 Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.7.0 to 0.9.1. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.7.0...deadpool-v0.9.1) --- updated-dependencies: - dependency-name: deadpool dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Attempt fix for deadpool v0.8.0+ (#372) Signed-off-by: MichaIng <micha@dietpi.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: MichaIng <micha@dietpi.com>
2021-10-28 00:05:58 +00:00
[[package]]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
name = "derivative"
version = "2.2.0"
Bump deadpool from 0.7.0 to 0.9.1 (#371) * Bump deadpool from 0.7.0 to 0.9.1 Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.7.0 to 0.9.1. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.7.0...deadpool-v0.9.1) --- updated-dependencies: - dependency-name: deadpool dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Attempt fix for deadpool v0.8.0+ (#372) Signed-off-by: MichaIng <micha@dietpi.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: MichaIng <micha@dietpi.com>
2021-10-28 00:05:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
checksum = "fcc3dd5e9e9c0b295d6e1e4d811fb6f157d5ffd784b8d202fc62eac8035a770b"
Bump deadpool from 0.7.0 to 0.9.1 (#371) * Bump deadpool from 0.7.0 to 0.9.1 Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.7.0 to 0.9.1. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.7.0...deadpool-v0.9.1) --- updated-dependencies: - dependency-name: deadpool dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Attempt fix for deadpool v0.8.0+ (#372) Signed-off-by: MichaIng <micha@dietpi.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: MichaIng <micha@dietpi.com>
2021-10-28 00:05:58 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"proc-macro2",
"quote",
"syn",
Bump deadpool from 0.7.0 to 0.9.1 (#371) * Bump deadpool from 0.7.0 to 0.9.1 Bumps [deadpool](https://github.com/bikeshedder/deadpool) from 0.7.0 to 0.9.1. - [Release notes](https://github.com/bikeshedder/deadpool/releases) - [Changelog](https://github.com/bikeshedder/deadpool/blob/master/CHANGELOG.md) - [Commits](https://github.com/bikeshedder/deadpool/compare/deadpool-v0.7.0...deadpool-v0.9.1) --- updated-dependencies: - dependency-name: deadpool dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Attempt fix for deadpool v0.8.0+ (#372) Signed-off-by: MichaIng <micha@dietpi.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: MichaIng <micha@dietpi.com>
2021-10-28 00:05:58 +00:00
]
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
[[package]]
name = "diff"
version = "0.1.12"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "0e25ea47919b1560c4e3b7fe0aaab9becf5b84a10325ddf7db0f0ba5e1026499"
Reintegrate master
2021-09-08 23:49:25 +00:00
[[package]]
name = "difflib"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6184e33543162437515c2e2b48714794e37845ec9851711914eec9d308f6ebe8"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
[[package]]
name = "digest"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
version = "0.9.0"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
checksum = "d3dd60d1080a57a05ab032377049e0591415d2b31afd7028356dbf3cc6dcb066"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
dependencies = [
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"generic-array",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
]
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
[[package]]
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
name = "dirs-next"
version = "2.0.0"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
checksum = "b98cf8ebf19c3d1b223e151f99a4f9f0690dca41414773390fc824184ac833e1"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
"dirs-sys-next",
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
]
[[package]]
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
name = "dirs-sys-next"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.1.2"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "4ebda144c4fe02d1f7ea1a7d9641b6fc6b580adcfa024ae48797ecdeb6825b4d"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
dependencies = [
"libc",
"redox_users",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
]
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "doc-comment"
version = "0.3.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "fea41bba32d969b513997752735605054bc0dfa92b4c56bf1189f2e174be7a10"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "either"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.6.1"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "e78d4f1cc4ae33bbfc157ed5d5a5ef3bc29227303d595861deb238fcec4e9457"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "encode_unicode"
version = "0.3.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "a357d28ed41a50f9c765dbfe56cbc04a64e53e5fc58ba79fbc34c10ef3df831f"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "encoding_rs"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.29"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a74ea89a0a1b98f6332de42c95baff457ada66d1cb4030f9ff151b2041a1c746"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "enum-as-inner"
version = "0.3.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "7c5f0096a91d210159eceb2ff5e1c4da18388a170e1e3ce948aac9c8fdbbf595"
dependencies = [
"heck",
"proc-macro2",
"quote",
"syn",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "event-listener"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "2.5.1"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "f7531096570974c3a9dcf9e4b8e1cede1ec26cf5046219fb3b9d897503b9be59"
Add connection timeout
2020-08-21 22:36:03 +00:00
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "extract"
version = "0.1.0"
dependencies = [
"lychee-lib",
"tokio",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "fast-socks5"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
version = "0.4.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.24 to 0.8.25 (#352) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.24 to 0.8.25. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.24...v0.8.25) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 12:56:20 +00:00
checksum = "ba337793c1ee49731350a8d971d791651ed51d6e814ab4ddabd79c12b5366140"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"anyhow",
"async-std",
"futures",
"log",
"thiserror",
]
[[package]]
name = "fast_chemail"
version = "0.9.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "495a39d30d624c2caabe6312bfead73e7717692b44e0b32df168c275a2e8e9e4"
dependencies = [
"ascii_utils",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "fastrand"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.5.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "b394ed3d285a429378d3b384b9eb1285267e7df4b166df24b7a6939a04dc392e"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
dependencies = [
"instant",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "flate2"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.22"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1e6988e897c1c9c485f43b47a529cef42fde0547f9d8d41a7062518f1d8fc53f"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
"crc32fast",
"libc",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"miniz_oxide",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "float-cmp"
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
version = "0.9.0"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
checksum = "98de4bbd547a563b716d8dfa9aad1cb19bfab00f4fa09a6a4ed21dbcf44ce9c4"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
dependencies = [
"num-traits",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "flume"
version = "0.10.9"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "24c3fd473b3a903a62609e413ed7538f99e10b665ecb502b5e481a95283f8ab4"
dependencies = [
"futures-core",
"futures-sink",
"nanorand",
"pin-project",
"spin 0.9.2",
]
[[package]]
name = "flurry"
version = "0.3.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8c0a35f7b50e99185a2825541946252f669f3c3ca77801357cd682a1b356bb3e"
dependencies = [
"ahash",
"crossbeam-epoch 0.8.2",
"num_cpus",
"parking_lot 0.10.2",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "fnv"
version = "1.0.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3f9eec918d3f24069decb9af1554cad7c880e2da24a9afd88aca000531ab82c1"
[[package]]
name = "foreign-types"
version = "0.3.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f6f339eb8adc052cd2ca78910fda869aefa38d22d5cb648e6485e4d3fc06f3b1"
dependencies = [
"foreign-types-shared",
]
[[package]]
name = "foreign-types-shared"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "00b0228411908ca8685dba7fc2cdd70ec9990a6e753e89b6ac91a84c40fbaf4b"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
[[package]]
name = "form_urlencoded"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "1.0.1"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "5fc25a87fa4fd2094bffb06925852034d90a17f0d1e05197d4956d3555752191"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
dependencies = [
"matches",
"percent-encoding",
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "futf"
version = "0.1.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "7c9c1ce3fa9336301af935ab852c437817d14cd33690446569392e65170aac3b"
dependencies = [
"mac",
"new_debug_unreachable",
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "futures"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "28560757fe2bb34e79f907794bb6b22ae8b0e5c669b638a1132f2592b19035b4"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
"futures-channel",
"futures-core",
"futures-executor",
"futures-io",
"futures-sink",
"futures-task",
"futures-util",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "futures-channel"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "ba3dda0b6588335f360afc675d0564c17a77a2bda81ca178a4b6081bd86c7f0b"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"futures-core",
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
"futures-sink",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
[[package]]
name = "futures-core"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "d0c8ff0461b82559810cdccfde3215c3f373807f5e5232b71479bff7bb2583d7"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "futures-executor"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "29d6d2ff5bb10fb95c85b8ce46538a2e5f5e7fdc755623a7d4529ab8a4ed9d2a"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
"futures-core",
"futures-task",
"futures-util",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "futures-io"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "b1f9d34af5a1aac6fb380f735fe510746c38067c5bf16c7fd250280503c971b2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "futures-lite"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.12.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7694489acd39452c77daa48516b894c153f192c3578d5a839b62c58099fcbf48"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"fastrand",
"futures-core",
"futures-io",
"memchr",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"parking",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Add connection timeout
2020-08-21 22:36:03 +00:00
"waker-fn",
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "futures-macro"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "6dbd947adfffb0efc70599b3ddcf7b5597bb5fa9e245eb99f62b3a5f7bb8bd3c"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "futures-sink"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "e3055baccb68d74ff6480350f8d6eb8fcfa3aa11bdc1a1ae3afdd0514617d508"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "futures-task"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "6ee7c6485c30167ce4dfb83ac568a849fe53274c831081476ee13e0dce1aad72"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "futures-timer"
version = "3.0.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e64b03909df88034c26dc1547e8970b91f98bdb65165d6a4e9110d94263dbb2c"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "futures-util"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump futures from 0.3.18 to 0.3.19 (#430) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.18 to 0.3.19. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.18...0.3.19) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-20 14:37:18 +00:00
checksum = "d9b5cf40b47a271f77a8b1bec03ca09044d99d2372c0de244e66430761127164"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
"futures-channel",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"futures-core",
"futures-io",
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
"futures-macro",
"futures-sink",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"futures-task",
"memchr",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"pin-utils",
"slab",
]
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
[[package]]
name = "generic-array"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
version = "0.14.4"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
checksum = "501466ecc8a30d1d3b7fc9229b122b2ce8ed6e9d9223f1138d4babb253e51817"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
dependencies = [
"typenum",
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
"version_check",
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
]
feat: Support relative URLs (#15)
2020-10-20 23:31:06 +00:00
[[package]]
name = "getopts"
version = "0.2.21"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "14dbbfd5c71d70241ecf9e6f13737f7b5ce823821063188d7e46c41d371eebd5"
dependencies = [
"unicode-width",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "getrandom"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.1.16"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "8fc3cb4d91f53b50155bdcfd23f6a4c39ae1969c2ae85982b135750cccaf5fce"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"libc",
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
"wasi 0.9.0+wasi-snapshot-preview1",
]
[[package]]
name = "getrandom"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.3"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7fcd999463524c52659517fe2cea98493cfe485d10565e7b0fb07dbba7ad2753"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
"js-sys",
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
"libc",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"wasi 0.10.2+wasi-snapshot-preview1",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"wasm-bindgen",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add globbing support
2020-08-14 00:33:04 +00:00
[[package]]
name = "glob"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "9b919933a397b79c37e33b77bb2aa3dc8eb6e165ad809e58ff75bc7db2e34574"
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "gloo-timers"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "47204a46aaff920a1ea58b11d03dec6f704287d27561724a4631e450654a891f"
dependencies = [
"futures-channel",
"futures-core",
"js-sys",
"wasm-bindgen",
"web-sys",
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "h2"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.7"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7fd819562fcebdac5afc5c113c3ec36f902840b70fd4fc458799c8ce4607ae55"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"fnv",
"futures-core",
"futures-sink",
"futures-util",
"http",
"indexmap",
"slab",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
"tokio-util",
Update deps
2020-08-18 22:10:59 +00:00
"tracing",
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "half"
version = "1.8.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "eabb4a44450da02c90444cf74558da904edde8fb4e9035a9a6a4e15445af0bd7"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
[[package]]
name = "hashbrown"
version = "0.11.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ab5ef0d4909ef3724cc8cce6ccc8572c5c817592e9285f5464f8e86f8bd3726e"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
[[package]]
name = "headers"
Bump headers from 0.3.4 to 0.3.5 (#365) Bumps [headers](https://github.com/hyperium/headers) from 0.3.4 to 0.3.5. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.4...headers-v0.3.5) --- updated-dependencies: - dependency-name: headers dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:19:21 +00:00
version = "0.3.5"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump headers from 0.3.4 to 0.3.5 (#365) Bumps [headers](https://github.com/hyperium/headers) from 0.3.4 to 0.3.5. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.4...headers-v0.3.5) --- updated-dependencies: - dependency-name: headers dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:19:21 +00:00
checksum = "a4c4eb0471fcb85846d8b0690695ef354f9afb11cb03cac2e1d7c9253351afb0"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
dependencies = [
Bump headers from 0.3.2 to 0.3.3 Bumps [headers](https://github.com/hyperium/headers) from 0.3.2 to 0.3.3. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.2...headers-v0.3.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-14 07:12:27 +00:00
"base64 0.13.0",
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
"bitflags",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
"headers-core",
"http",
Update deps
2021-11-03 22:45:42 +00:00
"httpdate",
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
"mime",
"sha-1",
]
[[package]]
name = "headers-core"
version = "0.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e7f66481bfee273957b1f20485a4ff3362987f85b2c236580d81b4eb7a326429"
dependencies = [
"http",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "heck"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "6d621efb26863f0e9924c6ac577e8275e5e6b77455db64ffa6c65c904e9e132c"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"unicode-segmentation",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "hermit-abi"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "62b467343b94ba476dcb2500d242dadbb39557df889310ac77c5d99100aaac33"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"libc",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "hostname"
version = "0.1.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "21ceb46a83a85e824ef93669c8b390009623863b5c195d1ba747292c0c72f94e"
dependencies = [
"libc",
"winutil",
]
[[package]]
name = "hostname"
version = "0.3.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3c731c3e10504cc8ed35cfe2f1db4c9274c3d35fa486e3b31df46f068ef3e867"
dependencies = [
"libc",
"match_cfg",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "html5ever"
version = "0.25.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "aafcf38a1a36118242d29b92e1b08ef84e67e4a5ed06e0a80be20e6a32bfed6b"
dependencies = [
"log",
"mac",
"markup5ever",
"proc-macro2",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "http"
Bump http from 0.2.5 to 0.2.6 (#438) Bumps [http](https://github.com/hyperium/http) from 0.2.5 to 0.2.6. - [Release notes](https://github.com/hyperium/http/releases) - [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md) - [Commits](https://github.com/hyperium/http/compare/v0.2.5...v0.2.6) --- updated-dependencies: - dependency-name: http dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-31 17:33:22 +00:00
version = "0.2.6"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump http from 0.2.5 to 0.2.6 (#438) Bumps [http](https://github.com/hyperium/http) from 0.2.5 to 0.2.6. - [Release notes](https://github.com/hyperium/http/releases) - [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md) - [Commits](https://github.com/hyperium/http/compare/v0.2.5...v0.2.6) --- updated-dependencies: - dependency-name: http dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-31 17:33:22 +00:00
checksum = "31f4c6746584866f0feabcc69893c5b51beef3831656a968ed7ae254cdc4fd03"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"fnv",
Bump http from 0.2.5 to 0.2.6 (#438) Bumps [http](https://github.com/hyperium/http) from 0.2.5 to 0.2.6. - [Release notes](https://github.com/hyperium/http/releases) - [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md) - [Commits](https://github.com/hyperium/http/compare/v0.2.5...v0.2.6) --- updated-dependencies: - dependency-name: http dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-31 17:33:22 +00:00
"itoa 1.0.1",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "http-body"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.4"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1ff4f84919677303da5f147645dbea6b1881f368d03ac84e1dc09031ebd7b2c6"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"http",
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
"pin-project-lite",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "http-types"
Bump wiremock from 0.5.2 to 0.5.7 (#313) Bumps [wiremock](https://github.com/LukeMathWalker/wiremock-rs) from 0.5.2 to 0.5.7. - [Release notes](https://github.com/LukeMathWalker/wiremock-rs/releases) - [Changelog](https://github.com/LukeMathWalker/wiremock-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/LukeMathWalker/wiremock-rs/compare/v0.5.2...v0.5.7) --- updated-dependencies: - dependency-name: wiremock dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-06 13:04:08 +00:00
version = "2.12.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump wiremock from 0.5.2 to 0.5.7 (#313) Bumps [wiremock](https://github.com/LukeMathWalker/wiremock-rs) from 0.5.2 to 0.5.7. - [Release notes](https://github.com/LukeMathWalker/wiremock-rs/releases) - [Changelog](https://github.com/LukeMathWalker/wiremock-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/LukeMathWalker/wiremock-rs/compare/v0.5.2...v0.5.7) --- updated-dependencies: - dependency-name: wiremock dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-06 13:04:08 +00:00
checksum = "6e9b187a72d63adbfba487f48095306ac823049cb504ee195541e91c7775f5ad"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"anyhow",
Make lychee usable as a library #13 (#46) This splits up the code into a `lib` and a `bin` to make the runtime usable from other crates. Co-authored-by: Paweł Romanowski <pawroman@pawroman.dev>
2020-12-04 09:44:31 +00:00
"async-channel",
"base64 0.13.0",
"futures-lite",
Add connection timeout
2020-08-21 22:36:03 +00:00
"http",
"infer",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand 0.7.3",
Add connection timeout
2020-08-21 22:36:03 +00:00
"serde",
"serde_json",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
"serde_qs",
Bump reqwest from 0.10.8 to 0.10.9 (#50) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.10.8 to 0.10.9. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.8...v0.10.9) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:31 +00:00
"serde_urlencoded",
Add connection timeout
2020-08-21 22:36:03 +00:00
"url",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "httparse"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.5.1"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "acd94fdbe1d4ff688b67b04eee2e17bd50995534a61539e45adfefb45e5e5503"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
Bump headers from 0.3.4 to 0.3.5 (#365) Bumps [headers](https://github.com/hyperium/headers) from 0.3.4 to 0.3.5. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.4...headers-v0.3.5) --- updated-dependencies: - dependency-name: headers dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 23:19:21 +00:00
[[package]]
name = "httpdate"
version = "1.0.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6456b8a6c8f33fee7d958fcd1b60d55b11940a79e63ae87013e6d22e26034440"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "hubcaps"
Bump hubcaps from 0.6.1 to 0.6.2 (#43) Bumps [hubcaps](https://github.com/softprops/hubcaps) from 0.6.1 to 0.6.2. - [Release notes](https://github.com/softprops/hubcaps/releases) - [Changelog](https://github.com/softprops/hubcaps/blob/master/CHANGELOG.md) - [Commits](https://github.com/softprops/hubcaps/compare/v0.6.1...v0.6.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-29 20:48:40 +00:00
version = "0.6.2"
Bump hubcaps from `324d02f` to `a9e6616` (#166) Bumps [hubcaps](https://github.com/softprops/hubcaps) from `324d02f` to `a9e6616`. - [Release notes](https://github.com/softprops/hubcaps/releases) - [Commits](https://github.com/softprops/hubcaps/compare/324d02fbb371782c82e9a13b839b86894475c91f...a9e6616ecc7b8eef0ea0eaf6055d9610c8961500) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-01 09:05:25 +00:00
source = "git+https://github.com/softprops/hubcaps.git#a9e6616ecc7b8eef0ea0eaf6055d9610c8961500"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"base64 0.13.0",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"data-encoding",
"futures",
"http",
"hyperx",
"jsonwebtoken",
"log",
"mime",
"percent-encoding",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"reqwest",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"serde",
"serde_derive",
"serde_json",
"url",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "hyper"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.14.14"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "2b91bb1f221b6ea1f1e4371216b70f40748774c2fb5971b450c07773fb92d26b"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"futures-channel",
"futures-core",
"futures-util",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"h2",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"http",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"http-body",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"httparse",
Update deps
2021-11-03 22:45:42 +00:00
"httpdate",
Bump serde_json from 1.0.72 to 1.0.73 (#422) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-14 13:00:58 +00:00
"itoa 0.4.8",
Update deps
2021-11-03 22:45:42 +00:00
"pin-project-lite",
"socket2 0.4.2",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"tower-service",
Update deps
2020-08-18 22:10:59 +00:00
"tracing",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"want",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "hyper-tls"
version = "0.5.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d6183ddfa99b85da61a140bea0efc93fdf56ceaa041b37d553518030827f9905"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
"hyper",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"native-tls",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"tokio-native-tls",
]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
[[package]]
name = "hyperx"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.4.0"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "5617e92fc2f2501c3e2bc6ce547cad841adba2bae5b921c7e52510beca6d084c"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"base64 0.13.0",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"http",
Update deps
2021-11-03 22:45:42 +00:00
"httpdate",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"language-tags",
"mime",
"percent-encoding",
"unicase",
]
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
[[package]]
name = "ident_case"
version = "1.0.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "b9e0384b61958566e926dc50660321d12159025e767c18e043daf26b70104c39"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "idna"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "418a0a6fab821475f634efe3ccc45c013f742efe03d853e8d3355d5cb850ecf8"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"matches",
"unicode-bidi",
"unicode-normalization",
]
[[package]]
name = "indexmap"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.7.0"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "bc633605454125dec4b66843673f01c7df2b89479b32e0ed634e43a91cff62a5"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"autocfg",
Update deps
2021-11-03 22:45:42 +00:00
"hashbrown",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "indicatif"
version = "0.15.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "7baab56125e25686df467fe470785512329883aab42696d661247aca2a2896e4"
dependencies = [
"console",
"lazy_static",
"number_prefix",
"regex",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "infer"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
version = "0.2.3"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
checksum = "64e9829a50b42bb782c1df523f78d332fe371b10c661e78b7a3c34b0198e9fac"
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "instant"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.12"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7a5bbe824c507c5da5956355e86a746d82e0e1464f65d862cc5e71da70e94b2c"
Make lychee usable as a library #13 (#46) This splits up the code into a `lib` and a `bin` to make the runtime usable from other crates. Co-authored-by: Paweł Romanowski <pawroman@pawroman.dev>
2020-12-04 09:44:31 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Make lychee usable as a library #13 (#46) This splits up the code into a `lib` and a `bin` to make the runtime usable from other crates. Co-authored-by: Paweł Romanowski <pawroman@pawroman.dev>
2020-12-04 09:44:31 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "ipconfig"
version = "0.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f7e2f18aece9709094573a9f24f483c4f65caa4298e2f7ae1b71cc65d853fad7"
dependencies = [
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
"socket2 0.3.19",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"widestring",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"winreg 0.6.2",
]
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "ipnet"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.3.1"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "68f2d64f2edebec4ce84ad108148e67e1064789bee435edc5b60ad398714a3a9"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
Reintegrate master
2021-09-08 23:49:25 +00:00
[[package]]
name = "itertools"
version = "0.10.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "69ddb889f9d0d08a67338271fa9b62996bc788c7796a5c18cf057420aaed5eaf"
dependencies = [
"either",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "itoa"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.8"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "b71991ff56294aa922b450139ee08b3bfc70982c6b2c7562771375cf73542dd4"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Bump serde_json from 1.0.72 to 1.0.73 (#422) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-14 13:00:58 +00:00
[[package]]
name = "itoa"
version = "1.0.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "1aab8fc367588b89dcee83ab0fd66b72b50b72fa1904d7095045ace2b0c81c35"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "js-sys"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.55"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7cc9ffccd38c451a86bf13657df244e9c3f37493cce8e5e21e940963777acc84"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"wasm-bindgen",
]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
[[package]]
name = "jsonwebtoken"
version = "7.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "afabcc15e437a6484fc4f12d0fd63068fe457bf93f1c148d3d9649c60b103f32"
dependencies = [
"base64 0.12.3",
"pem",
"ring",
"serde",
"serde_json",
"simple_asn1",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "jwalk"
version = "0.6.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "172752e853a067cbce46427de8470ddf308af7fd8ceaf9b682ef31a5021b6bb9"
dependencies = [
"crossbeam",
"rayon",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "kv-log-macro"
version = "1.0.7"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "0de8b303297635ad57c9f5059fd9cee7a47f8e8daa09df0fcd07dd39fb22977f"
dependencies = [
"log",
]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
[[package]]
name = "language-tags"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.2"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d4345964bb142484797b161f473a503a434de77149dd8c7427788c6e13379388"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "lazy_static"
version = "1.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e2abad23fbc42b3700f2f279844dc832adb2b2eb069b2df918f455c4e18cc646"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "lexical-core"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.7.6"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "6607c62aa161d23d17a9072cc5da0be67cdfc89d3afb1e8d9c842bebc2525ffe"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"arrayvec",
"bitflags",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"ryu",
"static_assertions",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "libc"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.106"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a60553f9a9e039a333b4e9b20573b9e9b9c0bb3a11e201ccc48ef4283456d673"
Add connection timeout
2020-08-21 22:36:03 +00:00
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "linked-hash-map"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.5.4"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "7fb9b38af92608140b86b693604b9ffcc5824240a484d1ecd4795bacb2fe88f3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
Switch to linkify to cover non MD links
2020-08-09 21:12:25 +00:00
[[package]]
name = "linkify"
Bump linkify from 0.7.0 to 0.8.0 (#409) Bumps [linkify](https://github.com/robinst/linkify) from 0.7.0 to 0.8.0. - [Release notes](https://github.com/robinst/linkify/releases) - [Changelog](https://github.com/robinst/linkify/blob/main/CHANGELOG.md) - [Commits](https://github.com/robinst/linkify/compare/0.7.0...0.8.0) --- updated-dependencies: - dependency-name: linkify dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-26 12:33:41 +00:00
version = "0.8.0"
Switch to linkify to cover non MD links
2020-08-09 21:12:25 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump linkify from 0.7.0 to 0.8.0 (#409) Bumps [linkify](https://github.com/robinst/linkify) from 0.7.0 to 0.8.0. - [Release notes](https://github.com/robinst/linkify/releases) - [Changelog](https://github.com/robinst/linkify/blob/main/CHANGELOG.md) - [Commits](https://github.com/robinst/linkify/compare/0.7.0...0.8.0) --- updated-dependencies: - dependency-name: linkify dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-26 12:33:41 +00:00
checksum = "ccbcd666d915aa3ae3c3774999a9e20b2776a018309b8159d07df062b91f45e8"
Switch to linkify to cover non MD links
2020-08-09 21:12:25 +00:00
dependencies = [
"memchr",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "lock_api"
version = "0.3.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "c4da24a77a3d8a6d4862d95f72e6fdb9c09a643ecdb402d754004a557f2bec75"
dependencies = [
"scopeguard",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "lock_api"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.5"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "712a4d093c9976e24e7dbca41db895dabcbac38eb5f4045393d17a95bdfb1109"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"scopeguard",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "log"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.4.14"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "51b9bbe6c47d51fc3e1a9b945965946b4c44142ab8792c50835a980d362c2710"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"value-bag",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "lru-cache"
version = "0.1.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "31e24f1ad8321ca0e8a1e0ac13f23cb668e6f5466c2c57319f6a5cf1cc8e3b1c"
dependencies = [
"linked-hash-map",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "lychee"
Bump version to 0.8.1 (#396)
2021-11-17 23:59:28 +00:00
version = "0.8.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Clean up error handling and configure reqwests
2020-08-07 22:06:17 +00:00
"anyhow",
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
"assert_cmd",
Add support for colored output
2021-02-18 23:41:49 +00:00
"console",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"futures",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"headers",
"http",
"indicatif",
"lazy_static",
"lychee-lib",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"once_cell",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"openssl-sys",
"pad",
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
"predicates",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"pretty_assertions",
"regex",
"reqwest",
"ring",
"serde",
"serde_json",
"structopt",
Add support for different output formats (compact, detailed, markdown) (#375)
2021-11-17 23:44:48 +00:00
"tabled",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"tempfile",
"tokio",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"tokio-stream",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"toml",
Disable tokio console-subscriber as it is not published yet
2021-10-28 01:15:44 +00:00
"tracing-subscriber",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"uuid",
"wiremock",
]
[[package]]
name = "lychee-lib"
Bump version to 0.8.1 (#396)
2021-11-17 23:59:28 +00:00
version = "0.8.1"
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"async-stream",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"cached",
Major refactor of codebase (#208) - The binary component and library component are separated as two packages in the same workspace. - `lychee` is the binary component, in `lychee-bin/*`. - `lychee-lib` is the library component, in `lychee-lib/*`. - Users can now install only the `lychee-lib`, instead of both components, that would require fewer dependencies and faster compilation. - Dependencies for each component are adjusted and updated. E.g., no CLI dependencies for `lychee-lib`. - CLI tests are only moved to `lychee`, as it has nothing to do with the library component. - `Status::Error` is refactored to contain dedicated error enum, `ErrorKind`. - The motivation is to delay the formatting of errors to strings. Note that `e.to_string()` is not necessarily cheap (though trivial in many cases). The formatting is no delayed until the error is needed to be displayed to users. So in some cases, if the error is never used, it means that it won't be formatted at all. - Replaced `regex` based matching with one of the following: - Simple string equality test in the case of 'false positivie'. - URL parsing based test, in the case of extracting repository and user name for GitHub links. - Either cases would be much more efficient than `regex` based matching. First, there's no need to construct a state machine for regex. Second, URL is already verified and parsed on its creation, and extracting its components is fairly cheap. Also, this removes the dependency on `lazy-static` in `lychee-lib`. - `types` module now has a sub-directory, and its components are now separated into their own modules (in that sub-directory). - `lychee-lib::test_utils` module is only compiled for tests. - `wiremock` is moved to `dev-dependency` as it's only needed for `test` modules. - Dependencies are listed in alphabetical order. - Imports are organized in the following fashion: - Imports from `std` - Imports from 3rd-party crates, and `lychee-lib`. - Imports from `crate::*` or `super::*`. - No glob import. - I followed suggestion from `cargo clippy`, with `clippy::all` and `clippy:pedantic`. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-14 23:24:11 +00:00
"check-if-email-exists",
Add doc-comment tests
2021-02-18 10:14:00 +00:00
"doc-comment",
Fix URLs with '@' parsing as emails (#177) * Fix URLs with '@' parsing as emails Only consider a link an email if it fails to parse as URL. Also use a proper email validation instead of a simple '@' check. This uses the fast_chemail crate which parses email links according to the HTML specification (which is much more practical than checking for RFC 5322 formatted emails). It's also worth noting that fast_chemail is used internally (albeit indirectly) by the check_if_email_exists crate. This means that email addresses not considered valid by fast_chemail wouldn't pass link checks anyway. * Fix comment in test
2021-03-14 19:10:36 +00:00
"fast_chemail",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"futures",
Add globbing support
2020-08-14 00:33:04 +00:00
"glob",
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
"html5ever",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"http",
"hubcaps",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"jwalk",
Exclude known false-positives from Github API check (#445) Fixes https://github.com/lycheeverse/lychee/issues/431
2022-01-05 23:33:53 +00:00
"lazy_static",
Switch to linkify to cover non MD links
2020-08-09 21:12:25 +00:00
"linkify",
Add support for local files
2021-06-16 11:03:36 +00:00
"log",
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
"once_cell",
Build binaries for Linux, Windows, and macOS for every release (#74) * Build binaries for Linux, Windows, and macOS for every release * Add vendored-openssl feature flag This allows us to trigger a build which includes a static dependency to openssl by compiling it from source in a build.rs script. It is useful for Linux, which has wildly different config parameters for different architectures. * Add openssl-sys as direct dependency This allows us to pass the vendored-openssl feature flag to this dependency and compile openssl from source * Update Cargo.lock * Cleanup
2020-12-11 21:13:26 +00:00
"openssl-sys",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"par-stream",
Fix resolving absolute paths The previous solution didn't resolve to absolute paths and rather removed things like `.` and `..`.
2021-09-02 23:42:57 +00:00
"path-clean",
Avoid double-encoding already encoded destination paths E.g. `web%20site` becomes `web site`. That's because Url::from_file_path will encode the full URL in the end. This behavior cannot be configured. See https://github.com/lycheeverse/lychee/pull/262#issuecomment-915245411
2021-09-08 23:44:10 +00:00
"percent-encoding",
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
"pretty_assertions",
feat: Support relative URLs (#15)
2020-10-20 23:31:06 +00:00
"pulldown-cmark",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"regex",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"reqwest",
"ring",
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
"serde",
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
"shellexpand",
"tempfile",
Use thiserror for error handling (#399) This removes some boilerplate and is arguably better than handwriting the error handling code for maintainability and avoid inconsitent functionality for the error variants. thiserror is also the de-facto standard for library error types as of today.
2021-11-20 00:42:50 +00:00
"thiserror",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
More refactor (#225) - Major changes in `lychee-lib::filter` module: - Fields in `Excludes` except the `RegexSet` is now moved to `Filter`. - `Filter` contains `Option<Excludes>` and `Option<Includes>`, which are wrapper struct of `RegexSet` instead of `Option<RegexSet>`. As a result the code now looks cleaner. - Factored out some filtering logics to dedicated functions. - It's possible to write tests for those functions in addition to tests for the `Filter` struct. - Added docs to `Filter::is_excluded` and reorgnized the code. - placed `derive_builder` by `typed_builder`: - The internal interface very ugly, as admitted by the author, but we no longer have nested `Option`s like before. - As a result, the `Client` building is much easier to read. - Main benefit of `typed_builder` is, the arguments feeded to builder is checked at compile time instead of run-time. - Fixed a bug in `lychee::tests::usage` and `lychee-lib::stats::test`. - Now it will clear environment variable which would otherwise cause an issue if `GITHUB_TOKEN` is set. - Updated dependencies. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-16 18:25:22 +00:00
"typed-builder",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
"url",
Add connection timeout
2020-08-21 22:36:03 +00:00
"wiremock",
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "mac"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "c41e0c4fef86961ac6d6f8a82609f55f31b05e4fce149ac5710e439df7619ba4"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "mailchecker"
Update deps
2021-11-03 22:45:42 +00:00
version = "4.0.13"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7ae68b057bc5965602b575e4b816dfaf69e702a4b932740ef6b4769308e12f07"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"fast_chemail",
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "markup5ever"
Refactor extractor (#354) This avoids sending URLs back and forth between the different parsers. Also, it should allow for future optimizations to reduce allocs.
2021-10-07 10:51:02 +00:00
version = "0.10.1"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Refactor extractor (#354) This avoids sending URLs back and forth between the different parsers. Also, it should allow for future optimizations to reduce allocs.
2021-10-07 10:51:02 +00:00
checksum = "a24f40fb03852d1cdd84330cddcaf98e9ec08a7b7768e952fad3b4cf048ec8fd"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
dependencies = [
"log",
"phf",
"phf_codegen",
"string_cache",
"string_cache_codegen",
"tendril",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "match_cfg"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ffbee8634e0d45d258acb448e7eaab3fce7a0a467395d4d9f228e3c1f01fb2e4"
Bump tracing-subscriber from 0.2.25 to 0.3.0 (#368) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.2.25 to 0.3.0. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.25...tracing-subscriber-0.3.0) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 22:56:39 +00:00
[[package]]
name = "matchers"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8263075bb86c5a1b1427b5ae862e8889656f126e9f77c484496e8b47cf5c5558"
dependencies = [
"regex-automata",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "matches"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.9"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a3e378b66a060d48947b590737b30a1be76706c8dd7b8ba0f2fe3989c68a853f"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "maybe-uninit"
version = "2.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "60302e4db3a61da70c0cb7991976248362f30319e88850c487b9b95bbf059e00"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "memchr"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.4.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "308cc39be01b73d0d18f82a0e7b2a3df85245f84af96fdddc5d202d27e47b86a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "memoffset"
version = "0.5.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "043175f069eda7b85febe4a74abbaeff828d9f8b448515d3151a14a3542811aa"
dependencies = [
"autocfg",
]
[[package]]
name = "memoffset"
version = "0.6.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "59accc507f1338036a0477ef61afdae33cde60840f4dfe481319ce3ad116ddf9"
dependencies = [
"autocfg",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "mime"
version = "0.3.16"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "2a60c7ce501c71e03a9c9c0d35b861413ae925bd979cc7a4e30d060069aaac8d"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "miniz_oxide"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "0.4.4"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "a92518e98c078586bc6c934028adcca4c92a53d6a958196de835170a01d84e4b"
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
dependencies = [
"adler",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"autocfg",
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
name = "mio"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.7.14"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8067b404fe97c70829f082dec8bcf4f71225d7eaea1d8645349cb76fa06205cc"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"libc",
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
"log",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"miow",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"ntapi",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "miow"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "0.3.7"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "b9f1c5b025cda876f66ef43a113f91ebc9f4ccef34843000e0adf6ebbab84e21"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "nanorand"
version = "0.6.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "729eb334247daa1803e0a094d0a5c55711b85571179f5ec6e53eccfdf7008958"
dependencies = [
"getrandom 0.2.3",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "native-tls"
Bump reqwest from 0.11.4 to 0.11.5 (#356) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.4 to 0.11.5. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5) --- updated-dependencies: - dependency-name: reqwest dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-10 00:41:08 +00:00
version = "0.2.8"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump reqwest from 0.11.4 to 0.11.5 (#356) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.4 to 0.11.5. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.4...v0.11.5) --- updated-dependencies: - dependency-name: reqwest dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-10 00:41:08 +00:00
checksum = "48ba9f7719b5a0f42f338907614285fb5fd70e53858141f69898a1fb7203b24d"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"lazy_static",
"libc",
"log",
"openssl",
"openssl-probe",
"openssl-sys",
"schannel",
"security-framework",
"security-framework-sys",
"tempfile",
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "new_debug_unreachable"
version = "1.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "e4a24736216ec316047a1fc4252e27dabb04218aa4a3f37c6e7ddbf1f9782b54"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "nom"
version = "5.1.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ffb4262d26ed83a1c0a33a38fe2bb15797329c85770da05e6b828ddb782627af"
dependencies = [
"lexical-core",
"memchr",
"version_check",
]
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "normalize-line-endings"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "61807f77802ff30975e01f4f071c8ba10c022052f98b3294119f3e615d13e5be"
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
name = "ntapi"
version = "0.3.6"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
checksum = "3f6bb902e437b6d86e03cce10a7e2af662292c5dfef23b65899ea3ac9354ad44"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
[[package]]
name = "num-bigint"
version = "0.2.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "090c7f9998ee0ff65aa5b723e4009f7b217707f1fb5ea551329cc4d6231fb304"
dependencies = [
"autocfg",
"num-integer",
"num-traits",
]
[[package]]
name = "num-integer"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.1.44"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "d2cc698a63b549a70bc047073d2949cce27cd1c7b0a4a862d08a8031bc2801db"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
dependencies = [
"autocfg",
"num-traits",
]
[[package]]
name = "num-traits"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.2.14"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "9a64b1ec5cda2586e284722486d802acf1f7dbdc623e2bfc57e65ca1cd099290"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
dependencies = [
"autocfg",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "num_cpus"
version = "1.13.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "05499f3756671c15885fee9034446956fff3f243d6077b91e5767df161f766b3"
dependencies = [
"hermit-abi",
"libc",
]
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "number_prefix"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "17b02fc0ff9a9e4b35b3342880f48e896ebf69f2967921fe8646bf5b7125956a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "once_cell"
Bump once_cell from 1.8.0 to 1.9.0 (#423) Bumps [once_cell](https://github.com/matklad/once_cell) from 1.8.0 to 1.9.0. - [Release notes](https://github.com/matklad/once_cell/releases) - [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md) - [Commits](https://github.com/matklad/once_cell/compare/v1.8.0...v1.9.0) --- updated-dependencies: - dependency-name: once_cell dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-15 12:45:19 +00:00
version = "1.9.0"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump once_cell from 1.8.0 to 1.9.0 (#423) Bumps [once_cell](https://github.com/matklad/once_cell) from 1.8.0 to 1.9.0. - [Release notes](https://github.com/matklad/once_cell/releases) - [Changelog](https://github.com/matklad/once_cell/blob/master/CHANGELOG.md) - [Commits](https://github.com/matklad/once_cell/compare/v1.8.0...v1.9.0) --- updated-dependencies: - dependency-name: once_cell dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-15 12:45:19 +00:00
checksum = "da32515d9f6e6e489d7bc9d84c71b060db7247dc035bbe44eac88cf87486d8d5"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "oorandom"
version = "11.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "0ab1bc2a289d34bd04a330323ac98a1b4bc82c9d9fcb1e66b63caa84da26b575"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
[[package]]
name = "opaque-debug"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
version = "0.3.0"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump headers from 0.3.3 to 0.3.4 (#170) Bumps [headers](https://github.com/hyperium/headers) from 0.3.3 to 0.3.4. - [Release notes](https://github.com/hyperium/headers/releases) - [Commits](https://github.com/hyperium/headers/compare/headers-v0.3.3...headers-v0.3.4) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2021-03-04 11:30:59 +00:00
checksum = "624a8340c38c1b80fd549087862da4ba43e08858af025b236e509b6649fc13d5"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "openssl"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.10.38"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "0c7ae222234c30df141154f159066c5093ff73b63204dcda7121eb082fc56a95"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"bitflags",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"foreign-types",
"libc",
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
"once_cell",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"openssl-sys",
]
[[package]]
name = "openssl-probe"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.4"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "28988d872ab76095a6e6ac88d99b54fd267702734fd7ffe610ca27f533ddb95a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Build binaries for Linux, Windows, and macOS for every release (#74) * Build binaries for Linux, Windows, and macOS for every release * Add vendored-openssl feature flag This allows us to trigger a build which includes a static dependency to openssl by compiling it from source in a build.rs script. It is useful for Linux, which has wildly different config parameters for different architectures. * Add openssl-sys as direct dependency This allows us to pass the vendored-openssl feature flag to this dependency and compile openssl from source * Update Cargo.lock * Cleanup
2020-12-11 21:13:26 +00:00
[[package]]
name = "openssl-src"
Bump openssl-sys from 0.9.71 to 0.9.72 (#421) Bumps [openssl-sys](https://github.com/sfackler/rust-openssl) from 0.9.71 to 0.9.72. - [Release notes](https://github.com/sfackler/rust-openssl/releases) - [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-sys-v0.9.71...openssl-sys-v0.9.72) --- updated-dependencies: - dependency-name: openssl-sys dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-13 12:26:15 +00:00
version = "111.16.0+1.1.1l"
Build binaries for Linux, Windows, and macOS for every release (#74) * Build binaries for Linux, Windows, and macOS for every release * Add vendored-openssl feature flag This allows us to trigger a build which includes a static dependency to openssl by compiling it from source in a build.rs script. It is useful for Linux, which has wildly different config parameters for different architectures. * Add openssl-sys as direct dependency This allows us to pass the vendored-openssl feature flag to this dependency and compile openssl from source * Update Cargo.lock * Cleanup
2020-12-11 21:13:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump openssl-sys from 0.9.71 to 0.9.72 (#421) Bumps [openssl-sys](https://github.com/sfackler/rust-openssl) from 0.9.71 to 0.9.72. - [Release notes](https://github.com/sfackler/rust-openssl/releases) - [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-sys-v0.9.71...openssl-sys-v0.9.72) --- updated-dependencies: - dependency-name: openssl-sys dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-13 12:26:15 +00:00
checksum = "7ab2173f69416cf3ec12debb5823d244127d23a9b127d5a5189aa97c5fa2859f"
Build binaries for Linux, Windows, and macOS for every release (#74) * Build binaries for Linux, Windows, and macOS for every release * Add vendored-openssl feature flag This allows us to trigger a build which includes a static dependency to openssl by compiling it from source in a build.rs script. It is useful for Linux, which has wildly different config parameters for different architectures. * Add openssl-sys as direct dependency This allows us to pass the vendored-openssl feature flag to this dependency and compile openssl from source * Update Cargo.lock * Cleanup
2020-12-11 21:13:26 +00:00
dependencies = [
"cc",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "openssl-sys"
Bump openssl-sys from 0.9.71 to 0.9.72 (#421) Bumps [openssl-sys](https://github.com/sfackler/rust-openssl) from 0.9.71 to 0.9.72. - [Release notes](https://github.com/sfackler/rust-openssl/releases) - [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-sys-v0.9.71...openssl-sys-v0.9.72) --- updated-dependencies: - dependency-name: openssl-sys dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-13 12:26:15 +00:00
version = "0.9.72"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump openssl-sys from 0.9.71 to 0.9.72 (#421) Bumps [openssl-sys](https://github.com/sfackler/rust-openssl) from 0.9.71 to 0.9.72. - [Release notes](https://github.com/sfackler/rust-openssl/releases) - [Commits](https://github.com/sfackler/rust-openssl/compare/openssl-sys-v0.9.71...openssl-sys-v0.9.72) --- updated-dependencies: - dependency-name: openssl-sys dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-13 12:26:15 +00:00
checksum = "7e46109c383602735fa0a2e48dd2b7c892b048e1bf69e5c3b1d804b7d9c203cb"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"autocfg",
"cc",
"libc",
Build binaries for Linux, Windows, and macOS for every release (#74) * Build binaries for Linux, Windows, and macOS for every release * Add vendored-openssl feature flag This allows us to trigger a build which includes a static dependency to openssl by compiling it from source in a build.rs script. It is useful for Linux, which has wildly different config parameters for different architectures. * Add openssl-sys as direct dependency This allows us to pass the vendored-openssl feature flag to this dependency and compile openssl from source * Update Cargo.lock * Cleanup
2020-12-11 21:13:26 +00:00
"openssl-src",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"pkg-config",
"vcpkg",
]
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
[[package]]
name = "output_vt100"
version = "0.1.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "53cdc5b785b7a58c5aad8216b3dfa114df64b0b06ae6e1501cef91df2fbdf8f9"
dependencies = [
"winapi",
]
Show input source in status output If an error occurs during link checking, it is important to know where the error occured. Therefore the request and response objects now contain a the input source as a field. This makes error tracking easier.
2021-02-15 23:15:14 +00:00
[[package]]
name = "pad"
version = "0.1.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d2ad9b889f1b12e0b9ee24db044b5129150d5eada288edc800f789928dc8c0e3"
dependencies = [
"unicode-width",
]
Add support for different output formats (compact, detailed, markdown) (#375)
2021-11-17 23:44:48 +00:00
[[package]]
name = "papergrid"
version = "0.1.23"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6fe93a33fc67c8a9d21f3fefa54c4a991e08d2eba5f2fd6f327ca520862eddfb"
dependencies = [
"unicode-width",
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "par-stream"
version = "0.7.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "2f9c49089732ef484eee337df6312564f73bbce4e2d5fde5a823730f86038390"
dependencies = [
"by_address",
"derivative",
"flume",
"flurry",
"futures",
"num_cpus",
"pin-project",
"tokio",
"tokio-stream",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "parking"
version = "2.0.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "427c3892f9e783d91cc128285287e70a59e206ca452770ece88a76f7a3eddd72"
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "parking_lot"
version = "0.10.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d3a704eb390aafdc107b0e392f56a82b668e3a71366993b5340f5833fd62505e"
dependencies = [
"lock_api 0.3.4",
"parking_lot_core 0.7.2",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "parking_lot"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.11.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7d17b78036a60663b797adeaee46f5c9dfebb86948d1255007a1d6be0271ff99"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"instant",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"lock_api 0.4.5",
"parking_lot_core 0.8.5",
]
[[package]]
name = "parking_lot_core"
version = "0.7.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d58c7c768d4ba344e3e8d72518ac13e259d7c7ade24167003b8488e10b6740a3"
dependencies = [
"cfg-if 0.1.10",
"cloudabi",
"libc",
"redox_syscall 0.1.57",
"smallvec",
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
[[package]]
name = "parking_lot_core"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.5"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d76e8e1493bcac0d2766c42737f34458f1c8c50c0d23bcb24ea953affb273216"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Add connection timeout
2020-08-21 22:36:03 +00:00
"instant",
"libc",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"redox_syscall 0.2.10",
Add connection timeout
2020-08-21 22:36:03 +00:00
"smallvec",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Fix resolving absolute paths The previous solution didn't resolve to absolute paths and rather removed things like `.` and `..`.
2021-09-02 23:42:57 +00:00
[[package]]
name = "path-clean"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ecba01bf2678719532c5e3059e0b5f0811273d94b397088b82e3bd0a78c78fdd"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "pem"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "0.8.3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "fd56cbd21fea48d0c440b41cd69c589faacade08c992d9a54e471b79d0fd13eb"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"base64 0.13.0",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"once_cell",
"regex",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
[[package]]
name = "percent-encoding"
version = "2.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d4fd5641d01c8f18a23da7b6fe29298ff4b55afcccdf78973b24cf3175fee32e"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "phf"
version = "0.8.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3dfb61232e34fcb633f43d12c58f83c1df82962dcdfa565a4e866ffc17dafe12"
dependencies = [
"phf_shared",
]
[[package]]
name = "phf_codegen"
version = "0.8.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "cbffee61585b0411840d3ece935cce9cb6321f01c45477d30066498cd5e1a815"
dependencies = [
"phf_generator",
"phf_shared",
]
[[package]]
name = "phf_generator"
version = "0.8.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "17367f0cc86f2d25802b2c26ee58a7b23faeccf78a396094c13dced0d0182526"
dependencies = [
"phf_shared",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand 0.7.3",
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
]
[[package]]
name = "phf_shared"
version = "0.8.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "c00cf8b9eafe68dde5e9eaa2cef8ee84a9336a47d566ec55ca16589633b65af7"
dependencies = [
"siphasher",
]
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
[[package]]
name = "pin-project"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.8"
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "576bc800220cc65dac09e99e97b08b358cfab6e17078de8dc5fee223bd2d0c08"
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
dependencies = [
Bump check-if-email-exists to latest (#203)
2021-04-01 08:43:50 +00:00
"pin-project-internal",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
[[package]]
name = "pin-project-internal"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.8"
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "6e8fe8163d14ce7f0cdac2e040116f22eac817edabff0be91e8aff7e9accf389"
Bump futures from 0.3.5 to 0.3.8 (#58) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.5 to 0.3.8. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/rust-lang/futures-rs/compare/0.3.5...0.3.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-12-01 10:08:35 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "pin-project-lite"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.7"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8d31d11c69a6b52a174b42bdc0c30e5e11670f90788b2c471c31c1d17d449443"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "pin-utils"
version = "0.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8b870d8c151b6f2fb93e84a13146138f05d02ed11c7e7c54f8826aaaf7c9f184"
[[package]]
name = "pkg-config"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.22"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "12295df4f294471248581bc09bef3c38a5e46f1e36d6a37353621a0c6c357e1f"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "plotters"
version = "0.3.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "32a3fd9ec30b9749ce28cd91f255d569591cdf937fe280c312143e3c4bad6f2a"
dependencies = [
"num-traits",
"plotters-backend",
"plotters-svg",
"wasm-bindgen",
"web-sys",
]
[[package]]
name = "plotters-backend"
version = "0.3.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d88417318da0eaf0fdcdb51a0ee6c3bed624333bff8f946733049380be67ac1c"
[[package]]
name = "plotters-svg"
version = "0.3.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "521fa9638fa597e1dc53e9412a4f9cefb01187ee1f7413076f9e6749e2885ba9"
dependencies = [
"plotters-backend",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "polling"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.1.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "92341d779fa34ea8437ef4d82d440d5e1ce3f3ff7f824aa64424cd481f9a1f25"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Add connection timeout
2020-08-21 22:36:03 +00:00
"libc",
Bump check-if-email-exists from 0.8.13 to 0.8.15 (#49) Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.13 to 0.8.15. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.13...v0.8.15) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:01 +00:00
"log",
Update deps
2021-11-03 22:45:42 +00:00
"wepoll-ffi",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "ppv-lite86"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.15"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "ed0cfbc8191465bed66e1718596ee0b0b35d5ee1f41c5df2189d0fe8bde535ba"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "precomputed-hash"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "925383efa346730478fb4838dbe9137d2a47675ad789c546d150a6e1dd4ab31c"
Reintegrate master
2021-09-08 23:49:25 +00:00
[[package]]
name = "predicates"
Bump predicates from 2.0.3 to 2.1.0 (#404) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 2.0.3 to 2.1.0. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v2.0.3...v2.1.0) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-23 12:31:50 +00:00
version = "2.1.0"
Reintegrate master
2021-09-08 23:49:25 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump predicates from 2.0.3 to 2.1.0 (#404) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 2.0.3 to 2.1.0. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v2.0.3...v2.1.0) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-23 12:31:50 +00:00
checksum = "95e5a7689e456ab905c22c2b48225bb921aba7c8dfa58440d68ba13f6222a715"
Reintegrate master
2021-09-08 23:49:25 +00:00
dependencies = [
"difflib",
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
"float-cmp",
Reintegrate master
2021-09-08 23:49:25 +00:00
"itertools",
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
"normalize-line-endings",
Reintegrate master
2021-09-08 23:49:25 +00:00
"predicates-core",
Bump predicates from 1.0.8 to 2.0.3 (#381) Bumps [predicates](https://github.com/assert-rs/predicates-rs) from 1.0.8 to 2.0.3. - [Release notes](https://github.com/assert-rs/predicates-rs/releases) - [Changelog](https://github.com/assert-rs/predicates-rs/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/predicates-rs/compare/v1.0.8...v2.0.3) --- updated-dependencies: - dependency-name: predicates dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-11-18 22:22:38 +00:00
"regex",
Reintegrate master
2021-09-08 23:49:25 +00:00
]
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "predicates-core"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.0.2"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "57e35a3326b75e49aa85f5dc6ec15b41108cf5aee58eabb1f274dd18b73c2451"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "predicates-tree"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.4"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "338c7be2905b732ae3984a2f40032b5e94fd8f52505b186c7d4d68d193445df7"
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
dependencies = [
"predicates-core",
Update deps
2021-11-03 22:45:42 +00:00
"termtree",
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
]
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
[[package]]
name = "pretty_assertions"
Bump pretty_assertions from 0.7.2 to 1.0.0 (#347) Bumps [pretty_assertions](https://github.com/colin-kiegel/rust-pretty-assertions) from 0.7.2 to 1.0.0. - [Release notes](https://github.com/colin-kiegel/rust-pretty-assertions/releases) - [Changelog](https://github.com/colin-kiegel/rust-pretty-assertions/blob/main/CHANGELOG.md) - [Commits](https://github.com/colin-kiegel/rust-pretty-assertions/compare/v0.7.2...v1.0.0) --- updated-dependencies: - dependency-name: pretty_assertions dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-28 22:56:15 +00:00
version = "1.0.0"
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump pretty_assertions from 0.7.2 to 1.0.0 (#347) Bumps [pretty_assertions](https://github.com/colin-kiegel/rust-pretty-assertions) from 0.7.2 to 1.0.0. - [Release notes](https://github.com/colin-kiegel/rust-pretty-assertions/releases) - [Changelog](https://github.com/colin-kiegel/rust-pretty-assertions/blob/main/CHANGELOG.md) - [Commits](https://github.com/colin-kiegel/rust-pretty-assertions/compare/v0.7.2...v1.0.0) --- updated-dependencies: - dependency-name: pretty_assertions dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-28 22:56:15 +00:00
checksum = "ec0cfe1b2403f172ba0f234e500906ee0a3e493fb81092dac23ebefe129301cc"
Assume HTML in case there is no extension (e.g. for URLs) (#197)
2021-04-12 12:40:39 +00:00
dependencies = [
"ansi_term 0.12.1",
"ctor",
"diff",
"output_vt100",
]
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "proc-macro-error"
version = "1.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "da25490ff9892aab3fcf7c36f08cfb902dd3e71ca0f9f9517bea02a73a5ce38c"
dependencies = [
"proc-macro-error-attr",
"proc-macro2",
"quote",
"syn",
"version_check",
]
[[package]]
name = "proc-macro-error-attr"
version = "1.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "a1be40180e52ecc98ad80b184934baf3d0d29f979574e439af5a55274b35f869"
dependencies = [
"proc-macro2",
"quote",
"version_check",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "proc-macro2"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.32"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "ba508cc11742c0dc5c1659771673afbab7a0efab23aa17e854cbab0837ed0b43"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"unicode-xid",
]
feat: Support relative URLs (#15)
2020-10-20 23:31:06 +00:00
[[package]]
name = "pulldown-cmark"
Bump pulldown-cmark from 0.8.0 to 0.9.0 (#433) Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark) from 0.8.0 to 0.9.0. - [Release notes](https://github.com/raphlinus/pulldown-cmark/releases) - [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.0) --- updated-dependencies: - dependency-name: pulldown-cmark dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-23 12:49:54 +00:00
version = "0.9.0"
feat: Support relative URLs (#15)
2020-10-20 23:31:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump pulldown-cmark from 0.8.0 to 0.9.0 (#433) Bumps [pulldown-cmark](https://github.com/raphlinus/pulldown-cmark) from 0.8.0 to 0.9.0. - [Release notes](https://github.com/raphlinus/pulldown-cmark/releases) - [Commits](https://github.com/raphlinus/pulldown-cmark/compare/v0.8.0...v0.9.0) --- updated-dependencies: - dependency-name: pulldown-cmark dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-23 12:49:54 +00:00
checksum = "acd16514d1af5f7a71f909a44ef253cdb712a376d7ebc8ae4a471a9be9743548"
feat: Support relative URLs (#15)
2020-10-20 23:31:06 +00:00
dependencies = [
"bitflags",
"getopts",
"memchr",
"unicase",
]
Add logging and proper URL parsing
2020-08-07 17:00:21 +00:00
[[package]]
name = "quick-error"
version = "1.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "a1d01941d82fa2ab50be1e79e6714289dd7cde78eba4c074bc5a4374f650dfe0"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "quote"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.10"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "38bc8cc6a5f2e3655e0899c1b848643b2562f853f114bfec7be120678e3ace05"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"proc-macro2",
]
[[package]]
name = "rand"
version = "0.7.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6a6b1679d49b24bbfe0c803429aa1874472f50d9b363131f0e89fc356b544d03"
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"getrandom 0.1.16",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"libc",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand_chacha 0.2.2",
"rand_core 0.5.1",
"rand_hc 0.2.0",
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
"rand_pcg",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
[[package]]
name = "rand"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.4"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "2e7573632e6454cf6b99d7aac4ccca54be06da05aca2ef7423d22d27d4d4bcd8"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
dependencies = [
"libc",
Update deps
2021-11-03 22:45:42 +00:00
"rand_chacha 0.3.1",
"rand_core 0.6.3",
"rand_hc 0.3.1",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "rand_chacha"
version = "0.2.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f4c8ed856279c9737206bf725bf36935d8666ead7aa69b52be55af369d193402"
dependencies = [
"ppv-lite86",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand_core 0.5.1",
]
[[package]]
name = "rand_chacha"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.1"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "e6c10a63a0fa32252be49d21e7709d4d4baf8d231c2dbce1eaa8141b9b127d88"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
dependencies = [
"ppv-lite86",
Update deps
2021-11-03 22:45:42 +00:00
"rand_core 0.6.3",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
[[package]]
name = "rand_core"
version = "0.5.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "90bde5296fc891b0cef12a6d03ddccc162ce7b2aff54160af9338f8d40df6d19"
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"getrandom 0.1.16",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
[[package]]
name = "rand_core"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.6.3"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d34f1408f55294453790c48b2f1ebbb1c5b4b7563eb1f418bcfcfdbb06ebb4e7"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
dependencies = [
Update deps
2021-11-03 22:45:42 +00:00
"getrandom 0.2.3",
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "rand_hc"
version = "0.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ca3129af7b92a17112d59ad498c6f81eaf463253766b90396d39ea7a39d6613c"
dependencies = [
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand_core 0.5.1",
]
[[package]]
name = "rand_hc"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.1"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d51e9f596de227fda2ea6c84607f5558e196eeaf43c986b724ba4fb8fdf497e7"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
dependencies = [
Update deps
2021-11-03 22:45:42 +00:00
"rand_core 0.6.3",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "rand_pcg"
version = "0.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "16abd0c1b639e9eb4d7c50c0b8100b0d0f849be2349829c740fe8e6eb4816429"
dependencies = [
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
"rand_core 0.5.1",
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "rayon"
version = "1.5.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "c06aca804d41dbc8ba42dfd964f0d01334eceb64314b9ecf7c5fad5188a06d90"
dependencies = [
"autocfg",
"crossbeam-deque",
"either",
"rayon-core",
]
[[package]]
name = "rayon-core"
version = "1.9.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d78120e2c850279833f1dd3582f730c4ab53ed95aeaaaa862a2a5c71b1656d8e"
dependencies = [
"crossbeam-channel",
"crossbeam-deque",
"crossbeam-utils 0.8.5",
"lazy_static",
"num_cpus",
]
[[package]]
name = "redox_syscall"
version = "0.1.57"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "41cc0f7e4d5d4544e8861606a285bb08d3e70712ccc7d2b84d7c0ccfaf4b05ce"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "redox_syscall"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.10"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8383f39639269cde97d255a32bdb68c047337295414940c68bdd30c2e13203ff"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
dependencies = [
"bitflags",
]
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
[[package]]
name = "redox_users"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.4.0"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "528532f3d801c87aec9def2add9ca802fe569e44a544afe633765267840abe64"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
dependencies = [
Update deps
2021-11-03 22:45:42 +00:00
"getrandom 0.2.3",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"redox_syscall 0.2.10",
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "regex"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.5.4"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d07a8629359eb56f1e2fb1652bb04212c072a87ba68546a04065d525673ac461"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"aho-corasick",
"memchr",
"regex-syntax",
]
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
[[package]]
name = "regex-automata"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.10"
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "6c230d73fb8d8c1b9c0b3135c5142a8acee3a0558fb8db5cf1cb65f8d7862132"
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
dependencies = [
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
"regex-syntax",
Bump assert_cmd from 1.0.2 to 1.0.3 Bumps [assert_cmd](https://github.com/assert-rs/assert_cmd) from 1.0.2 to 1.0.3. - [Release notes](https://github.com/assert-rs/assert_cmd/releases) - [Changelog](https://github.com/assert-rs/assert_cmd/blob/master/CHANGELOG.md) - [Commits](https://github.com/assert-rs/assert_cmd/compare/v1.0.2...v1.0.3) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-02-02 06:45:53 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "regex-syntax"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.6.25"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "f497285884f3fcff424ffc933e56d7cbca511def0c9831a7f9b5f6153e3cc89b"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "remove_dir_all"
version = "0.5.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "3acd125665422973a33ac9d3dd2df85edad0f4ae9b00dafb1a05e43a9f5ef8e7"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "reqwest"
Bump reqwest from 0.11.7 to 0.11.8 (#432) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.7 to 0.11.8. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.7...v0.11.8) --- updated-dependencies: - dependency-name: reqwest dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-21 15:28:22 +00:00
version = "0.11.8"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump reqwest from 0.11.7 to 0.11.8 (#432) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.11.7 to 0.11.8. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.11.7...v0.11.8) --- updated-dependencies: - dependency-name: reqwest dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-21 15:28:22 +00:00
checksum = "7c4e0a76dc12a116108933f6301b95e83634e0c47b0afbed6abbaa0601e99258"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
dependencies = [
"async-compression",
"base64 0.13.0",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"encoding_rs",
"futures-core",
"futures-util",
"http",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"http-body",
"hyper",
"hyper-tls",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"ipnet",
"js-sys",
"lazy_static",
"log",
"mime",
"native-tls",
"percent-encoding",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"serde",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"serde_json",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"serde_urlencoded",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"tokio-native-tls",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio-socks",
"tokio-util",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"url",
"wasm-bindgen",
"wasm-bindgen-futures",
"web-sys",
"winreg 0.7.0",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "resolv-conf"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.7.0"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "52e44394d2086d010551b14b53b1f24e31647570cd1deb0379e2c21b329aba00"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"hostname 0.3.1",
"quick-error",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
[[package]]
name = "ring"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.16.20"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "3053cf52e236a3ed746dfc745aa9cacf1b791d846bdaf412f60a8d7d6e17c8fc"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"cc",
"libc",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"once_cell",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"spin 0.5.2",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"untrusted",
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
"web-sys",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "rustc_version"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "bfa0f585226d2e68097d4f95d113b15b83a82e819ab25717ec0590d9584ef366"
dependencies = [
"semver",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "ryu"
version = "1.0.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "71d301d4193d031abdd79ff7e3dd721168a9572ef3fe51a1517aba235bd8f86e"
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "same-file"
version = "1.0.6"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "93fc1dc3aaa9bfed95e02e6eadabb4baf7e3078b0bd1b4d7b6b0b68378900502"
dependencies = [
"winapi-util",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "schannel"
version = "0.1.19"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8f05ba609c234e60bee0d547fe94a4c7e9da733d1c962cf6e59efa4cd9c8bc75"
dependencies = [
"lazy_static",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "scopeguard"
version = "1.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d29ab0c6d3fc0ee92fe66e2d99f700eab17a8d57d1c1d3b748380fb20baa78cd"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "security-framework"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.4.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "525bc1abfda2e1998d152c45cf13e696f76d0a4972310b22fac1658b05df7c87"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"bitflags",
"core-foundation",
"core-foundation-sys",
"libc",
"security-framework-sys",
]
[[package]]
name = "security-framework-sys"
Update deps
2021-11-03 22:45:42 +00:00
version = "2.4.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a9dd14d83160b528b7bfd66439110573efcfbe281b17fc2ca9f39f550d619c7e"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"core-foundation-sys",
"libc",
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "semver"
version = "1.0.4"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "568a8e6258aa33c13358f81fd834adb854c6f7c9468520910a9b1e8fac068012"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "serde"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
version = "1.0.130"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
checksum = "f12d06de37cf59146fbdecab66aa99f9fe4f78722e3607577a5375d66bd0c913"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
dependencies = [
"serde_derive",
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "serde_cbor"
version = "0.11.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "2bef2ebfde456fb76bbcf9f59315333decc4fda0b2b44b420243c11e0f5ec1f5"
dependencies = [
"half",
"serde",
]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
[[package]]
name = "serde_derive"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
version = "1.0.130"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
checksum = "d7bc1a1ab1961464eae040d96713baa5a724a8152c1222492465b54322ec508b"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "serde_json"
Bump serde_json from 1.0.73 to 1.0.74 (#441) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.73 to 1.0.74. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.73...v1.0.74) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-03 19:53:17 +00:00
version = "1.0.74"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump serde_json from 1.0.73 to 1.0.74 (#441) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.73 to 1.0.74. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.73...v1.0.74) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-03 19:53:17 +00:00
checksum = "ee2bb9cd061c5865d345bb02ca49fcef1391741b672b54a0bf7b679badec3142"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Bump serde_json from 1.0.72 to 1.0.73 (#422) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-14 13:00:58 +00:00
"itoa 1.0.1",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"ryu",
"serde",
]
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
[[package]]
name = "serde_qs"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.5"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "c7715380eec75f029a4ef7de39a9200e0a63823176b759d055b613f5a87df6a6"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
dependencies = [
"percent-encoding",
"serde",
"thiserror",
]
[[package]]
name = "serde_urlencoded"
version = "0.7.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "edfa57a7f8d9c1d260a549e7224100f6c43d43f9103e06dd8b4095a9b2b43ce9"
dependencies = [
"form_urlencoded",
Bump serde_json from 1.0.72 to 1.0.73 (#422) Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.72 to 1.0.73. - [Release notes](https://github.com/serde-rs/json/releases) - [Commits](https://github.com/serde-rs/json/compare/v1.0.72...v1.0.73) --- updated-dependencies: - dependency-name: serde_json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-14 13:00:58 +00:00
"itoa 0.4.8",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
"ryu",
"serde",
]
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
[[package]]
name = "sha-1"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.9.8"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "99cd6713db3cf16b6c84e06321e049a9b9f699826e16096d23bbcc44d15d51a6"
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
dependencies = [
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"block-buffer",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Update deps
2021-11-03 22:45:42 +00:00
"cpufeatures",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"digest",
"opaque-debug",
Add support for basic auth #18 (#20) [Issue #18](https://github.com/hello-rust/lychee/issues/18) * Add headers crate to type headers and create auth header * Add cmd param basic-auth to set property to the main * Add simple test to test if with auth headres is no broken Signed-off-by: FabianBG <f4b4g3@gmail.com>
2020-10-26 08:23:45 +00:00
]
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
[[package]]
name = "sharded-slab"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.4"
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "900fba806f70c630b0a382d0d825e17a0f19fcd059a2ade1ff237bcddf446b31"
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
dependencies = [
"lazy_static",
]
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
[[package]]
name = "shellexpand"
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
version = "2.1.0"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
checksum = "83bdb7831b2d85ddf4a7b148aa19d0587eddbe8671a436b7bd1182eaad0f2829"
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
dependencies = [
Bump shellexpand from 2.0.0 to 2.1.0 Bumps [shellexpand](https://github.com/netvl/shellexpand) from 2.0.0 to 2.1.0. - [Release notes](https://github.com/netvl/shellexpand/releases) - [Commits](https://github.com/netvl/shellexpand/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-23 06:59:22 +00:00
"dirs-next",
Add support for reading from stdin and make input handling more robust (closes #26) * Adds a `skip_missing` flag * Adds an `Input` enum to handle different types of inputs
2020-12-02 22:28:37 +00:00
]
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
[[package]]
name = "signal-hook"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.10"
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "9c98891d737e271a2954825ef19e46bd16bdb98e2746f2eec4f7a4ef7946efd1"
Bump check-if-email-exists from 0.8.16 to 0.8.17 Bumps [check-if-email-exists](https://github.com/amaurymartiny/check-if-email-exists) from 0.8.16 to 0.8.17. - [Release notes](https://github.com/amaurymartiny/check-if-email-exists/releases) - [Changelog](https://github.com/amaurymartiny/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/amaurymartiny/check-if-email-exists/compare/v0.8.16...v0.8.17) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-06 07:49:49 +00:00
dependencies = [
"libc",
"signal-hook-registry",
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "signal-hook-registry"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.4.0"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "e51e73328dc4ac0c7ccbda3a494dfa03df1de2f46018127f60c693f2648455b0"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
"libc",
]
Add example folder (#241)
2021-04-30 11:33:24 +00:00
[[package]]
name = "simple"
version = "0.1.0"
dependencies = [
"lychee-lib",
"tokio",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "simple_asn1"
version = "0.4.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
checksum = "692ca13de57ce0613a363c8c2f1de925adebc81b04c923ac60c5488bb44abe4b"
dependencies = [
"chrono",
"num-bigint",
"num-traits",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "siphasher"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.7"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "533494a8f9b724d33625ab53c6c4800f7cc445895924a8ef649222dcb76e938b"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
name = "slab"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.5"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "9def91fd1e018fe007022791f865d0ccc9b3a0d5001e01aabb8b40e46000afb5"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "smallvec"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.7.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1ecab6c735a6bb4139c0caafd0cc3635748bbb3acf4550e8138122099251f309"
Add connection timeout
2020-08-21 22:36:03 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "socket2"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
version = "0.3.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
checksum = "122e570113d28d773067fab24266b66753f6ea915758651696b6e35e49f88d6e"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
"libc",
"winapi",
]
[[package]]
name = "socket2"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.2"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "5dc90fe6c7be1a323296982db1836d1ea9e47b6839496dde9a541bc496df3516"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
dependencies = [
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"libc",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
[[package]]
name = "spin"
version = "0.5.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "6e63cff320ae2c57904679ba7cb63280a3dc4613885beafb148ee7bf9aa9042d"
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "spin"
version = "0.9.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "511254be0c5bcf062b019a6c89c01a664aa359ded62f78aa72c6fc137c0590e5"
dependencies = [
"lock_api 0.4.5",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "static_assertions"
version = "1.1.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "a2eb9349b6444b326872e140eb1cf5e7c522154d69e7a0ffb0fb81c06b37543f"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "string_cache"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.8.2"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "923f0f39b6267d37d23ce71ae7235602134b250ace715dd2c90421998ddac0c6"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
dependencies = [
"lazy_static",
"new_debug_unreachable",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"parking_lot 0.11.2",
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
"phf_shared",
"precomputed-hash",
"serde",
]
[[package]]
name = "string_cache_codegen"
version = "0.5.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f24c8e5e19d22a726626f1a5e16fe15b132dcf21d10177fa5a45ce7962996b97"
dependencies = [
"phf_generator",
"phf_shared",
"proc-macro2",
"quote",
]
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "strsim"
version = "0.8.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8ea5119cdb4c55b55d432abb513a0429384878c15dde60cc77b1c99de1a95a6a"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
[[package]]
name = "strsim"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
version = "0.10.0"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump cached from 0.25.0 to 0.25.1 (#361) Bumps [cached](https://github.com/jaemk/cached) from 0.25.0 to 0.25.1. - [Release notes](https://github.com/jaemk/cached/releases) - [Changelog](https://github.com/jaemk/cached/blob/master/CHANGELOG.md) - [Commits](https://github.com/jaemk/cached/commits) --- updated-dependencies: - dependency-name: cached dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-16 16:02:27 +00:00
checksum = "73473c0e59e6d5812c5dfe2a064a6444949f089e20eec9a2e5506596494e4623"
Cache `absolute_path` to decrease allocations (#346) * Cache `absolute_path` to decrease allocations While profiling local file handling, I noticed that resolving paths was taking a significant amount of time. It also caused quite a few allocations. By caching the path and using a constant value for the current directory, we can reduce the number of allocs by quite a lot. For example, when testing on the sentry documentation, we do 50,4% less allocations in total now. That's just a single test-case of course, but it's probably also helping in many other cases as well. * Defer to_string for attr.value to reduce allocs * Use Tendrils instead of Strings for parsing (another ~1.5% less allocs) * Move option parsing code into separate module * Handle base dir more correctly * Temporarily disable dry run
2021-10-04 23:37:43 +00:00
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "structopt"
Bump structopt from 0.3.21 to 0.3.25 (#362) Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.21 to 0.3.25. - [Release notes](https://github.com/TeXitoi/structopt/releases) - [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md) - [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.21...v0.3.25) --- updated-dependencies: - dependency-name: structopt dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-18 22:51:45 +00:00
version = "0.3.25"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump structopt from 0.3.21 to 0.3.25 (#362) Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.21 to 0.3.25. - [Release notes](https://github.com/TeXitoi/structopt/releases) - [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md) - [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.21...v0.3.25) --- updated-dependencies: - dependency-name: structopt dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-18 22:51:45 +00:00
checksum = "40b9788f4202aa75c240ecc9c15c65185e6a39ccdeb0fd5d008b98825464c87c"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
dependencies = [
"clap",
"lazy_static",
"structopt-derive",
]
[[package]]
name = "structopt-derive"
Bump structopt from 0.3.21 to 0.3.25 (#362) Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.21 to 0.3.25. - [Release notes](https://github.com/TeXitoi/structopt/releases) - [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md) - [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.21...v0.3.25) --- updated-dependencies: - dependency-name: structopt dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-18 22:51:45 +00:00
version = "0.4.18"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump structopt from 0.3.21 to 0.3.25 (#362) Bumps [structopt](https://github.com/TeXitoi/structopt) from 0.3.21 to 0.3.25. - [Release notes](https://github.com/TeXitoi/structopt/releases) - [Changelog](https://github.com/TeXitoi/structopt/blob/master/CHANGELOG.md) - [Commits](https://github.com/TeXitoi/structopt/compare/v0.3.21...v0.3.25) --- updated-dependencies: - dependency-name: structopt dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-18 22:51:45 +00:00
checksum = "dcb5ae327f9cc13b68763b5749770cb9e048a99bd9dfdfa58d0cf05d5f64afe0"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
dependencies = [
"heck",
"proc-macro-error",
"proc-macro2",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "syn"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.81"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "f2afee18b8beb5a596ecb4a2dce128c719b4ba399d34126b9e4396e3f9860966"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"proc-macro2",
"quote",
"unicode-xid",
]
Add support for different output formats (compact, detailed, markdown) (#375)
2021-11-17 23:44:48 +00:00
[[package]]
name = "tabled"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "465c45048a4b177eee43527a3741866dd66839f15c3223b5047dbc43d8a5076e"
dependencies = [
"papergrid",
"tabled_derive",
]
[[package]]
name = "tabled_derive"
version = "0.1.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "b366a04a152b687a209b2459f29da3650b74bc859390308949305211e28af4b9"
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "tempfile"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
version = "3.2.0"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump tempfile from 3.1.0 to 3.2.0 Bumps [tempfile](https://github.com/Stebalien/tempfile) from 3.1.0 to 3.2.0. - [Release notes](https://github.com/Stebalien/tempfile/releases) - [Changelog](https://github.com/Stebalien/tempfile/blob/master/NEWS) - [Commits](https://github.com/Stebalien/tempfile/commits) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-12 07:05:18 +00:00
checksum = "dac1c663cfc93810f88aed9b8941d48cabf856a1b111c29a40439018d870eb22"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"libc",
Update deps
2021-11-03 22:45:42 +00:00
"rand 0.8.4",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"redox_syscall 0.2.10",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"remove_dir_all",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "tendril"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.4.2"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "a9ef557cb397a4f0a5a3a628f06515f78563f2209e64d47055d9dc6052bf5e33"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
dependencies = [
"futf",
"mac",
"utf-8",
]
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "terminal_size"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.17"
Add progress bar
2020-10-10 04:31:28 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "633c1a546cee861a1a6d0dc69ebeca693bf4296661ba7852b9d21d159e0506df"
Add progress bar
2020-10-10 04:31:28 +00:00
dependencies = [
"libc",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add progress bar
2020-10-10 04:31:28 +00:00
]
Update deps
2021-11-03 22:45:42 +00:00
[[package]]
name = "termtree"
version = "0.2.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "13a4ec180a2de59b57434704ccfad967f789b12737738798fa08798cd5824c16"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "textwrap"
version = "0.11.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "d326610f408c7a4eb6f51c37c330e496b08506c9457c9d34287ecc38809fb060"
dependencies = [
"unicode-width",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "thiserror"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.30"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "854babe52e4df1653706b98fcfc05843010039b406875930a70e4d9644e5c417"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"thiserror-impl",
]
[[package]]
name = "thiserror-impl"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.30"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "aa32fd3f627f367fe16f893e2597ae3c05020f8bba2666a4e6ea73d377e5714b"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
[[package]]
name = "thread_local"
version = "1.1.3"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "8018d24e04c95ac8790716a5987d0fec4f8b27249ffa0f7d33f1369bdfb88cbd"
dependencies = [
"once_cell",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "time"
version = "0.1.43"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ca8a50ef2360fbd1eeb0ecd46795a87a19024eb4b53c5dc916ca1fd95fe62438"
dependencies = [
"libc",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "tinytemplate"
version = "1.2.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "be4d6b5f19ff7664e8c98d03e2139cb510db9b0a60b55f8e8709b689d939b6bc"
dependencies = [
"serde",
"serde_json",
]
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
[[package]]
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
name = "tinyvec"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.5.0"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "f83b2a3d4d9091d0abd7eba4dc2710b1718583bd4d8992e2190720ea38f391f7"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
dependencies = [
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
"tinyvec_macros",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
name = "tinyvec_macros"
version = "0.1.0"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "cda74da7e1a664f795bb1f8a87ec406fb89a02522cf6e50620d016add6dbbf5c"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
[[package]]
name = "tokio"
Bump tokio from 1.14.0 to 1.15.0 (#425) Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0) --- updated-dependencies: - dependency-name: tokio dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-16 18:32:51 +00:00
version = "1.15.0"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump tokio from 1.14.0 to 1.15.0 (#425) Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0) --- updated-dependencies: - dependency-name: tokio dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-16 18:32:51 +00:00
checksum = "fbbf1c778ec206785635ce8ad57fe52b3009ae9e0c9f574a728f3049d3e55838"
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"libc",
"memchr",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"mio",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"num_cpus",
"once_cell",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"parking_lot 0.11.2",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"signal-hook-registry",
"tokio-macros",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Use builder pattern and channels (fixes #12) (#33) This implements a basic builder for the Checker struct as discussed in #12. It is using derive_builder and uses a custom build method to instantiate the more elaborate fields like reqwest::Client. It also adds deadpool and tokio::mpsc as dependencies to handle a pool of clients to query websites.
2020-11-24 20:30:06 +00:00
]
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
[[package]]
name = "tokio-macros"
Bump tokio from 1.14.0 to 1.15.0 (#425) Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0) --- updated-dependencies: - dependency-name: tokio dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-16 18:32:51 +00:00
version = "1.7.0"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump tokio from 1.14.0 to 1.15.0 (#425) Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.14.0 to 1.15.0. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.14.0...tokio-1.15.0) --- updated-dependencies: - dependency-name: tokio dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-12-16 18:32:51 +00:00
checksum = "b557f72f448c511a979e2564e55d74e6c4432fc96ff4f6241bc6bded342643b7"
Make things blazing fast thanks to async
2020-08-11 14:13:10 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "tokio-native-tls"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f7d995660bd2b7f8c1568414c1126076c13fbb725c40112dc0120b78eb9b717b"
dependencies = [
"native-tls",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "tokio-socks"
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
version = "0.5.1"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
checksum = "51165dfa029d2a65969413a6cc96f354b86b464498702f174a4efa13608fd8c0"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"either",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"futures-util",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"thiserror",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
[[package]]
name = "tokio-stream"
version = "0.1.8"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "50145484efff8818b5ccd256697f36863f587da82cf8b409c53adf1e840798e3"
dependencies = [
"futures-core",
"pin-project-lite",
"tokio",
]
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
[[package]]
name = "tokio-util"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.6.9"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "9e99e1983e5d376cd8eb4b66604d2e99e79f5bd988c3055891dcd8c9e2604cc0"
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"bytes",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"futures-core",
"futures-sink",
"log",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
"tokio",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
]
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "toml"
Bump toml from 0.5.7 to 0.5.8 Bumps [toml](https://github.com/alexcrichton/toml-rs) from 0.5.7 to 0.5.8. - [Release notes](https://github.com/alexcrichton/toml-rs/releases) - [Commits](https://github.com/alexcrichton/toml-rs/compare/0.5.7...0.5.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-21 07:18:18 +00:00
version = "0.5.8"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump toml from 0.5.7 to 0.5.8 Bumps [toml](https://github.com/alexcrichton/toml-rs) from 0.5.7 to 0.5.8. - [Release notes](https://github.com/alexcrichton/toml-rs/releases) - [Commits](https://github.com/alexcrichton/toml-rs/compare/0.5.7...0.5.8) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-21 07:18:18 +00:00
checksum = "a31142970826733df8241ef35dc040ef98c679ab14d7c3e54d827099b3acecaa"
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
dependencies = [
"serde",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "tower-service"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.3.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "360dfd1d6d30e05fda32ace2c8c70e9c0a9da713275777f5a4dbb8a1893930c6"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Update deps
2020-08-18 22:10:59 +00:00
[[package]]
name = "tracing"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.29"
Update deps
2020-08-18 22:10:59 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "375a639232caf30edfc78e8d89b2d4c375515393e7af7e16f01cd96917fb2105"
Update deps
2020-08-18 22:10:59 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"pin-project-lite",
Update deps
2020-08-18 22:10:59 +00:00
"tracing-core",
]
[[package]]
name = "tracing-core"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.21"
Update deps
2020-08-18 22:10:59 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1f4ed65637b8390770814083d20756f87bfa2c21bf2f110babdc5438351746e4"
Update deps
2020-08-18 22:10:59 +00:00
dependencies = [
"lazy_static",
]
Bump tracing-subscriber from 0.2.25 to 0.3.0 (#368) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.2.25 to 0.3.0. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.25...tracing-subscriber-0.3.0) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 22:56:39 +00:00
[[package]]
name = "tracing-subscriber"
Bump tracing-subscriber from 0.3.4 to 0.3.5 (#437) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.4 to 0.3.5. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.3.4...tracing-subscriber-0.3.5) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-02 00:21:01 +00:00
version = "0.3.5"
Bump tracing-subscriber from 0.2.25 to 0.3.0 (#368) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.2.25 to 0.3.0. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.25...tracing-subscriber-0.3.0) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 22:56:39 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump tracing-subscriber from 0.3.4 to 0.3.5 (#437) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.4 to 0.3.5. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.3.4...tracing-subscriber-0.3.5) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-02 00:21:01 +00:00
checksum = "5d81bfa81424cc98cb034b837c985b7a290f592e5b4322f353f94a0ab0f9f594"
Bump tracing-subscriber from 0.2.25 to 0.3.0 (#368) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.2.25 to 0.3.0. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.2.25...tracing-subscriber-0.3.0) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-25 22:56:39 +00:00
dependencies = [
"lazy_static",
Disable tokio console-subscriber as it is not published yet
2021-10-28 01:15:44 +00:00
"matchers",
Add support for tokio-console (#318) This allows troubleshooting and improving async Rust code. It is an optional feature that is still experimental (but can be quite helpful)
2021-09-12 16:10:23 +00:00
"regex",
"sharded-slab",
"thread_local",
"tracing",
"tracing-core",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "trust-dns-proto"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
version = "0.20.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
checksum = "ad0d7f5db438199a6e2609debe3f69f808d074e0a2888ee0bccb45fe234d03f4"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
"async-trait",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"data-encoding",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"enum-as-inner",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"futures-channel",
"futures-io",
"futures-util",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"idna",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"ipnet",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"lazy_static",
"log",
Update deps
2021-11-03 22:45:42 +00:00
"rand 0.8.4",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"smallvec",
"thiserror",
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
"tinyvec",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"url",
]
[[package]]
name = "trust-dns-resolver"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
version = "0.20.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump check-if-email-exists from 0.8.21 to 0.8.23 (#311) Bumps [check-if-email-exists](https://github.com/reacherhq/check-if-email-exists) from 0.8.21 to 0.8.23. - [Release notes](https://github.com/reacherhq/check-if-email-exists/releases) - [Changelog](https://github.com/reacherhq/check-if-email-exists/blob/master/CHANGELOG.md) - [Commits](https://github.com/reacherhq/check-if-email-exists/compare/v0.8.21...v0.8.23) --- updated-dependencies: - dependency-name: check-if-email-exists dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-09-04 00:59:16 +00:00
checksum = "f6ad17b608a64bd0735e67bde16b0636f8aa8591f831a25d18443ed00a699770"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"futures-util",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"ipconfig",
"lazy_static",
"log",
"lru-cache",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"parking_lot 0.11.2",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
"resolv-conf",
"smallvec",
"thiserror",
"trust-dns-proto",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "try-lock"
Update deps
2020-08-18 22:10:59 +00:00
version = "0.2.3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2020-08-18 22:10:59 +00:00
checksum = "59547bce71d9c38b83d9c0e92b6066c4253371f15005def0c30d9657f50c7642"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
More refactor (#225) - Major changes in `lychee-lib::filter` module: - Fields in `Excludes` except the `RegexSet` is now moved to `Filter`. - `Filter` contains `Option<Excludes>` and `Option<Includes>`, which are wrapper struct of `RegexSet` instead of `Option<RegexSet>`. As a result the code now looks cleaner. - Factored out some filtering logics to dedicated functions. - It's possible to write tests for those functions in addition to tests for the `Filter` struct. - Added docs to `Filter::is_excluded` and reorgnized the code. - placed `derive_builder` by `typed_builder`: - The internal interface very ugly, as admitted by the author, but we no longer have nested `Option`s like before. - As a result, the `Client` building is much easier to read. - Main benefit of `typed_builder` is, the arguments feeded to builder is checked at compile time instead of run-time. - Fixed a bug in `lychee::tests::usage` and `lychee-lib::stats::test`. - Now it will clear environment variable which would otherwise cause an issue if `GITHUB_TOKEN` is set. - Updated dependencies. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-16 18:25:22 +00:00
[[package]]
name = "typed-builder"
Fix publish workflow (#309)
2021-09-03 23:49:29 +00:00
version = "0.9.1"
More refactor (#225) - Major changes in `lychee-lib::filter` module: - Fields in `Excludes` except the `RegexSet` is now moved to `Filter`. - `Filter` contains `Option<Excludes>` and `Option<Includes>`, which are wrapper struct of `RegexSet` instead of `Option<RegexSet>`. As a result the code now looks cleaner. - Factored out some filtering logics to dedicated functions. - It's possible to write tests for those functions in addition to tests for the `Filter` struct. - Added docs to `Filter::is_excluded` and reorgnized the code. - placed `derive_builder` by `typed_builder`: - The internal interface very ugly, as admitted by the author, but we no longer have nested `Option`s like before. - As a result, the `Client` building is much easier to read. - Main benefit of `typed_builder` is, the arguments feeded to builder is checked at compile time instead of run-time. - Fixed a bug in `lychee::tests::usage` and `lychee-lib::stats::test`. - Now it will clear environment variable which would otherwise cause an issue if `GITHUB_TOKEN` is set. - Updated dependencies. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-16 18:25:22 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Fix publish workflow (#309)
2021-09-03 23:49:29 +00:00
checksum = "a46ee5bd706ff79131be9c94e7edcb82b703c487766a114434e5790361cf08c5"
More refactor (#225) - Major changes in `lychee-lib::filter` module: - Fields in `Excludes` except the `RegexSet` is now moved to `Filter`. - `Filter` contains `Option<Excludes>` and `Option<Includes>`, which are wrapper struct of `RegexSet` instead of `Option<RegexSet>`. As a result the code now looks cleaner. - Factored out some filtering logics to dedicated functions. - It's possible to write tests for those functions in addition to tests for the `Filter` struct. - Added docs to `Filter::is_excluded` and reorgnized the code. - placed `derive_builder` by `typed_builder`: - The internal interface very ugly, as admitted by the author, but we no longer have nested `Option`s like before. - As a result, the `Client` building is much easier to read. - Main benefit of `typed_builder` is, the arguments feeded to builder is checked at compile time instead of run-time. - Fixed a bug in `lychee::tests::usage` and `lychee-lib::stats::test`. - Now it will clear environment variable which would otherwise cause an issue if `GITHUB_TOKEN` is set. - Updated dependencies. Co-authored-by: Lucius Hu <lebensterben@users.noreply.github.com>
2021-04-16 18:25:22 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
]
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
[[package]]
name = "typenum"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.14.0"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "b63708a265f51345575b27fe43f9500ad611579e764c79edbc2037b1121959ec"
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "unicase"
version = "2.6.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "50f37be617794602aabbeee0be4f259dc1778fabe05e2d67ee8f79326d5cb4f6"
dependencies = [
"version_check",
]
[[package]]
name = "unicode-bidi"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.7"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "1a01404663e3db436ed2746d9fefef640d868edae3cceb81c3b8d5732fda678f"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "unicode-normalization"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.19"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d54590932941a9e9266f0832deed84ebe1bf2e4c9e4a3554d393d18f5e854bf9"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"tinyvec",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "unicode-segmentation"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.8.0"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8895849a949e7845e06bd6dc1aa51731a103c42707010a5b591c0038fb73385b"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
Add progress bar
2020-10-10 04:31:28 +00:00
[[package]]
name = "unicode-width"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.1.9"
Add progress bar
2020-10-10 04:31:28 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "3ed742d4ea2bd1176e236172c8429aaf54486e7ac098db29ffe6529e0ce50973"
Add progress bar
2020-10-10 04:31:28 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "unicode-xid"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8ccb82d61f80a663efe1f787a51b16b5a51e3314d6ac365b08639f52387b33f3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "untrusted"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
version = "0.7.1"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Move to hubcaps. Allow defining accepted status codes
2020-08-17 23:17:26 +00:00
checksum = "a156c684c91ea7d62626509bce3cb4e1d9ed5c4d978f7b4352658f96a4c26b4a"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "url"
Bump url from 2.2.1 to 2.2.2 (#245) Bumps [url](https://github.com/servo/rust-url) from 2.2.1 to 2.2.2. - [Release notes](https://github.com/servo/rust-url/releases) - [Commits](https://github.com/servo/rust-url/compare/v2.2.1...v2.2.2) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-17 13:25:24 +00:00
version = "2.2.2"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump url from 2.2.1 to 2.2.2 (#245) Bumps [url](https://github.com/servo/rust-url) from 2.2.1 to 2.2.2. - [Release notes](https://github.com/servo/rust-url/releases) - [Commits](https://github.com/servo/rust-url/compare/v2.2.1...v2.2.2) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-17 13:25:24 +00:00
checksum = "a507c383b2d33b5fc35d1861e77e6b383d158b2da5e14fe51b83dfedf6fd578c"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Bump url from 2.1.1 to 2.2.0 Bumps [url](https://github.com/servo/rust-url) from 2.1.1 to 2.2.0. - [Release notes](https://github.com/servo/rust-url/releases) - [Commits](https://github.com/servo/rust-url/compare/v2.1.1...v2.2.0) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-11-29 20:41:55 +00:00
"form_urlencoded",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"idna",
"matches",
"percent-encoding",
Un-ignore test_timeout, upgrade wiremock to 0.3
2020-10-16 13:29:13 +00:00
"serde",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
[[package]]
name = "utf-8"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.7.6"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "09cc8ee72d2a9becf2f2febe0205bbed8fc6615b7cb429ad062dc7b7ddd036a9"
Use html5ever for HTML link extraction (#98)
2021-01-08 15:41:13 +00:00
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "uuid"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
version = "0.8.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
checksum = "bc5cf98d8186244414c848017f0e2676b3fcb46807f6668a97dfe67359a3c4b7"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Update deps
2021-11-03 22:45:42 +00:00
"getrandom 0.2.3",
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
]
[[package]]
name = "value-bag"
Update deps
2021-11-03 22:45:42 +00:00
version = "1.0.0-alpha.8"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "79923f7731dc61ebfba3633098bf3ac533bbd35ccd8c57e7088d9a5eebe0263f"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
dependencies = [
"ctor",
Update deps
2021-11-03 22:45:42 +00:00
"version_check",
Add connection timeout
2020-08-21 22:36:03 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "vcpkg"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.15"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "accd4ea62f7bb7a82fe23066fb0957d48ef677f6eeb8215f372f52e48bb32426"
Add connection timeout
2020-08-21 22:36:03 +00:00
Configuration file (lychee.toml) (#16)
2020-10-21 00:10:25 +00:00
[[package]]
name = "vec_map"
version = "0.8.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "f1bddf1187be692e79c5ffeab891132dfb0f236ed36a43c7ed39f1165ee20191"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "version_check"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
version = "0.9.3"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Merge "failed" status into "error" status (#191) I think that the separation between Status::Failed and Status::Error is a bit misleading. It was easier to implement, but from a user's perspective they are more or less the same: something unexpected happened. So I merged both into one: Status::Error. Still not 100% happy with the semantics, but it's an improvement I'd say.
2021-03-28 15:20:03 +00:00
checksum = "5fecdca9a5291cc2b8dcf7dc02453fee791a280f3743cb0905f8822ae463b3fe"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
Add --exclude-all-private flag and cli integration test
2020-10-17 08:01:06 +00:00
[[package]]
name = "wait-timeout"
version = "0.2.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "9f200f5b12eb75f8c1ed65abd4b2db8a6e1b138a20de009dacee265a2498f3f6"
dependencies = [
"libc",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "waker-fn"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "1.1.0"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "9d5b2c62b4012a3e1eca5a7e077d13b3bf498c4073e33ccd58626607748ceeca"
Add connection timeout
2020-08-21 22:36:03 +00:00
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "walkdir"
version = "2.3.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "808cf2735cd4b6866113f648b791c6adc5714537bc222d9347bb203386ffda56"
dependencies = [
"same-file",
"winapi",
"winapi-util",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "want"
version = "0.3.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "1ce8a968cb1cd110d136ff8b819a556d6fb6d919363c61534f6860c7eb172ba0"
dependencies = [
"log",
"try-lock",
]
[[package]]
name = "wasi"
version = "0.9.0+wasi-snapshot-preview1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "cccddf32554fecc6acb585f82a32a72e28b48f8c4c1883ddfeeeaa96f7d8e519"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
[[package]]
name = "wasi"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.10.2+wasi-snapshot-preview1"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "fd6fbd9a79829dd1ad0cc20627bf1ed606756a7f77edff7b66b7064f9cb327c6"
Bump uuid from 0.8.1 to 0.8.2 Bumps [uuid](https://github.com/uuid-rs/uuid) from 0.8.1 to 0.8.2. - [Release notes](https://github.com/uuid-rs/uuid/releases) - [Commits](https://github.com/uuid-rs/uuid/compare/0.8.1...0.8.2) Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2021-01-11 07:09:23 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "wasm-bindgen"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.78"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "632f73e236b219150ea279196e54e610f5dbafa5d61786303d4da54f84e47fce"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"wasm-bindgen-macro",
]
[[package]]
name = "wasm-bindgen-backend"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.78"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "a317bf8f9fba2476b4b2c85ef4c4af8ff39c3c7f0cdfeed4f82c34a880aa837b"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"bumpalo",
"lazy_static",
"log",
"proc-macro2",
"quote",
"syn",
"wasm-bindgen-shared",
]
[[package]]
name = "wasm-bindgen-futures"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.4.28"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "8e8d7523cb1f2a4c96c1317ca690031b714a51cc14e05f712446691f413f5d39"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"cfg-if 1.0.0",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
"js-sys",
"wasm-bindgen",
"web-sys",
]
[[package]]
name = "wasm-bindgen-macro"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.78"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d56146e7c495528bf6587663bea13a8eb588d39b36b679d83972e1a2dbbdacf9"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"quote",
"wasm-bindgen-macro-support",
]
[[package]]
name = "wasm-bindgen-macro-support"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.78"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "7803e0eea25835f8abdc585cd3021b3deb11543c6fe226dcd30b228857c5c5ab"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"proc-macro2",
"quote",
"syn",
"wasm-bindgen-backend",
"wasm-bindgen-shared",
]
[[package]]
name = "wasm-bindgen-shared"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.2.78"
Bump reqwest from 0.10.8 to 0.10.9 (#50) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.10.8 to 0.10.9. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.8...v0.10.9) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:31 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "0237232789cf037d5480773fe568aac745bfe2afbc11a863e97901780a6b47cc"
Bump reqwest from 0.10.8 to 0.10.9 (#50) Bumps [reqwest](https://github.com/seanmonstar/reqwest) from 0.10.8 to 0.10.9. - [Release notes](https://github.com/seanmonstar/reqwest/releases) - [Changelog](https://github.com/seanmonstar/reqwest/blob/master/CHANGELOG.md) - [Commits](https://github.com/seanmonstar/reqwest/compare/v0.10.8...v0.10.9) Signed-off-by: dependabot-preview[bot] <support@dependabot.com> Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-11-30 14:44:31 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "web-sys"
Update deps
2021-11-03 22:45:42 +00:00
version = "0.3.55"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "38eb105f1c59d9eaa6b5cdc92b859d85b926e82cb2e0945cd0c9259faa6fe9fb"
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
dependencies = [
"js-sys",
"wasm-bindgen",
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
Update deps
2021-11-03 22:45:42 +00:00
name = "wepoll-ffi"
version = "0.1.2"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Update deps
2021-11-03 22:45:42 +00:00
checksum = "d743fdedc5c64377b5fc2bc036b01c7fd642205a0d96356034ae3404d49eb7fb"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
"cc",
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "widestring"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
version = "0.4.3"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Exclude e-mails from being checked (#137) This can be useful in CI environments where SMTP is not allowed.
2021-02-10 10:58:04 +00:00
checksum = "c168940144dd21fd8046987c16a46a33d5fc84eec29ef9dcddc2ac9e31526b7c"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "winapi"
version = "0.3.9"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "5c839a674fcd7a98952e593242ea400abe93992746761e38641405d28b00f419"
dependencies = [
"winapi-i686-pc-windows-gnu",
"winapi-x86_64-pc-windows-gnu",
]
[[package]]
name = "winapi-i686-pc-windows-gnu"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "ac3b87c63620426dd9b991e5ce0329eff545bccbbb34f3be09ff6fb6ab51b7b6"
Use tokenizer for extraction; add benchmark (#424) This avoids creating a DOM tree for link extraction and instead uses a `TokenSink` for on-the-fly extraction. In hyperfine benchmarks it was about 10-25% faster than the master. Old: 4.557 s ± 0.404 s New: 3.832 s ± 0.131 s The performance fluctuates a little less as well. Some missing element/attribute pairs were also added, which contain links according to the HTML spec. These occur very rarely, but it's good to parse them for completeness' sake. Furthermore tried to clean up a lot of papercuts around our types. We now differentiate between a `RawUri` (stringy-types) and a Uri, which is a properly parsed `URI` type. The extractor now only deals with extracting `RawUri`s while the collector creates the request objects.
2021-12-16 17:45:52 +00:00
[[package]]
name = "winapi-util"
version = "0.1.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "70ec6ce85bb158151cae5e5c87f95a8e97d2c0c4b001223f33a334e3ce5de178"
dependencies = [
"winapi",
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "winapi-x86_64-pc-windows-gnu"
version = "0.4.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "712e227841d057c1ee1cd2fb22fa7e5a5461ae8e48fa2ca79ec42cfc1931183f"
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "winreg"
version = "0.6.2"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "b2986deb581c4fe11b621998a5e53361efe6b48a151178d0cd9eeffa4dc6acc9"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
]
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
[[package]]
name = "winreg"
version = "0.7.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "0120db82e8a1e0b9fb3345a539c478767c0048d842860994d96113d5b667bd69"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Add e-mail checking support
2020-08-23 21:22:48 +00:00
[[package]]
name = "winutil"
version = "0.1.1"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "7daf138b6b14196e3830a588acf1e86966c694d3e8fb026fb105b8b5dca07e6e"
dependencies = [
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"winapi",
Add e-mail checking support
2020-08-23 21:22:48 +00:00
]
Add connection timeout
2020-08-21 22:36:03 +00:00
[[package]]
name = "wiremock"
Bump wiremock from 0.5.8 to 0.5.9 (#442) Bumps [wiremock](https://github.com/LukeMathWalker/wiremock-rs) from 0.5.8 to 0.5.9. - [Release notes](https://github.com/LukeMathWalker/wiremock-rs/releases) - [Changelog](https://github.com/LukeMathWalker/wiremock-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/LukeMathWalker/wiremock-rs/compare/v0.5.8...v0.5.9) --- updated-dependencies: - dependency-name: wiremock dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-05 14:18:08 +00:00
version = "0.5.9"
Add connection timeout
2020-08-21 22:36:03 +00:00
source = "registry+https://github.com/rust-lang/crates.io-index"
Bump wiremock from 0.5.8 to 0.5.9 (#442) Bumps [wiremock](https://github.com/LukeMathWalker/wiremock-rs) from 0.5.8 to 0.5.9. - [Release notes](https://github.com/LukeMathWalker/wiremock-rs/releases) - [Changelog](https://github.com/LukeMathWalker/wiremock-rs/blob/main/CHANGELOG.md) - [Commits](https://github.com/LukeMathWalker/wiremock-rs/compare/v0.5.8...v0.5.9) --- updated-dependencies: - dependency-name: wiremock dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-01-05 14:18:08 +00:00
checksum = "8258886282e4e638166802e91fa2b09bac3a6409bf3a043e2ec7afc049f4d000"
Add connection timeout
2020-08-21 22:36:03 +00:00
dependencies = [
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"async-trait",
Improve concurrency with streams (#330) * Move to from vec to streams Previously we collected all inputs in one vector before checking the links, which is not ideal. Especially when reading many inputs (e.g. by using a glob pattern), this could cause issues like running out of file handles. By moving to streams we avoid that scenario. This is also the first step towards improving performance for many inputs. To stay as close to the pre-stream behaviour, we want to stop processing as soon as an Err value appears in the stream. This is easiest when the stream is consumed in the main thread. Previously, the stream was consumed in a tokio task and the main thread waited for responses. Now, a tokio task waits for responses (and displays them/registers response stats) and the main thread sends links to the ClientPool. To ensure that the main thread waits for all responses to have arrived before finishing the ProgressBar and printing the stats, it waits for the show_results_task to finish. * Return collected links as Stream * Initialize ProgressBar without length because we can't know the amount of links without blocking * Handle stream results in main thread, not in task * Add basic directory support using jwalk * Add test for HTTP protocol file type (http://) * Remove deadpool (once again): Replaced with `futures::StreamExt::for_each_concurrent`. * Refactor main; fix tests * Move commands into separate submodule * Simplify input handling * Simplify collector * Remove unnecessary unwrap * Simplify main * cleanup check * clean up dump command * Handle requests in parallel * Fix formatting and lints Co-authored-by: Timo Freiberg <self@timofreiberg.com>
2021-12-01 17:25:11 +00:00
"deadpool",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"futures",
Add connection timeout
2020-08-21 22:36:03 +00:00
"futures-timer",
"http-types",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"hyper",
Add connection timeout
2020-08-21 22:36:03 +00:00
"log",
Update dependencies (reqwest 0.11 and tokio 1.0) (#51) Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com> Co-authored-by: Matthias Endler <matthias-endler@gmx.net>
2021-01-06 23:10:58 +00:00
"once_cell",
Add connection timeout
2020-08-21 22:36:03 +00:00
"regex",
"serde",
"serde_json",
Fix issues with some dependencies (#140) * Try to make lychee buildable for Apple Silicon (ring) * Fix issues with old tokio 0.2 deps (async_smtp)
2021-02-12 21:34:41 +00:00
"tokio",
Extract from hello-rust/show repository
2020-08-04 22:32:37 +00:00
]
Reference in a new issue Copy permalink