Dev: Performance & Accuracy Improvements, Version Fixes, and New Worker Concurrency Feature #23
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Add support for Threads provider in provider.json (JackJuly#16) * update pics * Update CONTRIBUTING.md * add update fuction * New feature: ProxyNova integration * New feature: HaveIBeenPwned * Add new provider (JackJuly#19) * Add support for Threads provider in provider.json * Add Gravatar, Xing, Dev.to, and Kaskus support to provider.json; update notMatch messages * multi threading enabled * auto update check * version update and small fix --------- Co-authored-by: Rifqi <mysteriza@proton.me>
Updated scan_queue to use asyncio for running scans and adjusted SiteScanner timeout.
Refactor ScannerManager to use asyncio for concurrency instead of threading, improving performance and allowing for asynchronous HTTP requests.
Refactor site_scanner.py to use asyncio and aiohttp for asynchronous HTTP requests, improving performance. Update methods to accept an aiohttp.ClientSession parameter for better session management.
…ng project configuration.
…ement, and console output utilities.
…ration and `SiteScanner` for deep site analysis.
Owner
|
Sorry for the late reply. I'll check this first. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
Today I tested the Google Antigravity IDE on the Linkook project. The results were impressive: search accuracy improved significantly, and false positives appear to be completely eliminated.
I verified this by searching for my own username using:
python -m linkook mysteriza -a -ssAll platforms where I am registered were detected correctly. I also tested it using your username, and the results were equally accurate.
There is one issue worth noting: the version-checking logic may not be working correctly. I’m not fully sure how the version detection mechanism is intended to operate, so I may have introduced changes that need review. Please double-check whether the updated version-handling logic aligns with your original design.
Below is the full report of the changes included in this pull request.
What’s Changed
1. Updated project version
linkook/linkook.pypyproject.tomlsetup.py2. New Features
Customizable Concurrency (
--workers/-w)3. Performance Improvements
Dynamic Worker Allocation
ScannerManagerinlinkook/scanner/scanner_manager.pyto allocate workers dynamically based on user input or the new default.