Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed false positives #1869

Merged
merged 12 commits into from
Aug 29, 2023
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@
# Virtual Environment
venv/
bin/
lib/
pyvenv.cfg

# Editor Configurations
.vscode/
Expand Down
53 changes: 53 additions & 0 deletions removed_sites.json
Original file line number Diff line number Diff line change
Expand Up @@ -784,5 +784,58 @@
"url": "https://www.forumhouse.ru/members/?username={}",
"urlMain": "https://www.forumhouse.ru/",
"username_claimed": "red"
},
"Enjin": {
"errorMsg": "Yikes, there seems to have been an error. We've taken note and will check out the problem right away!",
"errorType": "message",
"url": "https://www.enjin.com/profile/{}",
"urlMain": "https://www.enjin.com/",
"username_claimed": "blue"
},
"IRL": {
"errorType": "status_code",
"url": "https://www.irl.com/{}",
"urlMain": "https://www.irl.com/",
"username_claimed": "hacker"
},
"Munzee": {
"errorType": "status_code",
"url": "https://www.munzee.com/m/{}",
"urlMain": "https://www.munzee.com/",
"username_claimed": "blue"
},
"Quizlet": {
"errorMsg": "Page Unavailable",
"errorType": "message",
"url": "https://quizlet.com/{}",
"urlMain": "https://quizlet.com",
"username_claimed": "blue"
},
"Youtube Channel": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/c/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "mkbhd"
},
"Youtube User": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/user/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "pewdiepie",
"username_unclaimed": "noonewouldeverusethis7"
},
"GunsAndAmmo": {
"errorType": "status_code",
"url": "https://forums.gunsandammo.com/profile/{}",
"urlMain": "https://gunsandammo.com/",
"username_claimed": "adam"
}
}
88 changes: 88 additions & 0 deletions removed_sites.md
Original file line number Diff line number Diff line change
Expand Up @@ -1736,4 +1736,92 @@ As of 2023.04.21, ForumhouseRU returns false positives
"urlMain": "https://www.forumhouse.ru/",
"username_claimed": "red"
}
```

## Enjin
As of 2023.08.29, Enjin has closed down.

```json
"Enjin": {
"errorMsg": "Yikes, there seems to have been an error. We've taken note and will check out the problem right away!",
"errorType": "message",
"url": "https://www.enjin.com/profile/{}",
"urlMain": "https://www.enjin.com/",
"username_claimed": "blue"
},
```

## IRL
As of 2023.08.29, IRL has shut down
```json
"IRL": {
"errorType": "status_code",
"url": "https://www.irl.com/{}",
"urlMain": "https://www.irl.com/",
"username_claimed": "hacker"
}
```

## Munzee
As of 2023.08.29, Munzee requires us to be logged into the site in order to check if a user exists or not
```json
"Munzee": {
"errorType": "status_code",
"url": "https://www.munzee.com/m/{}",
"urlMain": "https://www.munzee.com/",
"username_claimed": "blue"
}
```

## Quizlet
As of 2023.08.29 Quizlet requires us to enable JavaScript to check if a user exsits on the website

```json
"Quizlet": {
"errorMsg": "Page Unavailable",
"errorType": "message",
"url": "https://quizlet.com/{}",
"urlMain": "https://quizlet.com",
"username_claimed": "blue"
}
```


## YouTube
As of 2023.08.29, YouTube returns false positives as we need to accept their TOC but thats not possible with how Sherlock currently works


```json
"Youtube Channel": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/c/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "mkbhd"
},
"Youtube User": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/user/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "pewdiepie",
"username_unclaimed": "noonewouldeverusethis7"
}
```

## GunsAndAmmo
As of 2023.08.29, GunsAndAmmo responds with 404 from time to time
```json
"GunsAndAmmo": {
"errorType": "status_code",
"url": "https://forums.gunsandammo.com/profile/{}",
"urlMain": "https://gunsandammo.com/",
"username_claimed": "adam"
}
```
66 changes: 8 additions & 58 deletions sherlock/resources/data.json
Original file line number Diff line number Diff line change
Expand Up @@ -136,8 +136,7 @@
"username_claimed": "jason"
},
"Archive of Our Own": {
"errorMsg": "Sorry, could not find this user.",
"errorType": "message",
"errorType": "status_code",
"url": "https://archiveofourown.org/users/{}",
"urlMain": "https://archiveofourown.org/",
"username_claimed": "test"
Expand Down Expand Up @@ -329,10 +328,11 @@
"username_claimed": "blue"
},
"CNET": {
"errorType": "status_code",
"errorMsg": "null null - CNET",
"errorType": "message",
"url": "https://www.cnet.com/profiles/{}/",
"urlMain": "https://www.cnet.com/",
"username_claimed": "blue"
"username_claimed": "elliottcnet"
},
"CTAN": {
"errorType": "status_code",
Expand Down Expand Up @@ -620,6 +620,9 @@
"Duolingo": {
"errorMsg": "{\"users\":[]}",
"errorType": "message",
"headers": {
"User-Agent": "Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/116.0"
},
"url": "https://www.duolingo.com/profile/{}",
"urlMain": "https://duolingo.com/",
"urlProbe": "https://www.duolingo.com/2017-06-30/users?username={}",
Expand All @@ -631,13 +634,6 @@
"urlMain": "https://community.eintracht.de/",
"username_claimed": "mmammu"
},
"Enjin": {
"errorMsg": "Yikes, there seems to have been an error. We've taken note and will check out the problem right away!",
"errorType": "message",
"url": "https://www.enjin.com/profile/{}",
"urlMain": "https://www.enjin.com/",
"username_claimed": "blue"
},
"Envato Forum": {
"errorType": "status_code",
"url": "https://forums.envato.com/u/{}",
Expand Down Expand Up @@ -924,12 +920,6 @@
"urlMain": "https://www.gumroad.com/",
"username_claimed": "blue"
},
"GunsAndAmmo": {
"errorType": "status_code",
"url": "https://forums.gunsandammo.com/profile/{}",
"urlMain": "https://gunsandammo.com/",
"username_claimed": "adam"
},
"Gutefrage": {
"errorType": "status_code",
"url": "https://www.gutefrage.net/nutzer/{}",
Expand Down Expand Up @@ -1050,12 +1040,6 @@
"urlMain": "https://www.ifttt.com/",
"username_claimed": "blue"
},
"IRL": {
"errorType": "status_code",
"url": "https://www.irl.com/{}",
"urlMain": "https://www.irl.com/",
"username_claimed": "hacker"
},
"Icons8 Community": {
"errorType": "status_code",
"url": "https://community.icons8.com/u/{}/summary",
Expand Down Expand Up @@ -1335,12 +1319,6 @@
"urlMain": "https://www.motorradfrage.net/",
"username_claimed": "gutefrage"
},
"Munzee": {
"errorType": "status_code",
"url": "https://www.munzee.com/m/{}",
"urlMain": "https://www.munzee.com/",
"username_claimed": "blue"
},
"MyAnimeList": {
"errorType": "status_code",
"url": "https://myanimelist.net/profile/{}",
Expand Down Expand Up @@ -1603,13 +1581,6 @@
"urlMain": "https://pypi.org",
"username_claimed": "Blue"
},
"Quizlet": {
"errorMsg": "Page Unavailable</title>",
"errorType": "message",
"url": "https://quizlet.com/{}",
"urlMain": "https://quizlet.com",
"username_claimed": "blue"
},
"Rajce.net": {
"errorType": "status_code",
"regexCheck": "^[a-zA-Z0-9@_-]$",
Expand Down Expand Up @@ -1846,7 +1817,7 @@
"username_claimed": "adam"
},
"Speedrun.com": {
"errorMsg": "not found.",
"errorMsg": "Not found",
"errorType": "message",
"url": "https://speedrun.com/user/{}",
"urlMain": "https://speedrun.com/",
Expand Down Expand Up @@ -2281,27 +2252,6 @@
"urlMain": "https://youporn.com",
"username_claimed": "blue"
},
"Youtube Channel": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/c/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "mkbhd"
},
"Youtube User": {
"errorCode": 404,
"errorType": "status_code",
"headers": {
"Cookie": "CONSENT=YES+cb.20210418-17-p0.it+FX+917; "
},
"url": "https://www.youtube.com/user/{}",
"urlMain": "https://www.youtube.com",
"username_claimed": "pewdiepie",
"username_unclaimed": "noonewouldeverusethis7"
},
"Zhihu": {
"errorMsg": "404",
"errorType": "message",
Expand Down
9 changes: 1 addition & 8 deletions sites.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
## List Of Supported Sites (407 Sites In Total!)
## List Of Supported Sites (400 Sites In Total!)
1. ![](https://www.google.com/s2/favicons?domain=https://2Dimensions.com/) [2Dimensions](https://2Dimensions.com/)
1. ![](https://www.google.com/s2/favicons?domain=http://forum.3dnews.ru/) [3dnews](http://forum.3dnews.ru/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.7cups.com/) [7Cups](https://www.7cups.com/)
Expand Down Expand Up @@ -92,7 +92,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://dribbble.com/) [Dribbble](https://dribbble.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://duolingo.com/) [Duolingo](https://duolingo.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://community.eintracht.de/) [Eintracht Frankfurt Forum](https://community.eintracht.de/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.enjin.com/) [Enjin](https://www.enjin.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://forums.envato.com/) [Envato Forum](https://forums.envato.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.erome.com/) [Erome](https://www.erome.com/) **(NSFW)**
1. ![](https://www.google.com/s2/favicons?domain=https://www.etsy.com/) [Etsy](https://www.etsy.com/)
Expand Down Expand Up @@ -135,7 +134,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://www.grailed.com/) [Grailed](https://www.grailed.com/)
1. ![](https://www.google.com/s2/favicons?domain=http://en.gravatar.com/) [Gravatar](http://en.gravatar.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.gumroad.com/) [Gumroad](https://www.gumroad.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://gunsandammo.com/) [GunsAndAmmo](https://gunsandammo.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.gutefrage.net/) [Gutefrage](https://www.gutefrage.net/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.hexrpg.com/) [HEXRPG](https://www.hexrpg.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://forum.hackthebox.eu/) [HackTheBox](https://forum.hackthebox.eu/)
Expand All @@ -153,7 +151,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://hubski.com/) [Hubski](https://hubski.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://icq.com/) [ICQ](https://icq.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.ifttt.com/) [IFTTT](https://www.ifttt.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.irl.com/) [IRL](https://www.irl.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://community.icons8.com/) [Icons8 Community](https://community.icons8.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.imagefap.com/) [Image Fap](https://www.imagefap.com/) **(NSFW)**
1. ![](https://www.google.com/s2/favicons?domain=https://imgup.cz/) [ImgUp.cz](https://imgup.cz/)
Expand Down Expand Up @@ -195,7 +192,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://monkeytype.com/) [Monkeytype](https://monkeytype.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://motherless.com/) [Motherless](https://motherless.com/) **(NSFW)**
1. ![](https://www.google.com/s2/favicons?domain=https://www.motorradfrage.net/) [Motorradfrage](https://www.motorradfrage.net/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.munzee.com/) [Munzee](https://www.munzee.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://myanimelist.net/) [MyAnimeList](https://myanimelist.net/)
1. ![](https://www.google.com/s2/favicons?domain=https://www.myminifactory.com/) [MyMiniFactory](https://www.myminifactory.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://mydramalist.com) [Mydramalist](https://mydramalist.com)
Expand Down Expand Up @@ -236,7 +232,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://www.producthunt.com/) [ProductHunt](https://www.producthunt.com/)
1. ![](https://www.google.com/s2/favicons?domain=http://promodj.com/) [PromoDJ](http://promodj.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://pypi.org) [PyPi](https://pypi.org)
1. ![](https://www.google.com/s2/favicons?domain=https://quizlet.com) [Quizlet](https://quizlet.com)
1. ![](https://www.google.com/s2/favicons?domain=https://www.rajce.idnes.cz/) [Rajce.net](https://www.rajce.idnes.cz/)
1. ![](https://www.google.com/s2/favicons?domain=https://rateyourmusic.com/) [Rate Your Music](https://rateyourmusic.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://forum.rclone.org/) [Rclone Forum](https://forum.rclone.org/)
Expand Down Expand Up @@ -335,8 +330,6 @@
1. ![](https://www.google.com/s2/favicons?domain=https://www.younow.com/) [YouNow](https://www.younow.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://youpic.com/) [YouPic](https://youpic.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://youporn.com) [YouPorn](https://youporn.com) **(NSFW)**
1. ![](https://www.google.com/s2/favicons?domain=https://www.youtube.com) [Youtube Channel](https://www.youtube.com)
1. ![](https://www.google.com/s2/favicons?domain=https://www.youtube.com) [Youtube User](https://www.youtube.com)
1. ![](https://www.google.com/s2/favicons?domain=https://www.zhihu.com/) [Zhihu](https://www.zhihu.com/)
1. ![](https://www.google.com/s2/favicons?domain=https://akniga.org/profile/blue/) [akniga](https://akniga.org/profile/blue/)
1. ![](https://www.google.com/s2/favicons?domain=http://www.authorstream.com/) [authorSTREAM](http://www.authorstream.com/)
Expand Down
Loading