Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add builtwith as a source #960

Merged
merged 5 commits into from
Sep 12, 2023
Merged

add builtwith as a source #960

merged 5 commits into from
Sep 12, 2023

Conversation

dogancanbakir
Copy link
Member

@dogancanbakir dogancanbakir commented Aug 23, 2023

Closes #959

$ go run . -d builtwith.com -s builtwith -v

               __    _____           __         
   _______  __/ /_  / __(_)___  ____/ /__  _____
  / ___/ / / / __ \/ /_/ / __ \/ __  / _ \/ ___/
 (__  ) /_/ / /_/ / __/ / / / / /_/ /  __/ /    
/____/\__,_/_.___/_/ /_/_/ /_/\__,_/\___/_/

                projectdiscovery.io

[INF] Current subfinder version v2.6.3-dev (development)
[INF] Loading provider config from /home/vscode/.config/subfinder/provider-config.yaml
[DBG] API key(s) found for builtwith.
[DBG] Selected source(s) for this search: builtwith
[INF] Enumerating subdomains for builtwith.com
[builtwith] .builtwith.com
[builtwith] api.builtwith.com
[builtwith] blog.builtwith.com
[builtwith] cc.builtwith.com
[builtwith] cdn-cf.builtwith.com
[builtwith] kb.builtwith.com
[builtwith] leadsdiscovery.builtwith.com
[builtwith] leadseye.builtwith.com
[builtwith] mail.builtwith.com
[builtwith] monty.builtwith.com
[builtwith] optimizer.builtwith.com
[builtwith] pm-bounces.builtwith.com
[builtwith] pro.builtwith.com
[builtwith] sendy.builtwith.com
[builtwith] trends.builtwith.com
[builtwith] trendspro.builtwith.com
trends.builtwith.com
trendspro.builtwith.com
api.builtwith.com
kb.builtwith.com
mail.builtwith.com
pm-bounces.builtwith.com
sendy.builtwith.com
monty.builtwith.com
optimizer.builtwith.com
pro.builtwith.com
.builtwith.com
cdn-cf.builtwith.com
leadsdiscovery.builtwith.com
leadseye.builtwith.com
blog.builtwith.com
cc.builtwith.com
[INF] Found 16 subdomains for builtwith.com in 1 second 283 milliseconds

Note: The API key works with only -d builtwith.com /shrug

@dogancanbakir dogancanbakir self-assigned this Aug 23, 2023
@dogancanbakir dogancanbakir linked an issue Aug 23, 2023 that may be closed by this pull request
Copy link
Member

@Mzack9999 Mzack9999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you provide an example query, I was able to get an api key, but unfortunately it's unclear which is the expected format:

$ go run . -d google -s builtwith -v
...
[INF] Found 0 subdomains for google.com in 459 milliseconds 533 microseconds
$ go run . -d google.com -s builtwith -v
...
[INF] Found 0 subdomains for google in 420 milliseconds 752 microseconds
...

I think it's also worth updating the docs

v2/pkg/subscraping/sources/builtwith/builtwith.go Outdated Show resolved Hide resolved
@dogancanbakir
Copy link
Member Author

@Mzack9999 I have updated the initial message with an example and have also made changes to the document.

Copy link
Member

@Mzack9999 Mzack9999 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm - Apparently google.com had really zero results xD

@Mzack9999 Mzack9999 requested a review from ehsandeep August 24, 2023 12:26
@Mzack9999 Mzack9999 added the Type: Enhancement Most issues will probably ask for additions or changes. label Aug 24, 2023
@ehsandeep ehsandeep merged commit a76b559 into dev Sep 12, 2023
@ehsandeep ehsandeep deleted the add_builtwith branch September 12, 2023 09:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Enhancement Most issues will probably ask for additions or changes.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add BuiltWith Domain API as a source
3 participants