builder error: relative URL without a base

[sawmj]

Describe the bug
I get this error when trying to use some wordlists

builder error: relative URL without a base

To Reproduce
Steps to reproduce the behavior:

Simply try using the wordlist of Assetnotes ="httparchive_xml_2023_08_28.txt" OR "httparchive_directories_1m_2023_08_28.txt"

[epi052]

poked at this a little bit just now, defo something odd going on, but i think it's with the wordlist (some character/encoding etc)

i'll look at it more a bit later, thanks for reporting!

[epi052]

haha, this is a funny one.

ferox allows you to specify a URL to --wordlist in order to download a wordlist over the network, i.e.

feroxbuster -u http://localhost -w https://wordlists-cdn.assetnote.io/data/automated/httparchive_xml_2023_08_28.txt

since that behavior overloads --wordlist we detect if it's a url with a pretty basic check:

if wordlist.startswith("http") {
  // download wordlist
}

so the wordlists from from assetnote that begin with http make ferox think it's supposed to be downloading from the url httparchive_xml_2023_08_28.txt, which is what throws the error.

to resolve the issue, simply rename the wordlist to something that doesn't begin with http

[epi052]

i added an error message to make what's happening more clear for future users, which will be included in the next release. Thanks again for taking the time to report this!

❯ cargo run -- -u http://127.0.0.1:8000 -w httparchive_xml_2023_08_28.txt                                                                                                              
Unable to download wordlist from remote url: httparchive_xml_2023_08_28.txt                                                                                                            

[epi052]

@all-contributors add @sawmj for bug

[allcontributors]

@epi052

I've put up a pull request to add @sawmj! 🎉

[epi052]

closing, feel free to reopen if this didn't resolve your issue.