A command-line utility for downloading, processing, resolving, and consolidating DNS blocklists and allowlists from multiple sources. Performs DNS-to-IP resolution, reverse lookups, and overlap detection. Generates ready-to-use lists for DNS sinkholes, Pi-hole, AdGuard Home, and other network security tools.
---
config:
theme: mc
---
flowchart LR
B["Process<br>via Processors"] --> C["Consolidate<br>Group<br>Categorize<br>Top Entries<br>Overlaps"]
C --> D["Blocklist/Allowlist Files"] & E["Main README"] & F["Overlap Analysis"] & G["Summary Report"] & H["Statistics Report"] & n2["Format Conversion<br>via Converters"] & n4["Graph Generation<br>via Graphers"]
D --> I["Archive"]
E --> I
F --> I
H --> I
G --> I
n1["Data files"] --> B
A["Download<br>via Downloaders"] --> n1
n2 --> n3["Converted Files"]
n4 --> n5["Graph Images"]
n3 --> I
n5 --> I
B@{ shape: procs}
C@{ shape: h-cyl}
D@{ shape: docs}
n2@{ shape: h-cyl}
n4@{ shape: paper-tape}
n1@{ shape: docs}
n3@{ shape: docs}
style C stroke-width:4px,stroke-dasharray: 0
style n2 stroke-width:2px,stroke-dasharray: 2
Ready-to-use blocklist files are published daily to the output branch:
- Domain and IP blocklists/allowlists compatible with Pi-hole, pfBlockerNG, AdGuard Home
- Lists organized by size (mini, lite, normal, big) and category (ads, malware, privacy)
- Top entries based on source frequency for high-confidence blocking
⚡ Quick Usage: Add https://raw.githubusercontent.com/phani-kb/dns-toolkit/output/[filename] to your DNS filtering tool (Pi-hole, AdGuard Home, pfBlockerNG).
Most commonly used outputs; Click any link to open the file.
| Category | Files (click to open) |
|---|---|
| 🗂️ Consolidated | 🛑 Blocklists: adguard · cidr_ipv4 · domain · ipv4 · ipv6 ✅ Allowlists: adguard (allowlist) · domain (allowlist) · ipv4 (allowlist) |
| 📏 Mini — low false positives 🟢 | mini_adguard, mini_cidr_ipv4, mini_domain, mini_ipv4 |
| 📏 Lite — balanced protection 🟡 | lite_adguard, lite_cidr_ipv4, lite_domain, lite_ipv4 |
| 📏 Normal — broader protection 🔵 | normal_adguard, normal_cidr_ipv4, normal_domain, normal_ipv4 |
| 📏 Big — aggressive coverage 🔴 | big_adguard, big_cidr_ipv4, big_domain, big_ipv4, big_ipv6 |
| ⭐ Top lists — min3 to min12 | top_adguard_min3, top_adguard_min5 · top_domain_min3, top_domain_min5 · top_ipv4_min3, top_ipv4_min5 (min3 means "at least 3 sources", min5 means "at least 5 sources", etc.; higher minN → higher confidence, fewer entries.) |
View Detailed Overlap Analysis Comprehensive analysis showing how entries are shared across different DNS sources.
Conflicts Report (allowlist vs. blocklist) A daily-generated report listing entries found in both allowlists and blocklists, including the source(s) where they were found.
Processing summaries and metadata are archived in the summaries branch with 1-year retention.
Copy one of these raw URLs directly into your DNS filtering tool.
https://raw.githubusercontent.com/phani-kb/dns-toolkit/output/domain_blocklist.txt
https://raw.githubusercontent.com/phani-kb/dns-toolkit/output/adguard_blocklist.txt
Use the 'DNSBL' > 'DNSBL Groups' section and add a custom list using the raw URL. Example domain list (paste into pfBlockerNG custom list):
https://raw.githubusercontent.com/phani-kb/dns-toolkit/output/domain_blocklist.txt
Note: The repo size badge above only reflects the default branch (release/1.0.0).
- Output branch size: 362.54 MB
- Summaries branch size: 3.15 MB
Automatically generated statistics from source configuration files
| Metric | Count | Details |
|---|---|---|
| Total Sources | 181 | 152 enabled, 29 disabled |
| Blocklist Sources | 153 | Sources providing blocking rules |
| Allowlist Sources | 39 | Sources providing exception rules |
| Categories | 40 | ads, adult, ai, annoyance, anonymizer, botnet, browser, cryptocurrency, dating, discord, dns, doh, fake, fakenews, finance, gambling, issues, kad, local, mac, malicious, malware, mobile, others, phishing, privacy, proxy, ransomware, scam, smarttv, social, spam, spyware, threat, topdomains, tor, torrent_trackers, trackers, url_shorteners, windows |
| Source Types | 30 | adguard, adguard_csv_http_url_find, adguard_domain, adguard_http_url, cidr_ipv4, domain, domain_adguard, domain_comment, domain_csv_http_url_find, domain_custom_csv_blackbook, domain_custom_csv_maltrail, domain_custom_html_ccam, domain_custom_html_puppyscams, domain_http_url, domain_top, domain_url, domain_with_comment_suffix, hostname, ipv4, ipv4_cidr_expand, ipv4_csv_http_url_find, ipv4_custom_html_ccam, ipv4_find, ipv4_from_domain, ipv4_http_url, ipv4_range_expand, ipv4_url, ipv6, ipv6_find, ipv6_htaccess |
| Geographic Coverage | 21 countries | CN, CZ, DE, ES, FI, FR, HU, ID, IL, IT, KR, LV, MY, NL, RO, RU, SA, SK, UA, US, VN |
| Last Updated | 2025-10-30 20:32:22 UTC | Statistics generation time |
This project is made possible by the following blocklist and allowlist sources:
Legend: S = Status, C/U/X = Count / Unique / Conflicts
📄 sources_domain_al.json (19 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| AdGuardSDNSFilter_exclusions | ✅ | others | - | - |
| AdGuardTeam_HttpsExclusions_android | ✅ | mobile | 97 / 65 / 20 | - |
| AdGuardTeam_HttpsExclusions_banks | ✅ | finance | 3974 / 3932 / 22 | - |
| AdGuardTeam_HttpsExclusions_firefox | ✅ | browser | 18 / 13 / 0 | - |
| AdGuardTeam_HttpsExclusions_issues | ✅ | issues | 68 / 61 / 3 | - |
| AdGuardTeam_HttpsExclusions_mac | ✅ | mac | 11 / 4 / 1 | - |
| AdGuardTeam_HttpsExclusions_sensitive | ✅ | others | 170 / 141 / 14 | - |
| AdGuardTeam_HttpsExclusions_windows | ✅ | windows | 7 / 6 / 0 | - |
| anudeepND_Allowlist | ❌ | others | - | Last updated on 2021-12-01. This list is no longer maintained. |
| BlahDNS_whitelist | ❌ | others | - | Too many conflicts with other sources |
| China_CDN_Whitelist | ❌ | others | - | - |
| DandelionSprout_AdGuardHome_Whitelist | ✅ | others | 285 / 40 / 0 | - |
| Dogino_Discord_Official | ✅ | discord | 43 / 0 / 14 | - |
| fabriziosalmi_allowlist | ✅ | others | 2264 / 869 / 981 | - |
| Freekers_Whitelist | ❌ | others | - | No update since 2019 |
| Notracking_Hosts_whitelist | ❌ | others | - | Archived by the owner on Aug 8, 2023 |
| ShadowWhisperer_Allowlist | ✅ | others | 661 / 252 / 317 | - |
| T145_allowlist-domains | ❌ | others | - | Huge list, use with caution |
| TogoFire_AD_Settings_whitelist | ✅ | others | 1764 / 1519 / 0 | Huge list, use with caution |
📄 sources_domain_bl.json (106 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| 1Hosts (Lite) | ✅ | ads, trackers | 128569 / 0 / 179 | 100% covered by other sources |
| abpvn_hosts | ✅ | ads | 1121 / 1004 / 0 | - |
| Adaway | ✅ | ads | 6540 / 0 / 107 | >99% overlap with StevenBlack Fake Gambling list |
| AdBlockID | ✅ | ads | 3886 / 3848 / 0 | - |
| AdGuard Base filter | ✅ | ads, trackers | 104856 / 0 / 0 | - |
| AdGuard CNAME Mail Trackers | ✅ | trackers | 47028 / 46957 / 0 | - |
| AdGuard CNAME Trackers | ✅ | trackers | 86643 / 59947 / 10 | - |
| AdGuard DNS filter | ✅ | ads, trackers | 142027 / 0 / 0 | - |
| AdGuard Spyware Filter - Mobile | ✅ | ads, mobile, spyware | 1076 / 0 / 0 | - |
| AntiAdBlockFilters | ✅ | annoyance | 1708 / 1702 / 0 | - |
| anudeepND_adservers | ❌ | ads | - | No update since 2023-01-16 |
| bigdargon_hostsVN | ✅ | ads | 19057 / 0 / 149 | - |
| Blocklists UT1 Cryptojacking | ✅ | cryptocurrency | 16288 / 14756 / 8 | - |
| Blocklists UT1 Malware | ✅ | malware | 254789 / 0 / 4 | >80% overlap with phishing_army |
| Blocklists UT1 Publicite | ✅ | ads | 4270 / 0 / 129 | 100% covered by other sources |
| Blocklists UT1 Shortener | ✅ | url_shorteners | 4522 / 0 / 21 | - |
| Boutetnico_URL_Shorteners | ✅ | url_shorteners | 418 / 210 / 24 | - |
| Cameleon | ❌ | ads | - | No update since 2018-03-17 |
| CF_Torrent_Trackers | ✅ | torrent_trackers | 149 / 0 / 0 | - |
| CJX Annoyance | ✅ | annoyance | 1805 / 1713 / 0 | - |
| CybercrimeTracker_All | ❌ | botnet, malicious, malware | - | Redirect loops may occur; website unavailable since 2025-10-27 |
| CybercrimeTracker_CCAM | ❌ | botnet, malicious, malware | - | No regular updates |
| CybercrimeTracker_CCPMGate | ❌ | botnet, malicious, malware | - | Redirect loops may occur; website unavailable since 2025-10-27 |
| cyberhost_malware-blocklist | ✅ | malware | 19489 / 0 / 3 | - |
| Dan Pollock's List | ✅ | ads, malware, trackers | 11812 / 0 / 32 | >95% overlap with StevenBlack Fake Gambling list |
| DandelionSprout-Anti-Malware-List | ✅ | malware | 27792 / 27781 / 0 | - |
| Easy Privacy | ✅ | privacy, trackers | 53643 / 17019 / 1 | - |
| EasyList | ✅ | ads | 60755 / 0 / 0 | 100% covered by other sources |
| fabriziosalmi_blocklists | ❌ | malicious, threat | - | Huge list, >3 million entries |
| FadeMind_2o7Net | ❌ | ads, privacy, trackers | - | No update since 2023-11-30 |
| FakeWebshopListHUN | ✅ | fake, phishing, scam, threat | - | - |
| Frogeye-firstparty-trackers | ✅ | trackers | 32388 / 16533 / 11 | - |
| GetAdmiral Domains Filter List | ✅ | ads, annoyance | 1780 / 0 / 0 | - |
| GlobalAntiScamOrg-blocklist-domains | ✅ | scam | 11150 / 7417 / 2 | - |
| HaGeZi Amazon Tracker | ✅ | privacy, trackers | 606 / 0 / 34 | >98% overlap with HaGeZi Pro |
| HaGeZi Apple Tracker | ✅ | privacy, trackers | 102 / 0 / 7 | >80% overlap with HaGeZi Pro |
| HaGeZi DNS TIF Mini | ✅ | malicious, threat | 149965 / 28216 / 1 | 100% covered by other sources |
| HaGeZi Encrypted DNS Servers | ✅ | doh | 3402 / 2162 / 9 | - |
| HaGeZi Gambling Only Domains | ✅ | gambling | 199936 / 191866 / 6 | Huge list and gambling-specific focus |
| HaGeZi Microsoft Tracker | ✅ | privacy, trackers | 754 / 0 / 12 | >75% overlap with HaGeZi Pro |
| HaGeZi Most Abused TLDs | ✅ | spam | 432 / 430 / 0 | - |
| HaGeZi Normal | ❌ | ads, malware, trackers | - | 100% overlap with HaGeZi Pro |
| HaGeZi Pro | ✅ | ads, malware, phishing, trackers | 363541 / 0 / 186 | - |
| HaGeZi Xiaomi Tracker | ✅ | privacy, trackers | 473 / 0 / 0 | >95% overlap with HaGeZi Pro |
| Hestat_Minerchk | ❌ | cryptocurrency | - | No update since 2018 |
| hkamran80_smarttv | ✅ | smarttv | 294 / 0 / 14 | - |
| Hostsfile | ❌ | ads | - | No update since 2018-04-20 |
| hufilter | ✅ | ads | 100 / 0 / 3 | >90% overlap with HaGeZi Pro |
| iam-py-test_my-filters-001-antitypo | ✅ | fake | 824 / 823 / 0 | - |
| jarelllama_Scam-Blocklist | ✅ | scam | 468729 / 426345 / 11 | Disabled due to very large size (457K entries) - scam-specific focus |
| kadantiscam | ✅ | kad | 79433 / 0 / 2 | peer-to-peer network protocol |
| Korlabs_UrlShortener | ✅ | url_shorteners | 237 / 0 / 17 | - |
| Malicious URL Blocklist (URLHaus) | ✅ | ads | 8602 / 0 / 0 | 100% covered by other sources |
| Maltrail_StaticTrails | ✅ | malware, threat | 210033 / 182545 / 5 | - |
| malware-filter_phishing-filter | ✅ | malware, phishing | 21919 / 0 / 0 | - |
| OISD Blocklist Big | ✅ | ads, cryptocurrency, malware, phishing, ransomware, trackers | 209200 / 0 / 76 | Huge list |
| OISD Blocklist NSFW Small | ✅ | adult | 18556 / 0 / 12 | - |
| OISD Blocklist Small | ✅ | ads, cryptocurrency, malware, phishing, ransomware, trackers | 47733 / 0 / 52 | - |
| OpenPhish_Feed | ✅ | phishing | 220 / 141 / 2 | - |
| Peter Lowe's Blocklist | ❌ | ads | - | 100% covered by other sources, same as yoyo adservers list |
| pexcn Torrent Trackers | ✅ | torrent_trackers | 88 / 0 / 0 | - |
| ph00lt0_blocklist | ✅ | ads, trackers | 21760 / 0 / 476 | 100% covered by other sources, ~50 ip addresses in domain list |
| phishing_army | ✅ | phishing | 152592 / 0 / 2 | - |
| Policeman_SimpleDomainsBlocklist | ❌ | malicious | - | Archived on 2021-12-26 |
| PuppyScams | ✅ | fake, scam | 102 / 92 / 0 | List of top 100 pet scams is not being shared anymore, https://puppyscams.org/top-100-pet-scams |
| quidsup_notrack-annoyance | ✅ | annoyance | 457 / 0 / 1 | >90% overlap with HaGeZi Pro |
| quidsup_notrack-malware | ✅ | malware | 141 / 0 / 0 | - |
| quidsup_notrack-tracker | ✅ | trackers | 15602 / 0 / 162 | - |
| RedDragonWebDesign_block-everything | ✅ | ads, malicious, trackers | 665 / 661 / 0 | - |
| RPiList_specials-malware | ✅ | malware | 267200 / 3151 / 0 | Huge list |
| RPiList_specials-phishing | ✅ | phishing | 905653 / 598798 / 0 | Huge list |
| ShadowWhisperer's Dating List | ✅ | dating | 1262 / 1063 / 0 | - |
| ShadowWhisperer_BlockLists Ads | ✅ | ads | 24133 / 0 / 78 | - |
| ShadowWhisperer_BlockLists Adult | ✅ | adult | 231630 / 174280 / 12 | Huge list and adult-specific focus |
| ShadowWhisperer_BlockLists Malware | ✅ | malware | 41977 / 0 / 4 | - |
| ShadowWhisperer_BlockLists Scam | ✅ | scam | 7137 / 4806 / 0 | - |
| ShadowWhisperer_UrlShortener | ✅ | url_shorteners | 5720 / 1074 / 2 | - |
| Sinfonietta_Adult | ✅ | adult | 58961 / 0 / 18 | - |
| Sinfonietta_Gambling | ✅ | gambling | 2639 / 0 / 1 | - |
| Sinfonietta_Social | ✅ | social | 3242 / 0 / 107 | - |
| Spam404 | ✅ | spam | 8140 / 5863 / 1 | - |
| Stamparm_Blackbook | ✅ | malicious, threat | 18145 / 0 / 0 | >95% overlap with Blocklists UT1 Malware |
| StevenBlack_Adhoc_list | ❌ | ads, malware, trackers | - | 100% overlap with StevenBlack Fake Gambling list |
| StevenBlack_Fake_Gambling | ✅ | ads, fake, fakenews, gambling | 112327 / 0 / 207 | - |
| StevenBlack_Porn | ✅ | adult | 75482 / 0 / 23 | - |
| StevenBlack_Social | ✅ | social | 3242 / 0 / 107 | - |
| T145_black-mirror | ❌ | malicious, threat | - | Huge list, >8 million entries |
| ThreatFox_Hostfile | ✅ | malware, threat | 36338 / 0 / 0 | - |
| ThreatView_Domain_High-Confidence | ✅ | malware, phishing, threat | 181778 / 47298 / 0 | Huge list, when compared to IPv4 feed from the same source |
| Torrent Trackers | ✅ | torrent_trackers | 528 / 262 / 0 | - |
| Ukrainian Ad Filter | ✅ | ads | 1457 / 1250 / 0 | - |
| Ukrainian Annoyance Filter | ✅ | annoyance | - | - |
| Ukrainian Privacy Filter | ✅ | privacy, trackers | 366 / 30 / 1 | - |
| Ukrainian Security Filter | ✅ | malicious, threat | 1736 / 1148 / 0 | - |
| UncheckyAds | ❌ | ads, privacy, trackers | - | No update since 2021 |
| URLHaus (Abuse.ch) | ✅ | malware | 880 / 0 / 0 | - |
| USOM-Blocklists-domains | ✅ | malicious, threat | 418111 / 355052 / 19 | Huge list |
| Viriback_Dump | ✅ | malware | 4701 / 69 / 0 | - |
| WaLLy3K | ✅ | ads | 350 / 0 / 12 | - |
| Warui_Adhosts | ✅ | ads | 75777 / 0 / 243 | Huge list |
| WindowsSpyBlocker_Hosts_spy | ❌ | privacy, trackers | - | No update since 2022-05-16 |
| Winhelp2002 | ❌ | ads | - | No update since 2021-03-06 |
| YousList | ✅ | ads | 624 / 0 / 3 | - |
| YousList-AdGuard | ✅ | ads | 7360 / 7179 / 0 | - |
| youtube_GoodbyeAds | ✅ | ads | 97645 / 97140 / 14 | No update since 2024-11-21 |
| Yoyo Adservers-Hosts | ✅ | ads | 3455 / 0 / 96 | >95% overlap with StevenBlack Fake Gambling list |
📄 sources_domain_new.json (1 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| nrd-14day-mini | ❌ | others | - | Huge list with low unique contribution |
📄 sources_domain_top.json (1 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| tranco | ✅ | topdomains | 1000 / 0 / 1377 | - |
📄 sources_ip.json (43 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| AlienVault_Reputation | ❌ | malicious, threat | - | Not available anymore. The service has been discontinued. |
| BinaryDefense_Banlist | ✅ | malicious, threat | 3023 / 0 / 0 | This is for public use only. |
| Blackhole_Today | ❌ | malicious, threat | - | Download fails frequently due to network instability or potential blocking. |
| BlockListDE_Brute | ✅ | threat | 1957 / 0 / 0 | >95% overlap with Firehol_level2 |
| BlockListDE_Strong | ✅ | malicious, threat | 277 / 0 / 0 | >95% overlap with Borestad_AbuseIPDB_S100_3d |
| Borestad_AbuseIPDB_S100_3d | ✅ | malicious, threat | 56129 / 0 / 0 | - |
| BruteforceBlocker | ✅ | threat | 317 / 0 / 0 | >95% overlap with EmergingThreats_CompromisedIPs |
| CINSScore_BadGuys_Army | ✅ | malicious, threat | 15000 / 0 / 0 | - |
| DanMeUK_TorExitNodes | ✅ | tor | 1265 / 156 / 0 | - |
| DoH_IP_blocklists | ✅ | doh | 2636 / 752 / 1 | >90% overlap with HaGeZi Encrypted DNS Servers |
| DoH_IP_list | ✅ | doh | 731 / 0 / 0 | - |
| DShield | ✅ | malicious, threat | 5120 / 0 / 0 | 100% overlap with Firehol_level2/Firehol_level3 |
| EmergingThreats_CompromisedIPs | ✅ | malicious, threat | 324 / 0 / 0 | >95% overlap with Firehol_level3, and Borestad_AbuseIPDB_S100_3d |
| ET_fwip | ✅ | malicious, threat | 1507 / 105 / 0 | - |
| FabrizioSalmi_DNS | ✅ | dns | 66 / 0 / 0 | - |
| Firehol_abusers_30d | ❌ | malicious, threat | - | False positives are common, use with caution. |
| Firehol_BitcoinNodes_1d | ✅ | cryptocurrency | 7648 / 7548 / 0 | - |
| Firehol_Botscout_1d | ✅ | malicious, threat | 530 / 417 / 0 | - |
| Firehol_CleanTalk | ✅ | malicious, threat | 494 / 453 / 0 | - |
| Firehol_CleanTalk_Top20 | ✅ | malicious, threat | 20 / 0 / 0 | - |
| Firehol_GPF_Comics | ✅ | malicious, threat | 2726 / 1472 / 0 | - |
| Firehol_level1 | ✅ | malicious, threat | 4476 / 3074 / 0 | - |
| Firehol_level2 | ✅ | malicious, threat | 13664 / 0 / 0 | - |
| Firehol_level3 | ✅ | malicious, threat | 13079 / 0 / 2 | - |
| Firehol_SocksProxy_7d | ✅ | anonymizer, privacy, proxy | 2280 / 2031 / 0 | - |
| Firehol_SSLProxies_1d | ✅ | anonymizer, privacy, proxy | 233 / 167 / 0 | - |
| GlobalAntiScamOrg-blocklist-ips | ✅ | scam | - | - |
| Greensnow | ✅ | malicious, malware, threat | 5067 / 0 / 0 | >95% overlap with Firehol_level2 |
| HaGeZi_DoH | ✅ | doh | 1710 / 0 / 0 | >90% overlap with DoH_IP_blocklists |
| HaGeZi_TIF | ✅ | malicious, threat | 58001 / 0 / 0 | No unique contribution |
| MyIP_MS_Blocklist | ✅ | malicious, threat | - | - |
| Public_DNS4 | ✅ | dns | 62607 / 61682 / 0 | - |
| Rutgers_DROP | ✅ | malicious, threat | 1849 / 0 / 0 | - |
| Sblam_Blocklist | ✅ | spam | 1532 / 803 / 0 | - |
| ScriptzTeam_BadIPS | ✅ | malicious, threat | 2567 / 1016 / 0 | - |
| Sentinel_Greylist | ✅ | malicious, threat | 6920 / 0 / 1 | - |
| spamhaus_drop | ✅ | spam, threat | - | - |
| T145_allowlist-ips | ❌ | others | - | Huge list, use with caution. More than its blocklist counterpart. |
| T145_blocklist | ❌ | malicious, malware, threat | - | Huge list, use with caution. |
| ThreatView_IP_HighConfidence | ✅ | malicious, phishing, threat | 1362 / 221 / 0 | - |
| URLHaus_Text | ✅ | malware | 19917 / 0 / 0 | - |
| USOM-Blocklists-ips | ✅ | malicious, threat | 13208 / 7490 / 0 | - |
| Yoyo AdServers-IPList | ✅ | ads | 8940 / 8889 / 0 | - |
📄 sources_local.json (7 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| local_adg_allowlist | ✅ | local | - | - |
| local_adg_blocklist | ✅ | local | 7 / 0 / 0 | - |
| local_ai_allowlist | ✅ | ai | 55 / 0 / 56 | - |
| local_ai_blocklist | ✅ | ai | 55 / 0 / 56 | - |
| local_domain_blocklist | ✅ | local | 7 / 0 / 1 | - |
| local_source_domain_allowlist | ✅ | local | 46 / 26 / 0 | - |
| local_source_ipv4_allowlist | ✅ | local | 56 / 47 / 8 | - |
📄 sources_local_category.json (3 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| local_miscellaneous_allowlist | ✅ | local | 6 / 0 / 10 | - |
| local_mobile_allowlist | ✅ | local, mobile | 4 / 3 / 1 | - |
| local_social_allowlist | ✅ | local, social | 1 / 0 / 2 | - |
📄 sources_mis.json (1 sources)
| Name | S | Categories | C / U / X | Notes |
|---|---|---|---|---|
| VXVault_URLList | ✅ | malware | 39 / 0 / 0 | >95% overlap with Firehol_level3 |
Sources are configured in data/config/sources*.json files. Each source specifies:
- Download URL and frequency
- Source type (domain, IPv4, IPv6, AdGuard, etc.)
- Categories (ads, malware, privacy, etc.)
- License and website information
Top domains sourced from the tranco-list.eu list (domain_top type) are treated as an allowlist.
---
config:
theme: mc
---
flowchart LR
subgraph horizontal[" "]
direction LR
OutputIPv4["allowlist_ipv4.txt"]
end
ReadSources["Read Sources"] --> ExtractDomains["Extract Domains from Source URLs"]
ExtractDomains --> LoadCustom["Load Custom Files"]
LoadCustom --> Combine["Combine & Deduplicate"]
Combine --> OutputDomains["allowlist_domains.txt"] & OutputAdGuard["allowlist_adg.txt<br>(@@||domain^ format)"] & ResolveDNS["Resolve to IPv4"]
ResolveDNS --> OutputIPv4
OutputIPv4@{ shape: doc}
ReadSources@{ shape: procs}
ExtractDomains@{ shape: procs}
OutputDomains@{ shape: doc}
OutputAdGuard@{ shape: doc}
ResolveDNS@{ shape: proc}
style Combine stroke-width:2px,stroke-dasharray: 2
style horizontal fill:transparent,stroke:transparent
git clone https://github.com/phani-kb/dns-toolkit.git
cd dns-toolkit
go build -o bin/dns-toolkit main.go# Download and process all sources
dns-toolkit download
dns-toolkit process
dns-toolkit consolidate
dns-toolkit generate output
# Search for a domain
dns-toolkit search example.com
# Analyze overlaps between sources
dns-toolkit overlap
# Find top entries across sources
dns-toolkit topDNS Toolkit
Usage:
dns-toolkit [command]
Available Commands:
archive Archive DNS toolkit data
consolidate Consolidate processed files
download Download enabled sources
generate Generate different types of outputs
help Help about any command
overlap Find overlap between source files
process Process downloaded files
search Search for a domain or IP in the processed files
sts Prints the source types summary
top Find top entry(s) in each generic source type
validate-sources Validate the sources configuration
version Print the version number of DNS Toolkit
Flags:
-h, --help help for dns-toolkit
Use "dns-toolkit [command] --help" for more information about a command.
data/output/
├── *_blocklist.txt # Blocklists for various source types (adguard, domain, ipv4, ipv6, cidr)
├── *_allowlist.txt # Allowlists for various source types (adguard, domain, etc.)
├── categories/ # Lists by category (ads, malware, privacy, etc.)
├── groups/ # Lists by size (mini, lite, normal, big)
├── top/ # Top entries based on source frequency
└── summaries/ # Processing metadata and statistics
- Fork the repository
- Create a feature branch
- Make your changes
- Submit a pull request
If you encounter a bug, have a feature request, or want to suggest an improvement, please open an issue on the GitHub Issues page.
This project is licensed under the terms specified in the LICENSE file.