apply @hl2guide wildcard whitelist to threat-intelligence blocklist

This commit is contained in:
Zelo72 2021-10-27 13:22:52 +02:00
parent c14063a56d
commit 5bac5b2c10
2 changed files with 176 additions and 2040 deletions

File diff suppressed because it is too large Load Diff

View File

@ -16,12 +16,13 @@ Config:
threat-intelligence.white
-- Whitelists - 4:
-- Whitelists - 5:
../../data/exclude.list
../../data/white.list.important
../../data/white.list.apple
../../data/white.list.microsoft
../../data/white.list.hl2guide
Initialize ...
@ -32,42 +33,42 @@ Initialize ...
2 | 412 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 9439 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 34018 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 34033 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5987 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
9 | 59 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
10 | 43 | hosts | http | online | changed | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 1060 | hosts | http | online | changed | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
10 | 43 | hosts | http | online | unchanged | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 1060 | hosts | http | online | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
13 | 695 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
14 | 3686 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1653 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4447 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile
18 | 1639 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4460 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 914 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
21 | 915 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
22 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 357 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 34018 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73665 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 996 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
29 | 1997 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1999 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
26 | 34033 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73665 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 997 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1997 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 43 | domains | http | online | changed | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 45482 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
35 | 55350 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
33 | 43 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 45556 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 55430 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 34145 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 34267 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 23028 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
40 | 23028 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
42 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
43 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
@ -79,7 +80,7 @@ Initialize ...
49 | 3358 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 399 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 399 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -88,7 +89,7 @@ Initialize ...
58 | 2382 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-amnenstytech.txt
59 | 307 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-certego.txt
60 | 1010 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-citizenlabs.txt
61 | 100 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-cyble.txt
61 | 100 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-cyble.txt
62 | 211 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-drweb.txt
63 | 158 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-eset.txt
64 | 3 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt
@ -106,21 +107,21 @@ Initialize ...
76 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35097 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 101990 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 101996 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 130 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1195262
== Source (unique): 864701 (-330561)
-- White: 863937 (-764)
-- White(*): 860568 (-3369)
-- Dead: 371014 (-489554)
** Source (raw): 1195575
== Source (unique): 864845 (-330730)
-- White: 864078 (-767)
-- White(*): 858783 (-5295)
-- Dead: 369241 (-489542)
371014 unique Domains - Version 2021.1027.120131
MD5 Domains RAW: 50094488f8e3d501999711d93db6a6b6
369241 unique Domains - Version 2021.1027.131618
MD5 Domains RAW: e7279f41b3c80570af089f5f5c9dca31
# Convert threat-intelligence to Hostlist ...
@ -146,10 +147,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 351718
Length after applying transformations is 351718
The list was compressed from 351721 to 323206
Final length of the list is 323212
Original length is 349892
Length after applying transformations is 349892
The list was compressed from 349895 to 321341
Final length of the list is 321347
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling