2021-10-19 21:59:14 +02:00
|
|
|
|
### Compile threat-intelligence Blocklist ###
|
|
|
|
|
|
|
|
|
|
|
|
Config:
|
|
|
|
|
|
|
|
|
|
|
|
** Build - 3:
|
|
|
|
|
|
|
|
|
|
|
|
hosts
|
|
|
|
|
|
adblock
|
|
|
|
|
|
localpush
|
|
|
|
|
|
|
|
|
|
|
|
-- Deadlists - 1:
|
|
|
|
|
|
|
|
|
|
|
|
../../data/dead.list
|
|
|
|
|
|
|
|
|
|
|
|
-- Whitelists - 4:
|
|
|
|
|
|
|
|
|
|
|
|
../../data/exclude.list
|
|
|
|
|
|
../../data/white.list.apple
|
|
|
|
|
|
../../data/white.list.microsoft
|
|
|
|
|
|
../../data/white.list.energized
|
|
|
|
|
|
|
|
|
|
|
|
-- Unblocklists - 1:
|
|
|
|
|
|
|
|
|
|
|
|
../../data/white.list.important
|
|
|
|
|
|
|
|
|
|
|
|
Initialize ...
|
|
|
|
|
|
|
|
|
|
|
|
# Download and convert Sourcelists ...
|
|
|
|
|
|
|
|
|
|
|
|
Nr | Count | Format | Source | Status | File | URL/File
|
2021-10-22 13:23:48 +02:00
|
|
|
|
1 | 6706 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
|
|
|
|
|
|
2 | 413 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
|
|
|
|
|
|
3 | 8622 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
|
2021-10-19 21:59:14 +02:00
|
|
|
|
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
|
2021-10-22 13:23:48 +02:00
|
|
|
|
5 | 33535 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
|
2021-10-19 21:59:14 +02:00
|
|
|
|
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
7 | 5997 | hosts | http | online | changed | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
|
2021-10-20 18:05:52 +02:00
|
|
|
|
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
|
|
|
|
|
|
9 | 59 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
|
2021-10-22 13:23:48 +02:00
|
|
|
|
10 | 54 | hosts | http | online | changed | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
|
|
|
|
|
|
11 | 1047 | hosts | http | online | changed | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
|
|
|
|
|
|
13 | 695 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
|
2021-10-21 12:05:40 +02:00
|
|
|
|
14 | 3622 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
|
|
|
|
|
|
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
|
|
|
|
|
|
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
|
2021-10-22 13:23:48 +02:00
|
|
|
|
18 | 1517 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
|
2021-10-20 14:33:09 +02:00
|
|
|
|
19 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
|
2021-10-22 00:07:10 +02:00
|
|
|
|
20 | 914 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
|
2021-10-20 14:33:09 +02:00
|
|
|
|
21 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt
|
|
|
|
|
|
22 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
|
|
|
|
|
|
23 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
|
|
|
|
|
|
24 | 365 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
25 | 33535 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
|
|
|
|
|
|
26 | 73359 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
|
|
|
|
|
|
27 | 751 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
|
2021-10-22 06:06:03 +02:00
|
|
|
|
28 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
|
|
|
|
|
|
29 | 1998 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
30 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
|
|
|
|
|
|
31 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
32 | 54 | domains | http | online | changed | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
|
|
|
|
|
|
33 | 44764 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
|
|
|
|
|
|
34 | 54398 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
35 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
|
|
|
|
|
|
36 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
|
2021-10-22 00:07:10 +02:00
|
|
|
|
37 | 35258 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
38 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
|
2021-10-22 13:23:48 +02:00
|
|
|
|
39 | 22759 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
|
2021-10-20 14:33:09 +02:00
|
|
|
|
40 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
|
|
|
|
|
|
41 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
|
|
|
|
|
|
42 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
|
2021-10-22 06:06:03 +02:00
|
|
|
|
43 | 13908 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: cbuijs_ut1_cryptojacking_domains.txt
|
|
|
|
|
|
44 | 168923 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: cbuijs_ut1_malware_domains.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
45 | 434 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
|
|
|
|
|
|
46 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
|
|
|
|
|
|
47 | 644 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
48 | 3227 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
49 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
|
|
|
|
|
|
50 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
51 | 421 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
52 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
|
|
|
|
|
|
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
|
|
|
|
|
|
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
|
|
|
|
|
|
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.9_italy.txt
|
|
|
|
|
|
56 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v4.0_uk.txt
|
|
|
|
|
|
57 | 2382 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-amnenstytech.txt
|
|
|
|
|
|
58 | 307 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-certego.txt
|
|
|
|
|
|
59 | 1010 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-citizenlabs.txt
|
|
|
|
|
|
60 | 47 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-cyble.txt
|
|
|
|
|
|
61 | 211 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-drweb.txt
|
|
|
|
|
|
62 | 158 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-eset.txt
|
|
|
|
|
|
63 | 3 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt
|
|
|
|
|
|
64 | 10592 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt
|
|
|
|
|
|
65 | 1687 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt
|
|
|
|
|
|
66 | 2925 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt
|
|
|
|
|
|
67 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt
|
|
|
|
|
|
68 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
|
|
|
|
|
|
69 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
|
2021-10-21 12:05:40 +02:00
|
|
|
|
70 | 3791 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
|
|
|
|
|
|
71 | 150425 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
72 | 16899 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
|
|
|
|
|
|
73 | 500 | domains | http | online | unchanged | https://rescure.me/covid.txt
|
|
|
|
|
|
74 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
|
2021-10-20 14:33:09 +02:00
|
|
|
|
75 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
|
|
|
|
|
|
76 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
|
2021-10-22 00:07:10 +02:00
|
|
|
|
77 | 35065 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
|
2021-10-22 13:23:48 +02:00
|
|
|
|
78 | 101388 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
|
2021-10-22 06:06:03 +02:00
|
|
|
|
79 | 27 | domains | local | online | unchanged | black.list.threat-intelligence
|
2021-10-19 21:59:14 +02:00
|
|
|
|
|
|
|
|
|
|
# Build threat-intelligence Domainlist ...
|
|
|
|
|
|
|
|
|
|
|
|
Stats threat-intelligence:
|
|
|
|
|
|
|
2021-10-22 13:23:48 +02:00
|
|
|
|
** Source (raw): 1186787
|
|
|
|
|
|
== Source (unique): 859510 (-327277)
|
|
|
|
|
|
-- White: 858733 (-777)
|
|
|
|
|
|
-- White(*): 857207 (-1526)
|
|
|
|
|
|
-- Dead: 366852 (-490355)
|
|
|
|
|
|
-- Unblock: 366852 (-0)
|
2021-10-20 08:22:41 +02:00
|
|
|
|
|
2021-10-22 13:23:48 +02:00
|
|
|
|
366852 unique Domains - Version 2021.1022.105512
|
|
|
|
|
|
MD5 Domains RAW: 359838a18192842385f875ae0013e72a
|
2021-10-19 21:59:14 +02:00
|
|
|
|
|
|
|
|
|
|
# Convert threat-intelligence to Hostlist ...
|
|
|
|
|
|
|
|
|
|
|
|
# Convert threat-intelligence to AdBlocklist ...
|
|
|
|
|
|
|
|
|
|
|
|
Prepare domain list for compiling ... done.
|
|
|
|
|
|
|
2021-10-20 07:54:13 +02:00
|
|
|
|
ℹ Starting @adguard/hostlist-compiler v1.0.12
|
|
|
|
|
|
ℹ Starting the compiler
|
|
|
|
|
|
ℹ Configuration: {
|
|
|
|
|
|
"name": "threat-intelligence",
|
|
|
|
|
|
"sources": [
|
|
|
|
|
|
{
|
|
|
|
|
|
"source": "threat-intelligence.adblock.raw",
|
2021-10-22 13:23:48 +02:00
|
|
|
|
"type": "adblock",
|
|
|
|
|
|
"exclusions_sources": [
|
|
|
|
|
|
"https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exclusions.txt"
|
|
|
|
|
|
],
|
|
|
|
|
|
"transformations": [
|
|
|
|
|
|
"Validate"
|
|
|
|
|
|
]
|
|
|
|
|
|
},
|
|
|
|
|
|
{
|
|
|
|
|
|
"source": "https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/rules.txt",
|
|
|
|
|
|
"transformations": [
|
|
|
|
|
|
"Validate"
|
|
|
|
|
|
],
|
|
|
|
|
|
"type": "adblock"
|
|
|
|
|
|
},
|
|
|
|
|
|
{
|
|
|
|
|
|
"source": "https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exceptions.txt",
|
|
|
|
|
|
"transformations": [
|
|
|
|
|
|
"Validate"
|
|
|
|
|
|
],
|
2021-10-20 07:54:13 +02:00
|
|
|
|
"type": "adblock"
|
|
|
|
|
|
}
|
|
|
|
|
|
],
|
|
|
|
|
|
"transformations": [
|
|
|
|
|
|
"Compress"
|
|
|
|
|
|
]
|
|
|
|
|
|
}
|
|
|
|
|
|
ℹ Start compiling threat-intelligence.adblock.raw
|
2021-10-22 13:23:48 +02:00
|
|
|
|
ℹ Original length is 346835
|
|
|
|
|
|
ℹ Filtering the list of rules using 325 exclusion rules
|
|
|
|
|
|
ℹ Excluded 2 rules. 346833 rules left.
|
|
|
|
|
|
ℹ Length after applying transformations is 346833
|
|
|
|
|
|
ℹ Start compiling https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/rules.txt
|
|
|
|
|
|
ℹ Original length is 576
|
|
|
|
|
|
ℹ Length after applying transformations is 570
|
|
|
|
|
|
ℹ Start compiling https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exceptions.txt
|
|
|
|
|
|
ℹ Original length is 177
|
|
|
|
|
|
ℹ Length after applying transformations is 177
|
|
|
|
|
|
ℹ The list was compressed from 347589 to 319331
|
|
|
|
|
|
ℹ Final length of the list is 319337
|
2021-10-20 07:54:13 +02:00
|
|
|
|
ℹ Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
|
|
|
|
|
|
ℹ Finished compiling
|
2021-10-19 21:59:14 +02:00
|
|
|
|
|
|
|
|
|
|
# Attach header to threat-intelligence Domainlist ...
|
|
|
|
|
|
|
|
|
|
|
|
# Push threat-intelligence to local Repositories ...
|
|
|
|
|
|
|
