threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-10-23 17:39:45 +02:00
parent 0e13276196
commit fc5f2b156e
2 changed files with 1009 additions and 959 deletions

File diff suppressed because it is too large Load Diff

View File

@ -12,12 +12,11 @@ Config:
../../data/dead.list
-- Whitelists - 4:
-- Whitelists - 3:
../../data/exclude.list
../../data/white.list.apple
../../data/white.list.microsoft
../../data/white.list.energized
-- Unblocklists - 1:
@ -28,11 +27,11 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 6523 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 406 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
1 | 6442 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 407 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 8884 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 33642 | hosts | http | online | unchanged | https://hole.cert.pl/domains/domains_hosts.txt
5 | 33656 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5997 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -52,11 +51,11 @@ Initialize ...
22 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
23 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
24 | 365 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
25 | 33642 | domains | http | online | unchanged | https://hole.cert.pl/domains/domains.txt
26 | 73354 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
27 | 758 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
28 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
29 | 1997 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: kriskintel.com_feeds_ktip_malicious_domains.txt
25 | 33656 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
26 | 73323 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
27 | 767 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
28 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
29 | 1994 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
30 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
31 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
32 | 52 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
@ -78,7 +77,7 @@ Initialize ...
48 | 3239 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
50 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
51 | 336 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
51 | 495 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -104,23 +103,23 @@ Initialize ...
74 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
75 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
76 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
77 | 35074 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
78 | 101528 | domains | http | online | unchanged | https://www.usom.gov.tr/url-list.txt
77 | 35077 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
78 | 101556 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 29 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1187583
== Source (unique): 860090 (-327493)
-- White: 859321 (-769)
-- White(*): 857810 (-1511)
-- Dead: 367520 (-490290)
-- Unblock: 367520 (-0)
** Source (raw): 1187696
== Source (unique): 860119 (-327577)
-- White: 859351 (-768)
-- White(*): 857831 (-1520)
-- Dead: 367555 (-490276)
-- Unblock: 367555 (-0)
367520 unique Domains - Version 2021.1023.143043
MD5 Domains RAW: b20efc15d897cd84251e89d9db10e3b8
367555 unique Domains - Version 2021.1023.173527
MD5 Domains RAW: e2bdefc242b6b4afb20e955f849d5ac9
# Convert threat-intelligence to Hostlist ...
@ -146,10 +145,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 347390
Length after applying transformations is 347390
The list was compressed from 347393 to 319466
Final length of the list is 319472
Original length is 347419
Length after applying transformations is 347419
The list was compressed from 347422 to 319517
Final length of the list is 319523
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling