threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-11-01 12:13:34 +01:00
parent 0168da9726
commit 3aefcdd447
2 changed files with 388 additions and 28 deletions

File diff suppressed because it is too large Load Diff

View File

@ -20,10 +20,11 @@ Config:
threat-intelligence.white
-- Whitelists - 5:
-- Whitelists - 6:
../../data/exclude.list
../../data/white.list.apple
../../data/white.list.egp
../../data/white.list.microsoft
../../data/white.list.hl2guide
../../data/networks/google.list
@ -37,7 +38,7 @@ Initialize ...
2 | 423 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10362 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 34453 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 34500 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5987 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -50,7 +51,7 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1105 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
18 | 1139 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4465 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 915 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
@ -58,9 +59,9 @@ Initialize ...
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 357 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 34453 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73518 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 847 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
26 | 34500 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73712 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 1194 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1998 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
@ -84,7 +85,7 @@ Initialize ...
49 | 3752 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 247 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 247 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -111,22 +112,22 @@ Initialize ...
76 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35117 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 102446 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 102453 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1199391
== Source (unique): 866964 (-332427)
-- Exclude: 866959 (-5)
-- White: 866186 (-773)
-- White(*): 860827 (-5359)
-- Dead: 371431 (-489396)
** Source (raw): 1200067
== Source (unique): 867350 (-332717)
-- Exclude: 867345 (-5)
-- White: 866572 (-773)
-- White(*): 861213 (-5359)
-- Dead: 371816 (-489397)
371431 unique Domains - Version 2021.1101.101738
MD5 Domains RAW: 94402dbd58cd526bd1ccdbdfe71324cc
371816 unique Domains - Version 2021.1101.120610
MD5 Domains RAW: 87d58e7024f988e218928791bc7cd582
# Convert threat-intelligence to Hostlist ...
@ -149,10 +150,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 352061
Length after applying transformations is 352061
The list was compressed from 352064 to 323481
Final length of the list is 323487
Original length is 352420
Length after applying transformations is 352420
The list was compressed from 352423 to 323840
Final length of the list is 323846
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling