threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-11-01 16:18:39 +01:00
parent eb11096f28
commit 6a9fbfce4c
2 changed files with 3141 additions and 2892 deletions

File diff suppressed because it is too large Load Diff

View File

@ -2,11 +2,12 @@
Config:
** Build - 3:
** Build - 4:
hosts
adblock
localpush
checkfordead
-- Excludelists - 1:
@ -34,11 +35,11 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 6579 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 423 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10362 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
1 | 6552 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 417 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10424 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 34500 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 34531 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5987 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -51,7 +52,7 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1139 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
18 | 1169 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4465 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 915 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
@ -59,19 +60,19 @@ Initialize ...
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 357 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 34500 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73712 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 1194 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1998 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
26 | 34531 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73712 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 1196 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1998 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1997 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 147 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 46122 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 56039 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
34 | 46091 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
35 | 55970 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 34021 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 34129 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 23171 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
@ -82,10 +83,10 @@ Initialize ...
46 | 434 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
47 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
48 | 657 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
49 | 3752 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 3765 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 247 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 449 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -112,22 +113,22 @@ Initialize ...
76 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35117 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 102453 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 102497 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1200067
== Source (unique): 867350 (-332717)
-- Exclude: 867345 (-5)
-- White: 866572 (-773)
-- White(*): 861213 (-5359)
-- Dead: 371816 (-489397)
** Source (raw): 1200455
== Source (unique): 867634 (-332821)
-- Exclude: 867629 (-5)
-- White: 866854 (-775)
-- White(*): 861490 (-5364)
-- Dead: 372098 (-489392)
371816 unique Domains - Version 2021.1101.120610
MD5 Domains RAW: 87d58e7024f988e218928791bc7cd582
372098 unique Domains - Version 2021.1101.161159
MD5 Domains RAW: 5c3b9c3b1fb7c2e8ffe8fd11746dd49c
# Convert threat-intelligence to Hostlist ...
@ -150,10 +151,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 352420
Length after applying transformations is 352420
The list was compressed from 352423 to 323840
Final length of the list is 323846
Original length is 352717
Length after applying transformations is 352717
The list was compressed from 352720 to 324088
Final length of the list is 324094
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling