threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-10-28 00:07:35 +02:00
parent 7493271d69
commit ebc0850ae9
2 changed files with 3096 additions and 2935 deletions

File diff suppressed because it is too large Load Diff

View File

@ -29,11 +29,11 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 6422 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 415 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 9606 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
1 | 6422 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 415 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 9606 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 34059 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 34124 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5987 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -46,29 +46,29 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1703 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4459 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile
18 | 1753 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4459 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 915 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
22 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 357 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 34059 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73635 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 985 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
26 | 34124 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73635 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 985 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
29 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1995 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
30 | 1998 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 43 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 45556 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 55430 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
34 | 45769 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 55678 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 34309 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 34331 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 23076 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
40 | 23093 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
42 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
43 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
@ -77,10 +77,10 @@ Initialize ...
46 | 434 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
47 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
48 | 657 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
49 | 3359 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 3359 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 952 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 1004 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -104,24 +104,24 @@ Initialize ...
73 | 16919 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
74 | 500 | domains | http | online | unchanged | https://rescure.me/covid.txt
75 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
76 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35098 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 102036 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 132 | domains | local | online | changed | black.list.threat-intelligence
76 | 508 | domains | http | online | changed | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 90 | domains | http | online | changed | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35100 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 102068 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 134 | domains | local | online | changed | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1196571
== Source (unique): 865601 (-330970)
-- White: 864832 (-769)
-- White(*): 859536 (-5296)
-- Dead: 369990 (-489546)
** Source (raw): 1197834
== Source (unique): 865935 (-331899)
-- White: 865170 (-765)
-- White(*): 859869 (-5301)
-- Dead: 370347 (-489522)
369990 unique Domains - Version 2021.1027.180138
MD5 Domains RAW: 3713d2819b552aac9d19cad579adcc82
370347 unique Domains - Version 2021.1028.000140
MD5 Domains RAW: d9f7af3ea29dc7339cc3cf45ce0d3425
# Convert threat-intelligence to Hostlist ...
@ -147,10 +147,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 350613
Length after applying transformations is 350613
The list was compressed from 350616 to 322076
Final length of the list is 322082
Original length is 350955
Length after applying transformations is 350955
The list was compressed from 350958 to 322237
Final length of the list is 322243
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling