build auto-update

This commit is contained in:
Zelo72 2021-11-16 15:49:04 +01:00
parent 07fa86ee41
commit 0e0e4237c8
1 changed files with 238 additions and 271 deletions

View File

@ -3,8 +3,8 @@ Initialize ...
===========================================
Bereits aktuell.
[master 095651b] auto-update
3 files changed, 4 insertions(+), 253 deletions(-)
[master ccefd09e] auto-update
1 file changed, 251 deletions(-)
delete mode 100644 pihole/blocklists/build/sourcefiles.txt
Bereits aktuell.
@ -41,7 +41,7 @@ Whitelist ...
594 /media/nas/git/rpi/pihole/blocklists/data/white.list.adguard
2528 /media/nas/git/rpi/pihole/blocklists/data/white.list.hl2guide
Start: 2021.11-16-13:20:31
Start: 2021.11-16-14:41:42
### Compile exclude Blocklist ###
@ -89,7 +89,7 @@ Initialize ...
28 | 4422 | white | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/accomplist/master/whitelist/optimized.white.domain.list
29 | 686 | white | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/my-allowlist/master/allow.list
30 | 352 | white | http | online | unchanged | https://raw.githubusercontent.com/chrisjudk/hosts/master/whitelist
31 | 3358 | white | http | online | changed | https://raw.githubusercontent.com/mkb2091/blockconvert/master/output/whitelist_domains.txt
31 | 3358 | white | http | online | unchanged | https://raw.githubusercontent.com/mkb2091/blockconvert/master/output/whitelist_domains.txt
32 | 429 | white | http | online | unchanged | https://raw.githubusercontent.com/nextdns/metadata/master/privacy/affiliate-tracking-domains
33 | 356 | white | http | online | unchanged | https://raw.githubusercontent.com/nextdns/metadata/master/security/typosquatting/protected-domains
34 | 1695 | white | http | online | unchanged | https://raw.githubusercontent.com/notracking/hosts-blocklists-scripts/master/hostnames.whitelist.txt
@ -98,7 +98,7 @@ Initialize ...
37 | 739 | white | http | online | unchanged | https://raw.githubusercontent.com/rspamd/maps/master/rspamd/dmarc_whitelist.inc
38 | 79 | white | http | online | unchanged | https://raw.githubusercontent.com/zebpalmer/dns_blocklists/master/whitelist.txt
39 | 231 | white | http | online | unchanged | https://raw.githubusercontent.com/p1r473/hosts/master/whitelist.txt
40 | 592 | white | local | online | changed | white.list
40 | 592 | white | local | online | unchanged | white.list
41 | 890 | white | local | online | unchanged | white.list.referral
42 | 69 | white | local | online | unchanged | white.list.important
43 | 594 | white | local | online | unchanged | white.list.adguard
@ -116,12 +116,9 @@ Stats exclude:
++ FLD: 65685 (+96)
++ WWW: 93626 (+27941)
93626 unique Domains - Version 2021.1116.132031
MD5 Domains RAW: d12f34cd4fb222024381776ca03c5b8e
# Push exclude to local Repositories ...
End: 2021.11-16-13:20:58
*****************************************************
* No changes to the previous repo version detected! *
*****************************************************
exclude - Done!
@ -129,7 +126,7 @@ exclude - Done!
Deadlist ...
===========================================
Start: 2021.11-16-13:21:05
Start: 2021.11-16-14:42:08
### Compile dead Blocklist ###
@ -153,41 +150,46 @@ Initialize ...
5 | 436 | dead | local | online | unchanged | dead.list.afftrack
6 | 6335 | dead | local | online | unchanged | dead.list.fake
7 | 96665 | dead | local | online | unchanged | dead.list.multi
8 | 1036 | dead | local | online | unchanged | dead.list.personal
9 | 499866 | dead | local | OFFLINE | unchanged | USE LOCAL COPY: dead.list.threat-intelligence
10 | 59 | dead | local | online | unchanged | dead.list.doh
8 | 499866 | dead | local | online | unchanged | dead.list.threat-intelligence
# Build dead Domainlist ...
Stats dead:
** Source (raw): 721495
== Source (unique): 542311 (-179184)
** Source (raw): 720400
== Source (unique): 542251 (-178149)
*****************************************************
* No changes to the previous repo version detected! *
*****************************************************
542251 unique Domains - Version 2021.1116.144208
MD5 Domains RAW: 43065d20973441c2c275a022bcf60720
# Push dead to local Repositories ...
End: 2021.11-16-14:42:39
dead - Done!
Bereits aktuell.
[master dc44f7b] white-dead auto-update
10 files changed, 80 insertions(+), 20 deletions(-)
[master 1b00f4a0] white-dead auto-update
8 files changed, 69 insertions(+), 139 deletions(-)
create mode 100644 pihole/blocklists/build/sourcefiles.txt
Bereits aktuell.
[main dd62dcd] white-dead auto-update
1 file changed, 2 insertions(+), 1 deletion(-)
Auf Branch main
Ihr Branch ist auf demselben Stand wie 'origin/main'.
nichts zu committen, Arbeitsverzeichnis unverändert
Bereits aktuell.
[main d71e5e4] white-dead auto-update
1 file changed, 1 insertion(+)
Auf Branch main
Ihr Branch ist auf demselben Stand wie 'origin/main'.
nichts zu committen, Arbeitsverzeichnis unverändert
===========================================
Black ...
===========================================
Start: 2021.11-16-13:21:25
Start: 2021.11-16-14:42:52
### Compile black Blocklist ###
@ -216,9 +218,9 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 13464 | domains | local | online | unchanged | black.list
2 | 178 | domains | local | online | changed | black.list.wl.removed
3 | 332 | domains | local | online | unchanged | black.list.wc.removed
1 | 12852 | domains | local | online | unchanged | black.list
2 | 184 | domains | local | online | changed | black.list.wl.removed
3 | 938 | domains | local | online | changed | black.list.wc.removed
# Build black Domainlist ...
@ -229,18 +231,15 @@ Stats black:
-- White: 13790 (-184)
-- White(*): 12852 (-938)
12852 unique Domains - Version 2021.1116.132125
MD5 Domains RAW: b0be0e9eb7b4f73cea3d04b12e05730c
# Push black to local Repositories ...
End: 2021.11-16-13:21:54
*****************************************************
* No changes to the previous repo version detected! *
*****************************************************
black - Done!
Bereits aktuell.
[master 2f9bd98] black auto-update
12 files changed, 1540 insertions(+), 1233 deletions(-)
[master 8060bee6] black auto-update
4 files changed, 621 insertions(+), 7 deletions(-)
Bereits aktuell.
Auf Branch main
@ -258,7 +257,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
Rules ...
===========================================
Start: 2021.11-16-13:21:59
Start: 2021.11-16-14:43:30
### Compile rules Blocklist ###
@ -291,7 +290,7 @@ Stats rules:
rules - Done!
Bereits aktuell.
[master 2f77299] rules auto-update
[master 36d96892] rules auto-update
1 file changed, 1 insertion(+)
Bereits aktuell.
@ -310,7 +309,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
Threat Intelligence Feeds ...
===========================================
Start: 2021.11-16-13:22:04
Start: 2021.11-16-14:43:35
### Compile threat-intelligence Blocklist ###
@ -348,11 +347,11 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 7000 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 372 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10368 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
1 | 7016 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 377 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10480 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 36009 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 36032 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 6020 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -365,7 +364,7 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1146 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
18 | 1112 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4578 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 919 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
@ -373,19 +372,19 @@ Initialize ...
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 355 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 36009 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
26 | 36032 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 73770 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 640 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1997 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
28 | 642 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1995 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2249 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 52 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 48022 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
35 | 58240 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
34 | 48022 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 58240 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 35015 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 35015 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 676 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 25414 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
@ -399,7 +398,7 @@ Initialize ...
49 | 3927 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71287 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 396 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 624 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -426,7 +425,7 @@ Initialize ...
76 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35201 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 103776 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 103892 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 56177 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains
81 | 11527 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains
82 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
@ -435,15 +434,15 @@ Initialize ...
Stats threat-intelligence:
** Source (raw): 1280997
== Source (unique): 877194 (-403803)
-- Exclude: 877189 (-5)
-- White: 876416 (-773)
-- White(*): 870475 (-5941)
-- Dead: 369104 (-501371)
** Source (raw): 1281487
== Source (unique): 877458 (-404029)
-- Exclude: 877453 (-5)
-- White: 876680 (-773)
-- White(*): 870477 (-6203)
-- Dead: 369283 (-501194)
369104 unique Domains - Version 2021.1116.132204
MD5 Domains RAW: f07dbc94e5c7d263420b0e75e76fbbd6
369283 unique Domains - Version 2021.1116.144335
MD5 Domains RAW: 70249192502ee69a507404dcaa05756b
# Convert threat-intelligence to Hostlist ...
@ -466,10 +465,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 349817
Length after applying transformations is 349817
The list was compressed from 349820 to 320363
Final length of the list is 320369
Original length is 349992
Length after applying transformations is 349992
The list was compressed from 349995 to 320532
Final length of the list is 320538
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling
@ -477,27 +476,29 @@ Prepare domain list for compiling ... done.
# Push threat-intelligence to local Repositories ...
End: 2021.11-16-13:28:13
End: 2021.11-16-14:50:14
threat-intelligence - Done!
Bereits aktuell.
[master befa1f9] threat-intelligence auto-update
19 files changed, 21340 insertions(+), 21082 deletions(-)
[master f5ae4ac1] threat-intelligence auto-update
22 files changed, 40631 insertions(+), 39075 deletions(-)
rewrite pihole/blocklists/sources/kriskintel.com_feeds_ktip_covid_domains.txt (95%)
rewrite pihole/blocklists/sources/kriskintel.com_feeds_ktip_malicious_domains.txt (97%)
Bereits aktuell.
[main 43015f5] threat-intelligence auto-update
2 files changed, 168 insertions(+), 132 deletions(-)
[main 7bead6d] threat-intelligence auto-update
2 files changed, 3533 insertions(+), 3354 deletions(-)
Bereits aktuell.
[main 2ecdd1a] threat-intelligence auto-update
2 files changed, 131 insertions(+), 106 deletions(-)
[main ebed016] threat-intelligence auto-update
2 files changed, 3003 insertions(+), 2834 deletions(-)
===========================================
Personal ...
===========================================
Start: 2021.11-16-13:28:41
Start: 2021.11-16-14:50:53
### Compile personal Blocklist ###
@ -538,10 +539,10 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 12852 | domains | local | online | changed | black.list
1 | 12852 | domains | local | online | unchanged | black.list
2 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
3 | 2 | domains | local | online | unchanged | black.list.affiliatetracking
4 | 3685 | hosts | http | online | changed | https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
4 | 3685 | hosts | http | online | unchanged | https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
5 | 1740 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/ads-and-trackers.txt
6 | 2014 | adblock | http | online | unchanged | https://raw.githubusercontent.com/Kees1958/W3C_annual_most_used_survey_blocklist/master/TOP_EU_US_Ads_Trackers_ABP
7 | 4921 | adblock | http | online | unchanged | https://raw.githubusercontent.com/Kees1958/W3C_annual_most_used_survey_blocklist/master/EU_US%2Bmost_used_ad_and_tracking_networks
@ -554,15 +555,15 @@ Stats personal:
== Source (unique): 21604 (-3749)
-- White: 20998 (-606)
-- White(*): 20969 (-29)
-- Dead: 19954 (-1015)
++ Block: 20149 (+195)
-- Unblock: 20145 (-4)
-- Unblock(*): 20139 (-6)
++ FLD: 20290 (+151)
++ WWW: 27035 (+6745)
-- Dead: 19955 (-1014)
++ Block: 20150 (+195)
-- Unblock: 20146 (-4)
-- Unblock(*): 20140 (-6)
++ FLD: 20291 (+151)
++ WWW: 27036 (+6745)
27035 unique Domains - Version 2021.1116.132841
MD5 Domains RAW: c26d697027c31ccfcd6a315215ab9a47
27036 unique Domains - Version 2021.1116.145053
MD5 Domains RAW: d65a3f2cd5ded522f04c04361bbe4149
# Convert personal to Hostlist ...
@ -585,10 +586,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling personal.adblock.raw
Original length is 19898
Length after applying transformations is 19898
The list was compressed from 19901 to 12395
Final length of the list is 12401
Original length is 19899
Length after applying transformations is 19899
The list was compressed from 19902 to 12396
Final length of the list is 12402
Writing output to /media/nas/git/rpi/pihole/blocklists/build/personal/out/personal.adblock
Finished compiling
@ -596,27 +597,27 @@ Prepare domain list for compiling ... done.
# Push personal to local Repositories ...
End: 2021.11-16-13:29:36
End: 2021.11-16-14:51:55
personal - Done!
Bereits aktuell.
[master 667228c] personal auto-update
12 files changed, 46 insertions(+), 1258 deletions(-)
[master ae8d5a08] personal auto-update
9 files changed, 51 insertions(+), 42 deletions(-)
Bereits aktuell.
[main 5e38c83] personal auto-update
2 files changed, 14 insertions(+), 13 deletions(-)
[main b500f75] personal auto-update
2 files changed, 18 insertions(+), 17 deletions(-)
Bereits aktuell.
[main 87c5a95] personal auto-update
2 files changed, 13 insertions(+), 13 deletions(-)
[main 9d632e5] personal auto-update
2 files changed, 18 insertions(+), 17 deletions(-)
===========================================
Fake ...
===========================================
Start: 2021.11-16-13:29:42
Start: 2021.11-16-14:52:03
### Compile fake Blocklist ###
@ -677,8 +678,8 @@ Stats fake:
fake - Done!
Bereits aktuell.
[master e3431cb] fake auto-update
3 files changed, 14 insertions(+), 79 deletions(-)
[master 3b9f9e53] fake auto-update
1 file changed, 9 insertions(+)
Bereits aktuell.
Auf Branch main
@ -696,7 +697,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
Light ...
===========================================
Start: 2021.11-16-13:30:37
Start: 2021.11-16-14:52:50
### Compile light Blocklist ###
@ -742,37 +743,37 @@ Initialize ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 1013 | domains | http | online | unchanged | https://raw.githubusercontent.com/jkrejcha/AdmiraList/master/AdmiraList.txt
2 | 16376 | domains | http | online | changed | https://raw.githubusercontent.com/AdroitAdorKhan/antipopads-re/master/formats/domains.txt
2 | 16376 | domains | http | online | unchanged | https://raw.githubusercontent.com/AdroitAdorKhan/antipopads-re/master/formats/domains.txt
3 | 3670 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/ads/domains
4 | 3685 | hosts | http | online | unchanged | https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
5 | 16965 | hosts | http | online | unchanged | https://someonewhocares.org/hosts/
6 | 1132 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
6 | 1112 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
7 | 4578 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
8 | 41581 | adblock | http | online | changed | https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
8 | 41581 | adblock | http | online | unchanged | https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
9 | 19021 | adblock | http | online | unchanged | https://easylist.to/easylist/easylist.txt
10 | 16237 | adblock | http | online | changed | https://easylist.to/easylist/easyprivacy.txt
10 | 16237 | adblock | http | online | unchanged | https://easylist.to/easylist/easyprivacy.txt
11 | 12852 | domains | local | online | unchanged | black.list
12 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
13 | 27035 | domains | local | online | changed | personal.txt
13 | 27036 | domains | local | online | changed | personal.txt
# Build light Domainlist ...
Stats light:
** Source (raw): 164284
== Source (unique): 98068 (-66216)
-- Exclude: 97981 (-87)
-- White: 96688 (-1293)
-- White(*): 95653 (-1035)
-- Dead: 81339 (-14314)
++ Block: 81533 (+194)
-- Unblock: 81529 (-4)
-- Unblock(*): 81523 (-6)
++ FLD: 82249 (+726)
++ WWW: 114344 (+32095)
** Source (raw): 164265
== Source (unique): 98048 (-66217)
-- Exclude: 97961 (-87)
-- White: 96668 (-1293)
-- White(*): 95633 (-1035)
-- Dead: 81320 (-14313)
++ Block: 81514 (+194)
-- Unblock: 81510 (-4)
-- Unblock(*): 81504 (-6)
++ FLD: 82224 (+720)
++ WWW: 114316 (+32092)
114344 unique Domains - Version 2021.1116.133037
MD5 Domains RAW: c992dfa5959928ff6ded221e33350263
114316 unique Domains - Version 2021.1116.145250
MD5 Domains RAW: ca4241626ab5a62b57a9fde5b2d5a8a8
# Convert light to Hostlist ...
@ -795,10 +796,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling light.adblock.raw
Original length is 73322
Length after applying transformations is 73322
The list was compressed from 73325 to 63317
Final length of the list is 63323
Original length is 73302
Length after applying transformations is 73302
The list was compressed from 73305 to 63296
Final length of the list is 63302
Writing output to /media/nas/git/rpi/pihole/blocklists/build/light/out/light.adblock
Finished compiling
@ -806,27 +807,27 @@ Prepare domain list for compiling ... done.
# Push light to local Repositories ...
End: 2021.11-16-13:32:21
End: 2021.11-16-14:54:30
light - Done!
Bereits aktuell.
[master b022828] light auto-update
14 files changed, 681 insertions(+), 582 deletions(-)
[master ffe2306f] light auto-update
11 files changed, 461 insertions(+), 557 deletions(-)
Bereits aktuell.
[main 7172e21] light auto-update
2 files changed, 177 insertions(+), 152 deletions(-)
[main 42e2148] light auto-update
2 files changed, 131 insertions(+), 159 deletions(-)
Bereits aktuell.
[main 78b3cd7] light auto-update
2 files changed, 120 insertions(+), 108 deletions(-)
[main 8b842ec] light auto-update
2 files changed, 96 insertions(+), 117 deletions(-)
===========================================
Multi ...
===========================================
Start: 2021.11-16-13:32:31
Start: 2021.11-16-14:54:39
### Compile multi Blocklist ###
@ -899,15 +900,15 @@ Initialize ...
24 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
25 | 93903 | hosts | http | online | unchanged | https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
26 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
27 | 1132 | hosts | http | online | unchanged | https://urlhaus.abuse.ch/downloads/hostfile/
27 | 1112 | hosts | http | online | unchanged | https://urlhaus.abuse.ch/downloads/hostfile/
28 | 4578 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
29 | 372 | hosts | http | online | unchanged | https://raw.githubusercontent.com/Laicure/hosts/master/shithosts
30 | 41581 | adblock | http | online | unchanged | https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
31 | 1027 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_11_Mobile/filter.txt
32 | 743 | adblock | http | online | changed | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_14_Annoyances/filter.txt
32 | 743 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_14_Annoyances/filter.txt
33 | 5552 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_16_French/filter.txt
34 | 4671 | adblock | http | online | changed | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_1_Russian/filter.txt
35 | 6944 | adblock | http | online | changed | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_224_Chinese/filter.txt
34 | 4671 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_1_Russian/filter.txt
35 | 6948 | adblock | http | online | changed | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_224_Chinese/filter.txt
36 | 22718 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_2_English/filter.txt
37 | 18797 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_3_Spyware/filter.txt
38 | 51 | adblock | http | online | unchanged | https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_4_Social/filter.txt
@ -919,13 +920,13 @@ Initialize ...
44 | 15754 | domains | http | online | unchanged | https://raw.githubusercontent.com/adguardteam/cname-trackers/master/combined_disguised_trackers_justdomains.txt
45 | 127 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/Liste_AR.txt
46 | 9660 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/advblock.txt
47 | 6674 | adblock | http | online | changed | https://easylist-downloads.adblockplus.org/easylistchina.txt
47 | 6678 | adblock | http | online | changed | https://easylist-downloads.adblockplus.org/easylistchina.txt
48 | 24 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/easylistdutch.txt
49 | 365 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/easylistgermany.txt
50 | 216 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/easylistitaly.txt
51 | 38 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/easylistpolish.txt
52 | 129 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/easylistportuguese.txt
53 | 427 | adblock | http | online | changed | https://easylist-downloads.adblockplus.org/easylistspanish.txt
53 | 428 | adblock | http | online | changed | https://easylist-downloads.adblockplus.org/easylistspanish.txt
54 | 19 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/indianlist.txt
55 | 25 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/koreanlist.txt
56 | 5545 | adblock | http | online | unchanged | https://easylist-downloads.adblockplus.org/liste_fr.txt
@ -958,20 +959,20 @@ Initialize ...
Stats multi:
** Source (raw): 790478
== Source (unique): 420956 (-369522)
-- Exclude: 416716 (-4240)
-- White: 413905 (-2811)
-- White(*): 407739 (-6166)
-- Dead: 302655 (-105084)
++ Block: 302849 (+194)
-- Unblock: 302845 (-4)
-- Unblock(*): 302839 (-6)
++ FLD: 303084 (+245)
++ WWW: 414796 (+111712)
** Source (raw): 790467
== Source (unique): 420962 (-369505)
-- Exclude: 416722 (-4240)
-- White: 413911 (-2811)
-- White(*): 407745 (-6166)
-- Dead: 302662 (-105083)
++ Block: 302856 (+194)
-- Unblock: 302852 (-4)
-- Unblock(*): 302846 (-6)
++ FLD: 303092 (+246)
++ WWW: 414808 (+111716)
414796 unique Domains - Version 2021.1116.133231
MD5 Domains RAW: 8aa21f93cb394cfc1a33741bfdebbd8c
414808 unique Domains - Version 2021.1116.145439
MD5 Domains RAW: 88d4fc1ff93df5f762e426bed7f5b1b2
# Convert multi to Hostlist ...
@ -994,10 +995,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling multi.adblock.raw
Original length is 266136
Length after applying transformations is 266136
The list was compressed from 266139 to 240018
Final length of the list is 240024
Original length is 266143
Length after applying transformations is 266143
The list was compressed from 266146 to 240025
Final length of the list is 240031
Writing output to /media/nas/git/rpi/pihole/blocklists/build/multi/out/multi.adblock
Finished compiling
@ -1005,28 +1006,27 @@ Prepare domain list for compiling ... done.
# Push multi to local Repositories ...
End: 2021.11-16-13:37:23
End: 2021.11-16-14:59:23
multi - Done!
Bereits aktuell.
[master f7b2ed1] multi auto-update
18 files changed, 830 insertions(+), 1542 deletions(-)
delete mode 100644 pihole/blocklists/build/doh-vpn-proxy-bypass/doh-vpn-proxy-bypass.config.deadlists
[master da3aff81] multi auto-update
14 files changed, 219 insertions(+), 96 deletions(-)
Bereits aktuell.
[main b744a3c] multi auto-update
2 files changed, 171 insertions(+), 93 deletions(-)
[main eb2f429] multi auto-update
2 files changed, 47 insertions(+), 35 deletions(-)
Bereits aktuell.
[main e052a47] multi auto-update
2 files changed, 129 insertions(+), 64 deletions(-)
[main 1c4a286] multi auto-update
2 files changed, 40 insertions(+), 33 deletions(-)
===========================================
Affiliate & Tracking ...
===========================================
Start: 2021.11-16-13:37:46
Start: 2021.11-16-15:00:06
### Compile d3host Blocklist ###
@ -1057,7 +1057,7 @@ Stats d3host:
d3host - Done!
Start: 2021.11-16-13:37:47
Start: 2021.11-16-15:00:08
### Compile affiliatetracking Blocklist ###
@ -1129,7 +1129,7 @@ Stats affiliatetracking:
affiliatetracking - Done!
Bereits aktuell.
[master 20c817a] affiliatetracking auto-update
[master c2dc7b6c] affiliatetracking auto-update
1 file changed, 1 insertion(+)
Bereits aktuell.
@ -1148,7 +1148,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
DoH/VPN/TOR/Proxy ...
===========================================
Start: 2021.11-16-13:38:25
Start: 2021.11-16-15:00:41
### Compile doh-vpn-proxy-bypass Blocklist ###
@ -1183,62 +1183,33 @@ Stats doh-vpn-proxy-bypass:
== Source (unique): 780 (-535)
-- White: 770 (-10)
770 unique Domains - Version 2021.1116.133825
MD5 Domains RAW: 49910087ad9ce7530fd416672f721dd3
# Convert doh-vpn-proxy-bypass to Hostlist ...
# Convert doh-vpn-proxy-bypass to AdBlocklist ...
Prepare domain list for compiling ... done.
Starting @adguard/hostlist-compiler v1.0.12
Starting the compiler
Configuration: {
"name": "doh-vpn-proxy-bypass",
"sources": [
{
"source": "doh-vpn-proxy-bypass.adblock.raw",
"type": "adblock"
}
],
"transformations": [
"Compress"
]
}
Start compiling doh-vpn-proxy-bypass.adblock.raw
Original length is 771
Length after applying transformations is 771
The list was compressed from 774 to 738
Final length of the list is 744
Writing output to /media/nas/git/rpi/pihole/blocklists/build/doh-vpn-proxy-bypass/out/doh-vpn-proxy-bypass.adblock
Finished compiling
# Attach header to doh-vpn-proxy-bypass Domainlist ...
# Push doh-vpn-proxy-bypass to local Repositories ...
End: 2021.11-16-13:38:28
*****************************************************
* No changes to the previous repo version detected! *
*****************************************************
doh-vpn-proxy-bypass - Done!
Bereits aktuell.
[master cb1e221] doh-vpn-proxy-bypass auto-update
9 files changed, 313 insertions(+), 24 deletions(-)
[master 82481cd2] doh-vpn-proxy-bypass auto-update
3 files changed, 7 insertions(+), 68 deletions(-)
Bereits aktuell.
[main bfb11ef] doh-vpn-proxy-bypass auto-update
2 files changed, 65 insertions(+), 12 deletions(-)
Auf Branch main
Ihr Branch ist auf demselben Stand wie 'origin/main'.
nichts zu committen, Arbeitsverzeichnis unverändert
Bereits aktuell.
[main fbf14ed] doh-vpn-proxy-bypass auto-update
2 files changed, 63 insertions(+), 12 deletions(-)
Auf Branch main
Ihr Branch ist auf demselben Stand wie 'origin/main'.
nichts zu committen, Arbeitsverzeichnis unverändert
===========================================
Big ...
===========================================
Start: 2021.11-16-13:38:33
Start: 2021.11-16-15:00:46
### Compile big Blocklist ###
@ -1278,7 +1249,7 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 414796 | domains | local | online | changed | multi.txt
1 | 414808 | domains | local | online | changed | multi.txt
2 | 43284 | domains | local | online | unchanged | fake.txt
3 | 1041172 | domains | http | online | unchanged | https://dbl.oisd.nl
@ -1286,19 +1257,19 @@ Initialize ...
Stats big:
** Source (raw): 1499252
== Source (unique): 1281558 (-217694)
-- White: 1280600 (-958)
-- White(*): 1271850 (-8750)
-- Dead: 1228794 (-43056)
++ Block: 1228988 (+194)
-- Unblock: 1228984 (-4)
-- Unblock(*): 1228978 (-6)
++ FLD: 1246583 (+17605)
++ WWW: 1256393 (+9810)
** Source (raw): 1499264
== Source (unique): 1281568 (-217696)
-- White: 1280610 (-958)
-- White(*): 1271860 (-8750)
-- Dead: 1228805 (-43055)
++ Block: 1228999 (+194)
-- Unblock: 1228995 (-4)
-- Unblock(*): 1228989 (-6)
++ FLD: 1246594 (+17605)
++ WWW: 1256404 (+9810)
1256393 unique Domains - Version 2021.1116.133833
MD5 Domains RAW: 465f17110a453fa62eb19c9d121b078a
1256404 unique Domains - Version 2021.1116.150046
MD5 Domains RAW: b6adb86c22597cd393ed4f56934a774c
# Convert big to Hostlist ...
@ -1321,10 +1292,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling big.adblock.raw
Original length is 909210
Length after applying transformations is 909210
The list was compressed from 909213 to 494100
Final length of the list is 494106
Original length is 909216
Length after applying transformations is 909216
The list was compressed from 909219 to 494105
Final length of the list is 494111
Writing output to /media/nas/git/rpi/pihole/blocklists/build/big/out/big.adblock
Finished compiling
@ -1332,25 +1303,21 @@ Prepare domain list for compiling ... done.
# Push big to local Repositories ...
End: 2021.11-16-14:01:10
End: 2021.11-16-15:23:42
big - Done!
Bereits aktuell.
[master 1d3c096] big auto-update
15 files changed, 500480 insertions(+), 2430 deletions(-)
delete mode 100644 pihole/blocklists/data/dead.list.doh
delete mode 100755 pihole/blocklists/data/dead.list.personal
delete mode 100644 pihole/blocklists/sources/white/dead.list.doh
delete mode 100644 pihole/blocklists/sources/white/dead.list.personal
[master d5b8d5ec] big auto-update
10 files changed, 115 insertions(+), 62 deletions(-)
Bereits aktuell.
[main 4c2bbff] big auto-update
2 files changed, 141 insertions(+), 64 deletions(-)
[main 0111db9] big auto-update
2 files changed, 34 insertions(+), 23 deletions(-)
Bereits aktuell.
[main 8920712] big auto-update
2 files changed, 100 insertions(+), 35 deletions(-)
[main 4fba5ff] big auto-update
2 files changed, 26 insertions(+), 21 deletions(-)
===========================================
Steven Black
@ -1446,7 +1413,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
Experimental ...
===========================================
Start: 2021.11-16-14:02:20
Start: 2021.11-16-15:24:52
### Compile experimental Blocklist ###
@ -1491,30 +1458,30 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 420956 | domains | local | online | changed | multi.domains.unique
2 | 27035 | domains | local | online | unchanged | personal.txt
1 | 420962 | domains | local | online | changed | multi.domains.unique
2 | 27036 | domains | local | online | unchanged | personal.txt
3 | 20760 | domains | local | online | unchanged | affiliatetracking.txt
4 | 43284 | domains | local | online | unchanged | fake.txt
5 | 369104 | domains | local | online | changed | threat-intelligence.txt
5 | 369283 | domains | local | online | changed | threat-intelligence.txt
6 | 1041172 | domains | http | online | unchanged | https://dbl.oisd.nl
# Build experimental Domainlist ...
Stats experimental:
** Source (raw): 1922311
== Source (unique): 1410374 (-511937)
-- White: 1408869 (-1505)
-- White(*): 1402393 (-6476)
-- Dead: 1279317 (-123076)
++ Block: 1279736 (+419)
-- Unblock: 1279735 (-1)
-- Unblock(*): 1279735 (-0)
++ FLD: 1297774 (+18039)
++ WWW: 1458643 (+160869)
** Source (raw): 1922497
== Source (unique): 1410598 (-511899)
-- White: 1409093 (-1505)
-- White(*): 1402617 (-6476)
-- Dead: 1279542 (-123075)
++ Block: 1279961 (+419)
-- Unblock: 1279960 (-1)
-- Unblock(*): 1279960 (-0)
++ FLD: 1298003 (+18043)
++ WWW: 1458930 (+160927)
1458643 unique Domains - Version 2021.1116.140220
MD5 Domains RAW: 59df8d1f84509d99917f290fc2751648
1458930 unique Domains - Version 2021.1116.152452
MD5 Domains RAW: e3b7da1a232ea094e3741f7a46435b30
# Convert experimental to Hostlist ...
@ -1537,20 +1504,20 @@ Prepare domain list for compiling ... done.
]
}
Start compiling experimental.adblock.raw
Original length is 1029977
Length after applying transformations is 1029977
The list was compressed from 1029980 to 566840
Final length of the list is 566846
Original length is 1030192
Length after applying transformations is 1030192
The list was compressed from 1030195 to 567028
Final length of the list is 567034
Writing output to /media/nas/git/rpi/pihole/blocklists/build/experimental/out/experimental.adblock
Finished compiling
End: 2021.11-16-14:23:37
End: 2021.11-16-15:46:06
experimental - Done!
Bereits aktuell.
[master 201efdf] experimental auto-update
9 files changed, 724 insertions(+), 2070 deletions(-)
[master 81d0ef5f] experimental auto-update
9 files changed, 17689 insertions(+), 16739 deletions(-)
Bereits aktuell.
Auf Branch main
@ -1569,7 +1536,7 @@ nichts zu committen, Arbeitsverzeichnis unverändert
Gallegonovato ...
===========================================
Start: 2021.11-16-14:24:16
Start: 2021.11-16-15:46:55
### Compile gallegonovato Blocklist ###
@ -1584,12 +1551,12 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 420956 | domains | local | online | unchanged | multi.domains.unique
1 | 420962 | domains | local | online | unchanged | multi.domains.unique
2 | 43284 | domains | local | online | unchanged | fake.txt
3 | 369104 | domains | local | online | unchanged | threat-intelligence.txt
4 | 770 | domains | local | online | changed | doh-vpn-proxy-bypass.txt
3 | 369283 | domains | local | online | unchanged | threat-intelligence.txt
4 | 770 | domains | local | online | unchanged | doh-vpn-proxy-bypass.txt
5 | 1041172 | domains | http | online | unchanged | https://dbl.oisd.nl
6 | 96610 | hosts | http | online | unchanged | https://raw.githubusercontent.com/badmojr/1Hosts/master/Lite/hosts.txt
6 | 98980 | hosts | http | online | changed | https://raw.githubusercontent.com/badmojr/1Hosts/master/Lite/hosts.txt
7 | 6 | domains | http | online | unchanged | https://raw.githubusercontent.com/badmojr/1Hosts/master/submit_here/include_for_all.txt
8 | 9922 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/adv/domains
9 | 1491 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/tracker/domains
@ -1611,23 +1578,23 @@ Initialize ...
Stats gallegonovato:
** Source (raw): 2358074
== Source (unique): 1456374 (-901700)
** Source (raw): 2360629
== Source (unique): 1457771 (-902858)
1456374 unique Domains - Version 2021.1116.142416
MD5 Domains RAW: 634e093449618d52c91c0e8523b6407a
1457771 unique Domains - Version 2021.1116.154655
MD5 Domains RAW: 2b8246fdd5605472cf784a4d4963c562
# Convert gallegonovato to Hostlist ...
# Attach header to gallegonovato Domainlist ...
End: 2021.11-16-14:26:06
End: 2021.11-16-15:48:18
gallegonovato - Done!
Bereits aktuell.
[master 5710727] @gallegonovato auto-update
7 files changed, 468 insertions(+), 1223 deletions(-)
[master 07fa86ee] @gallegonovato auto-update
7 files changed, 16196 insertions(+), 11015 deletions(-)
Bereits aktuell.
Auf Branch main