update experimenal

This commit is contained in:
Zelo72 2021-11-22 21:53:31 +01:00
parent ba6c737d02
commit 8a9e477493
17 changed files with 182420 additions and 23001 deletions

View File

@ -1,4 +1,4 @@
#extendWWWFLD
extendWWWFLD
hosts
noheader
adblock

View File

@ -1,2 +1,3 @@
../../data/black.list.block
../../data/rules.list.block
#../d3host/out/d3host.domains

View File

@ -2,15 +2,15 @@
# Zelo72's sources #
##############################
# ../multi/out/multi.domains.unique
../../big.txt
../../multi.txt
../../light.txt
../../personal.txt
../multi/out/multi.domains.unique
#../../big.txt
#../../multi.txt
#../../light.txt
#../../personal.txt
../../affiliatetracking.txt
../../fake.txt
../../threat-intelligence.txt
# https://dbl.oisd.nl
https://dbl.oisd.nl
##############################
# Test sources #

View File

@ -1 +1,6 @@
../../data/exclude.list
../../data/white.list
../../data/white.list.bmj
../../data/white.list.sw
../../data/white.list.nt
../../data/white.list.adguard
../../data/white.list.referral

View File

@ -1,3 +0,0 @@
../../data/black.list.block
../../data/rules.list.block
../d3host/out/d3host.domains

View File

@ -1,103 +0,0 @@
##############################
# Zelo72's sources #
##############################
! https://adaway.org/hosts.txt
! https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
! https://hostfiles.frogeye.fr/firstparty-trackers-hosts.txt
! https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext
! https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.2o7Net/hosts
! https://raw.githubusercontent.com/Laicure/hosts/master/shithosts
! https://raw.githubusercontent.com/StevenBlack/hosts/master/hosts
! https://raw.githubusercontent.com/badmojr/1Hosts/master/Lite/hosts.txt
! https://raw.githubusercontent.com/bigdargon/hostsVN/master/hosts
! https://raw.githubusercontent.com/d3ward/toolz/master/src/d3host.txt
! https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
! https://raw.githubusercontent.com/infinitytec/blocklists/master/ads-and-trackers.txt
! https://raw.githubusercontent.com/jdlingyu/ad-wars/master/hosts
! https://raw.githubusercontent.com/shreyasminocha/shady-hosts/main/hosts
! https://raw.githubusercontent.com/tiuxo/hosts/master/ads
! https://raw.githubusercontent.com/velesila/yhosts/master/hosts
! https://someonewhocares.org/hosts/
! https://threatfox.abuse.ch/downloads/hostfile
! https://urlhaus.abuse.ch/downloads/hostfile/
! https://winhelp2002.mvps.org/hosts.txt
& https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
& https://easylist-downloads.adblockplus.org/Liste_AR.txt
& https://easylist-downloads.adblockplus.org/advblock.txt
& https://easylist-downloads.adblockplus.org/easylistchina.txt
& https://easylist-downloads.adblockplus.org/easylistdutch.txt
& https://easylist-downloads.adblockplus.org/easylistgermany.txt
& https://easylist-downloads.adblockplus.org/easylistitaly.txt
& https://easylist-downloads.adblockplus.org/easylistpolish.txt
& https://easylist-downloads.adblockplus.org/easylistportuguese.txt
& https://easylist-downloads.adblockplus.org/easylistspanish.txt
& https://easylist-downloads.adblockplus.org/indianlist.txt
& https://easylist-downloads.adblockplus.org/koreanlist.txt
& https://easylist-downloads.adblockplus.org/liste_fr.txt
& https://easylist.to/easylist/easylist.txt
& https://easylist.to/easylist/easyprivacy.txt
& https://easylist.to/easylist/fanboy-social.txt
& https://notabug.org/latvian-list/adblock-latvian/raw/master/lists/latvian-list.txt
& https://raw.github.com/tomasko126/easylistczechandslovak/master/filters.txt
& https://raw.githubusercontent.com/ABPindo/indonesianadblockrules/master/subscriptions/abpindo.txt
& https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/rules.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_11_Mobile/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_14_Annoyances/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_16_French/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_1_Russian/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_224_Chinese/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_2_English/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_3_Spyware/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_4_Social/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_6_German/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_7_Japanese/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_8_Dutch/filter.txt
& https://raw.githubusercontent.com/AdguardTeam/FiltersRegistry/master/filters/filter_9_Spanish/filter.txt
& https://raw.githubusercontent.com/EasyList-Lithuania/easylist_lithuania/master/easylistlithuania.txt
& https://raw.githubusercontent.com/Kees1958/W3C_annual_most_used_survey_blocklist/master/EU_US%2Bmost_used_ad_and_tracking_networks
& https://raw.githubusercontent.com/Kees1958/W3C_annual_most_used_survey_blocklist/master/TOP_EU_US_Ads_Trackers_ABP
& https://raw.githubusercontent.com/abpvn/abpvn/master/filter/abpvn.txt
& https://raw.githubusercontent.com/easylist-thailand/easylist-thailand/master/subscription/easylist-thailand.txt
& https://raw.githubusercontent.com/easylist/EasyListHebrew/master/EasyListHebrew.txt
& https://raw.githubusercontent.com/easylist/easylist/master/easyprivacy/easyprivacy_specific_cname.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/badware.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/filters-2020.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/filters-2021.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/filters.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/privacy.txt
& https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/resource-abuse.txt
& https://secure.fanboy.co.nz/fanboy-annoyance.txt
& https://secure.fanboy.co.nz/fanboy-cookiemonster.txt
& https://stanev.org/abp/adblock_bg.txt
& https://www.void.gr/kargig/void-gr-filters.txt
& https://www.zoso.ro/pages/rolist.txt
https://dbl.oisd.nl
https://dbl.oisd.nl/basic/
https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-blocklist.txt
https://phishing.army/download/phishing_army_blocklist.txt
https://raw.githubusercontent.com/AdguardTeam/cname-trackers/master/combined_disguised_trackers_justdomains.txt
https://raw.githubusercontent.com/AdroitAdorKhan/antipopads-re/master/formats/domains.txt
https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
https://raw.githubusercontent.com/Zelo72/rpi/master/pihole/blocklists/fake.txt
https://raw.githubusercontent.com/Zelo72/rpi/master/pihole/blocklists/personal.txt
https://raw.githubusercontent.com/Zelo72/rpi/master/pihole/blocklists/threat-intelligence.txt
https://raw.githubusercontent.com/adguardteam/cname-trackers/master/combined_disguised_trackers_justdomains.txt
https://raw.githubusercontent.com/badmojr/1Hosts/master/submit_here/include_for_all.txt
https://raw.githubusercontent.com/cbuijs/shallalist/master/adv/domains
https://raw.githubusercontent.com/cbuijs/shallalist/master/tracker/domains
https://raw.githubusercontent.com/cbuijs/ut1/master/ads/domains
https://raw.githubusercontent.com/jkrejcha/AdmiraList/master/AdmiraList.txt
https://raw.githubusercontent.com/nextdns/cname-cloaking-blocklist/master/domains
https://raw.githubusercontent.com/nextdns/metadata/master/privacy/affiliate-tracking-domains
https://raw.githubusercontent.com/nextdns/metadata/master/security/parked-domains-cname
https://raw.githubusercontent.com/notracking/hosts-blocklists/master/dnscrypt-proxy/dnscrypt-proxy.blacklist.txt
https://raw.githubusercontent.com/ookangzheng/blahdns/master/hosts/blacklist.txt
https://v.firebog.net/hosts/Admiral.txt
https://v.firebog.net/hosts/static/w3kbl.txt
##############################
# Test sources #
##############################
https://raw.githubusercontent.com/Zelo72/rpi/master/pihole/blocklists/doh-vpn-proxy-bypass.txt

View File

@ -1 +0,0 @@
../../data/white.list.important

View File

@ -1,7 +0,0 @@
../../data/exclude.list
#../../data/white.list
#../../data/white.list.bmj
#../../data/white.list.sw
#../../data/white.list.nt
#../../data/white.list.adguard
#../../data/white.list.referral

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

View File

@ -1,7 +1,5 @@
1. domains - ../../big.txt
2. domains - ../../multi.txt
3. domains - ../../light.txt
4. domains - ../../personal.txt
5. domains - ../../affiliatetracking.txt
6. domains - ../../fake.txt
7. domains - ../../threat-intelligence.txt
1. domains - ../multi/out/multi.domains.unique
2. domains - ../../affiliatetracking.txt
3. domains - ../../fake.txt
4. domains - ../../threat-intelligence.txt
5. domains - https://dbl.oisd.nl

File diff suppressed because it is too large Load Diff

View File

@ -2,20 +2,34 @@
Config:
** Build - 3:
** Build - 4:
extendWWWFLD
hosts
noheader
adblock
+ Prioritized Block - 246:
experimental.block
++ Prioritized Blocklists - 2:
../../data/black.list.block
../../data/rules.list.block
-- Whitelists - 1:
-- Deadlists - 1:
../../data/exclude.list
../../data/dead.list
-- Whitelists - 6:
../../data/white.list
../../data/white.list.bmj
../../data/white.list.sw
../../data/white.list.nt
../../data/white.list.adguard
../../data/white.list.referral
-- Unblocklists - 1:
@ -26,28 +40,29 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 1233514 | domains | local | online | changed | big.txt
2 | 395742 | domains | local | online | unchanged | multi.txt
3 | 130527 | domains | local | online | changed | light.txt
4 | 14966 | domains | local | online | unchanged | personal.txt
5 | 14096 | domains | local | online | changed | affiliatetracking.txt
6 | 43915 | domains | local | online | unchanged | fake.txt
7 | 373962 | domains | local | online | changed | threat-intelligence.txt
1 | 382508 | domains | local | online | unchanged | multi.domains.unique
2 | 14096 | domains | local | online | unchanged | affiliatetracking.txt
3 | 43915 | domains | local | online | unchanged | fake.txt
4 | 373962 | domains | local | online | unchanged | threat-intelligence.txt
5 | 1031871 | domains | http | online | unchanged | https://dbl.oisd.nl
# Build experimental Domainlist ...
Stats experimental:
** Source (raw): 2206722
== Source (unique): 1361338 (-845384)
-- White: 1359887 (-1451)
-- White(*): 1359586 (-301)
++ Block: 1359637 (+51)
-- Unblock: 1359636 (-1)
-- Unblock(*): 1359636 (-0)
** Source (raw): 1846352
== Source (unique): 1381245 (-465107)
-- White: 1379692 (-1553)
-- White(*): 1373798 (-5894)
-- Dead: 1262636 (-111162)
++ Block: 1263046 (+410)
-- Unblock: 1263045 (-1)
-- Unblock(*): 1263045 (-0)
++ FLD: 1281017 (+17972)
++ WWW: 1448300 (+167283)
1359636 unique Domains - Version 2021.1122.120041
MD5 Domains RAW: eba2deceaa0fadb8706ddef80220a948
1448300 unique Domains - Version 2021.1122.205412
MD5 Domains RAW: e63f877ff7f57cdbd47cccbe41ffadf0
# Convert experimental to Hostlist ...
@ -70,12 +85,12 @@ Prepare domain list for compiling ... done.
]
}
Start compiling experimental.adblock.raw
Original length is 1012417
Length after applying transformations is 1012417
The list was compressed from 1012420 to 580341
Final length of the list is 580347
Original length is 1018013
Length after applying transformations is 1018013
The list was compressed from 1018016 to 562527
Final length of the list is 562533
Writing output to /media/nas/git/rpi/pihole/blocklists/build/experimental/out/experimental.adblock
Finished compiling
End: 2021.11-22-12:20:21
End: 2021.11-22-21:15:16

View File

@ -1 +1 @@
eba2deceaa0fadb8706ddef80220a948
e63f877ff7f57cdbd47cccbe41ffadf0

View File

@ -1 +1 @@
eba2deceaa0fadb8706ddef80220a948
e63f877ff7f57cdbd47cccbe41ffadf0