Commit Graph

10968 Commits

Author SHA1 Message Date
Sergey M․ 427cd050a3
[extractor/generic] Improve kaltura embed detection (Closes #9911) 2016-06-27 04:11:53 +07:00
Sergey M․ b0c200f1ec
[msn] Add test URL with non-alphanumeric characters 2016-06-26 22:03:36 +07:00
Sergey M․ 92747e664a
release 2016.06.26 2016-06-26 21:15:24 +07:00
Sergey M․ f1f336322d
[msn] Fix extraction (Closes #8960, closes #9542) 2016-06-26 21:10:05 +07:00
Sergey M․ bf8dd79045
[extractor/common] Fix sorting with custom field preference 2016-06-26 21:09:07 +07:00
TRox1972 c6781156aa
[MSN] add new extractor 2016-06-26 21:07:59 +07:00
Sergey M․ f484c5fa25
[vidbit] Improve (Closes #9759) 2016-06-26 16:59:28 +07:00
Sergey M․ 88d9f6c0c4
[utils] Add support for name list in _html_search_meta 2016-06-26 16:57:14 +07:00
TRox1972 3c9c088f9c
[Vidbit] Add new extractor 2016-06-26 16:52:52 +07:00
Yen Chi Hsuan fc3996bfe1
[iqiyi] Remove codes for debugging 2016-06-26 15:45:41 +08:00
Yen Chi Hsuan 5b6ad8630c
[iqiyi] Partially fix IqiyiIE
Use the HTML5 API. Only low-resolution formats available

Related: #9839

Thanks @zhangn1985 for the overall algorithm (soimort/you-get#1224)
2016-06-26 15:18:32 +08:00
Yen Chi Hsuan 30105f4ac0
[le] Move urshift() to utils.py 2016-06-26 15:17:26 +08:00
Yen Chi Hsuan 1143535d76
[utils] Add urshift()
Used in IqiyiIE and LeIE
2016-06-26 15:16:49 +08:00
Yen Chi Hsuan 7d52c052ef
[generic] Fix test_Generic_76
Broken: https://travis-ci.org/rg3/youtube-dl/jobs/140251658
2016-06-26 11:56:27 +08:00
stepshal a2406fce3c
Fix misspelling 2016-06-26 01:28:55 +07:00
Sergey M․ 3b34ab538c
[svtplay] Extend _VALID_URL (#9900) 2016-06-26 00:29:53 +07:00
Sergey M․ ac782306f1
[iqiyi] Mark broken 2016-06-26 00:25:41 +07:00
Sergey M․ ce96ed05f4
[polskieradio] Add test with video 2016-06-25 23:31:21 +07:00
Sergey M․ 0463b77a1f
[polskieradio] Improve extraction (Closes #9813) 2016-06-25 23:19:18 +07:00
Jakub Adam Wieczorek 2d185706ea
[polskieradio] Add support for Polskie Radio.
Polskie Radio is the main Polish state-funded radio broadcasting service.
2016-06-25 23:19:18 +07:00
Sergey M․ b72b44318c
[utils] Add strip_or_none 2016-06-25 23:19:18 +07:00
Sergey M․ 46f59e89ea
[utils] Add unified_timestamp 2016-06-25 23:19:18 +07:00
Sergey M․ b4241e308e
release 2016.06.25 2016-06-25 03:03:20 +07:00
Sergey M․ be49068d65
[youtube] Fix and skip some tests 2016-06-24 22:47:19 +07:00
Sergey M․ 525cedb971
[youtube] Relax URL expansion in description 2016-06-24 22:37:13 +07:00
Sergey M․ de3c7fe0d4
[youtube] Fix 141 format tests 2016-06-24 22:27:55 +07:00
Yen Chi Hsuan 896cc72750
[mixcloud] View count and like count may be absent
Closes #9874
2016-06-24 17:26:12 +08:00
Yen Chi Hsuan c1ff6e1ad0
[vimeo:review] Fix extraction for password-protected videos
Closes #9853
2016-06-24 16:48:37 +08:00
Remita Amine fee70322d7 [appletrailers] correct thumbnail fallback 2016-06-23 19:03:34 +01:00
Remita Amine 8065d6c55f [dcn] extend _VALID_URL for awaan.ae and extract all available formats 2016-06-23 17:22:15 +01:00
Remita Amine 494172d2e5 [appletrailers] extract info from an alternative source if available(closes #8422)(closes #8422) 2016-06-23 15:49:42 +01:00
Remita Amine 6e3c2047f8 [tvp] extract all formats and detect erros 2016-06-23 04:36:16 +01:00
Sergey M․ 011bd3221b
release 2016.06.23.1 2016-06-23 09:42:56 +07:00
Sergey M․ b46eabecd3
[jsinterp] Relax JS function regex (Closes #9863) 2016-06-23 09:41:34 +07:00
Remita Amine 0437307a41 [nbc:nbcnews] improve extraction and add msnbc to the extractor 2016-06-23 01:36:19 +01:00
Remita Amine 22b7ac13ef [tf1] fix wat id extraction(closes #9862) 2016-06-23 00:14:34 +01:00
Sergey M․ 96f88e91b7
release 2016.06.23 2016-06-23 04:29:34 +07:00
Sergey M․ 3331a4644d
[vk] Remove unused import 2016-06-23 04:27:10 +07:00
Sergey M․ adf1921dc1
[xnxx] Improve _VALID_URL (Closes #9858) 2016-06-23 04:26:49 +07:00
Sergey M․ 97674f0419
[xnxx] Replace test 2016-06-23 04:24:00 +07:00
rr- 73843ae8ac
[xnxx] fix url regex
The pattern has changed from "video123412" to "video-o8xa19".
The changes maintain backwards compatibility with old-style URLs.
2016-06-23 04:19:55 +07:00
Sergey M․ f2bb8c036a
[vk] Modernize 2016-06-23 04:18:43 +07:00
Sergey M․ 75ca6bcee2
[vk] Workaround buggy new.vk.com Set-Cookie headers 2016-06-23 04:17:13 +07:00
Sergey M․ 089657ed1f
[vimeo:album] Add paged example URL 2016-06-23 02:00:03 +07:00
Sergey M․ b5eab86c24
[vimeo:album] Impove _VALID_URL 2016-06-23 01:56:58 +07:00
Sergey M․ c8e3e0974b
[vimeo:channel] Improve playlist extraction 2016-06-23 01:28:36 +07:00
Purdea Andrei dfc8f46e1c
[vimeo:channel] Add video id to url_result
This will allow us to decide much faster that we don't want an already archived video,
and will allow having to download webpages for each video that has already been downloaded,
thus significantly speeding up the archival of channels that have no new content.
2016-06-23 01:26:27 +07:00
Sergey M․ c143ddce5d
[vimeo] Override original URL only when necessary 2016-06-23 00:51:36 +07:00
TRox1972 6ae938b295
[Vine] Extract view count 2016-06-22 23:57:35 +07:00
Sergey M․ cf40fdf5c1
release 2016.06.22 2016-06-22 23:43:24 +07:00
Sergey M․ 23bdae0955
[svt] Various improvements
+ [svt:play] Add fallback path looking for video id and fix extraction for oppetarkiv
* [svt:base] Detect geo restriction
* [svt:base] Extract series related metadata
2016-06-22 23:36:07 +07:00
Shai Coleman ca74c90bf5 Fix issue downloading facebook videos
youtube-dl expects the format items to be returned as a list,
but when there's only one item Facebook returns a dict instead,
this wraps the dict in a list if necessary
2016-06-22 12:52:15 +01:00
Sergey M․ 7cfc1e2a10
[gametrailers] Remove extractor
gametrailers closed (see http://www.polygon.com/2016/2/8/10944452/gametrailers-shuts-down-after-13-year-run)
2016-06-21 22:31:41 +07:00
Remita Amine 1ac5705f62 [gamespot] extract all formats 2016-06-21 13:37:57 +01:00
Yen Chi Hsuan e4f90ea0a7
[svt] Fix extraction for SVTPlay (closes #9809) 2016-06-21 17:55:53 +08:00
Sergey M․ cdfc187cd5
[cbs] Remove unused import 2016-06-20 22:40:33 +07:00
Sergey M․ feef925f49
[streamcloud] Capture error message (#9840) 2016-06-20 22:40:22 +07:00
Sergey M․ 19e2d1cdea
release 2016.06.20 2016-06-20 20:50:01 +07:00
Sergey M․ 8369a4fe76
[downloader/hls] Simplify and carry long lines 2016-06-20 21:55:17 +07:00
Philipp Hagemeister 1f749b6658 Revert "[jsinterp] Avoid double key lookup for setting new key"
This reverts commit 7c05097633.
2016-06-20 13:29:13 +02:00
Remita Amine 819707920a [cbs] fix _VALID_URL 2016-06-19 23:55:19 +01:00
Remita Amine 43518503a6 [cbs,cbsnews,cbssports] reduce requests while extracting all formats 2016-06-19 23:40:00 +01:00
Remita Amine 5839d556e4 [theplatform] reduce requests for theplatform feed info extraction 2016-06-19 23:37:05 +01:00
Yen Chi Hsuan 6c83e583b3
[radiojavan] PEP8
E275 is added in pycodestyle 2.6

See https://github.com/PyCQA/pycodestyle/pull/491
2016-06-19 13:32:08 +08:00
Yen Chi Hsuan 6aeb64b673 Merge pull request #8201 from remitamine/hls-aes
[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader
2016-06-19 13:25:08 +08:00
Remita Amine 6cd64b6806 [foxsports] extract http formats 2016-06-19 05:45:48 +01:00
remitamine e154c65128 [downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader 2016-06-19 01:01:40 +01:00
Sergey M․ a50fd6e026
release 2016.06.19.1 2016-06-19 03:57:14 +07:00
Sergey M․ 6a55bb66ee
[vimeo] Fix rented videos (Closes #9830) 2016-06-19 03:56:01 +07:00
Lucas Moura 7c05097633
[jsinterp] Avoid double key lookup for setting new key
In order to add a new key to both __objects and __functions dicts on jsinterp.py, it is
necessary to first verify if a key was present and if not, create the key and
assign it to a value.

However, this can be done with a single step using dict setdefault method.
2016-06-19 03:29:45 +07:00
Sergey M․ 589568789f
release 2016.06.19 2016-06-19 02:30:29 +07:00
Sergey M․ 7577d849a6
[r7] Fix extraction and add support for articles (Closes #9826) 2016-06-19 02:25:34 +07:00
Sergey M․ cb23192bc4
[closertotruth] Update and improve (Closes #8680) 2016-06-19 00:35:29 +07:00
Steven Gosseling 41c1023300
[closertotruth] Add extractor
Removed print statement from code.

Replaced two regex searches with the corret ones.

Removed some unnecessary semicolumns

fixed title extraction

refactored everything to search_regex

processed comments on commit 5650b0d, fixed feedback from flake8

Improved regexes and returns info dict now.

Added support for closertotruth interview URL

Added support for episodes page
2016-06-18 23:19:56 +07:00
Sergey M․ 90b6288cce
[arte:+7] Simplify _VALID_URL 2016-06-18 22:23:48 +07:00
Sergey M․ d7c6c656c5
[arte:+7] Expand _VALID_URL (Closes #9820) 2016-06-18 21:42:17 +07:00
Yen Chi Hsuan b0b128049a
[extractors] Update references to sportschau (#9799) 2016-06-18 13:43:47 +08:00
Yen Chi Hsuan e8f13f2637
[sportschau.de] Fix extraction and moved to its own file (closes #9799) 2016-06-18 13:42:58 +08:00
Yen Chi Hsuan b5aad37f6b
[ard] Remove SportschauIE, which is now based on WDR (#9799) 2016-06-18 13:42:39 +08:00
Yen Chi Hsuan 6d0d4fc26d
[wdr] Add WDRBaseIE, for Sportschau (#9799) 2016-06-18 13:40:55 +08:00
Yen Chi Hsuan 0278aa443f
[br] Skip invalid tests 2016-06-18 12:53:48 +08:00
Yen Chi Hsuan 1f35745758
[azubu] Don't fail on optional fields 2016-06-18 12:39:08 +08:00
Yen Chi Hsuan 573c35272f
[bbc] Skip a geo-restricted test case 2016-06-18 12:35:55 +08:00
Yen Chi Hsuan 09e3f91e40
[arte] Update _TESTS and fix for pages with multiple YouTube videos
Some tests are from #6895 and #6613
2016-06-18 12:34:58 +08:00
Yen Chi Hsuan 1b6cf16be7
[aftonbladet] Fix extraction 2016-06-18 12:27:39 +08:00
Yen Chi Hsuan 26264cb056
[adobetv] Use embedded data in the webpage
Sometimes the HTML webpage is returned even with '?format=json'
2016-06-18 12:21:40 +08:00
Yen Chi Hsuan a72df5f36f
[mtvservices] Fix ext for RTMP streams 2016-06-18 12:19:06 +08:00
Yen Chi Hsuan c878e635de
[bet] Moved to MTVServices 2016-06-18 12:17:24 +08:00
Sergey M․ 0f47cc2e92
release 2016.06.18.1 2016-06-18 06:20:34 +07:00
Sergey M․ 5fc2757682
release 2016.06.18 2016-06-18 06:00:05 +07:00
Sergey M․ e3944c2621
[pornhd] Add working test 2016-06-18 05:50:17 +07:00
Sergey M․ 667d96480b
[pornhd] Detect removed videos and modernize 2016-06-18 05:42:20 +07:00
Sergey M․ e6fe993c31
[pornhd] Improve formats extraction 2016-06-18 05:37:53 +07:00
Sergey M․ d0d93f76ea
[pornhd] Fix metadata extraction 2016-06-18 05:30:46 +07:00
Sergey M․ 20a6a154fe
[mtv] Use compat_xpath and fix FutureWarning 2016-06-18 04:46:26 +07:00
Sergey M․ f011876076
[nickde] Add extractor (Closes #9778) 2016-06-18 04:40:48 +07:00
Sergey M․ 6929569403
[mitele] Extract series metadata and make title more robust (Closes #9758) 2016-06-18 04:06:19 +07:00
Sergey M․ eb451890da
[carambatv] Add extractor (Closes #9815) 2016-06-18 03:04:14 +07:00
Sergey M․ ded7511a70
[bbccouk] Add support for playlists (Closes #9812) 2016-06-17 23:42:52 +07:00
Sergey M․ d2161cade5
release 2016.06.16 2016-06-16 22:40:55 +07:00
Sergey M․ 27e5fa8198
[cda] Fix extraction (Closes #9803) 2016-06-16 22:33:12 +07:00
Yen Chi Hsuan efbd1eb51a
[wimp] Fix extraction and update _TESTS 2016-06-16 12:27:21 +08:00
Yen Chi Hsuan 369ff75081
[jwplatform] Improved JWPlayer support 2016-06-16 12:26:45 +08:00
Yen Chi Hsuan 47212f7bcb
[utils] Don't transform numbers not starting with a zero
Fix test_Viidea and maybe others
2016-06-16 11:00:54 +08:00
Sergey M․ 4c93ee8d14
[imdb] Improve _VALID_URL (Closes #9788) 2016-06-15 22:34:55 +07:00
Yen Chi Hsuan 8bc4dbb1af
[wrzuta.pl] Detect error and update _TESTS 2016-06-14 11:14:59 +08:00
Sergey M․ 6c3760292c
[pornhub] Improve title extraction (Closes #9777) 2016-06-14 04:57:59 +07:00
Sergey M․ ff4af6ec59
[lynda] Remove superfluous _NETRC_MACHINE 2016-06-14 02:49:33 +07:00
Sergey M․ d01fb21d4c release 2016.06.14 2016-06-14 02:19:42 +07:00
Sergey M․ 1759672eed
[wrzuta:playlist] Improve and simplify (Closes #9341) 2016-06-14 02:13:54 +07:00
venth fea55ef4a9
[wrzuta.pl:playlist] Added playlist extraction from wrzuta.pl 2016-06-14 02:10:48 +07:00
Sergey M․ 16b6bd01d2
[rockstargames] Improve and add Youtube fallback (Closes #9737) 2016-06-14 01:11:24 +07:00
Dracony 14d0f4e0f3
Added extractor for rockstargames.com 2016-06-14 01:09:35 +07:00
Sergey M․ 778f969447
[twitch:clips] Add extractor (Closes #9767) 2016-06-14 00:06:31 +07:00
Sergey M․ 33b72ce64e
[xfileshare] Improve removed videos detection 2016-06-13 01:19:54 +07:00
Sergey M․ cf2bf840ba
[xfileshare] Fix test 2016-06-13 01:11:14 +07:00
Sergey M․ bccdac6874
[xfileshare:xvidstage] Add support for videos with packed codes (Closes #4335) 2016-06-13 01:11:04 +07:00
Sergey M․ e69f9f5d68
[downloader/external] Decode error string before writing to stderr 2016-06-12 16:45:07 +07:00
Sergey M․ 77a9a9c295 release 2016.06.12 2016-06-12 12:06:48 +07:00
Sergey M․ 84dcd1c4e4
[streamcloud] Detect removed videos (Closes #3768) 2016-06-12 11:08:39 +07:00
Sergey M․ 971e3b7520
[nrk:skole] Fix extraction 2016-06-12 07:20:37 +07:00
Sergey M․ 4e79011729
[nrktv] Fix tests 2016-06-12 06:57:04 +07:00
Sergey M․ 98960c911c
[instagram] Extract metadata from JSON 2016-06-12 06:06:04 +07:00
Sergey M․ 329ca3bef6
[utils] Add try_get
To reduce boilerplate when accessing JSON
2016-06-12 06:05:34 +07:00
Sergey M․ 2c3322e36e
[youporn] Fix metadata extraction 2016-06-12 04:49:37 +07:00
Sergey M․ 80ae228b34
[matchtv] Modernize 2016-06-12 01:57:23 +07:00
Yen Chi Hsuan 6d28c408cf
[viki] Do not use a fallback language for title in the first try
In test_Viki_3, 'titles' gives a Hebrew title.
2016-06-11 23:00:44 +08:00
Yen Chi Hsuan c83b35d4aa
[viki] Update _TESTS 2016-06-11 22:39:13 +08:00
Yen Chi Hsuan 94e5d6aedb
[viki] Skip a geo-restricted test 2016-06-11 21:49:01 +08:00
Yen Chi Hsuan 531a74968c
[vimeo] Fix extraction for VimeoReview videos 2016-06-11 21:35:08 +08:00
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
2016-06-11 18:39:58 +08:00
Yen Chi Hsuan 856150d056
[telewebion] Add new extractor (closes #5135) 2016-06-11 18:39:58 +08:00
Paul Henning 15d106787e [utils] Change Firefox 44 to 47
See commit title.
2016-06-11 05:36:31 -04:00
Yen Chi Hsuan 7aab3696dd
[kuwo] Update _TESTS 2016-06-11 15:37:04 +08:00
Yen Chi Hsuan 47787efa2b
[leeco] Recognize Le Sports URLs (fixes #9750) 2016-06-11 13:14:41 +08:00
Sergey M․ 4a420119a6 release 2016.06.11.3 2016-06-11 08:34:30 +07:00
Sergey M․ 33751818d3 release 2016.06.11.2 2016-06-11 08:28:51 +07:00
Sergey M․ fe458b6596
[limelight] Extract ttml subtitles (Closes #9739) 2016-06-11 05:57:27 +07:00
Sergey M․ 21ac1a8ac3
[limelight] Fix typo 2016-06-11 05:52:50 +07:00
Sergey M․ 79027c0ea0
[limelight] Improve _VALID_URLs 2016-06-11 05:40:02 +07:00
Sergey M․ 4cad2929cd
[limelight] Fix _VALID_URLs 2016-06-11 05:30:44 +07:00
Sergey M․ 62666af99f
[indavideo] Fix formats' height (Closes #9744) 2016-06-11 05:13:05 +07:00
Sergey M․ 6626c214e1 release 2016.06.11.1 2016-06-11 03:00:08 +07:00
Sergey M․ d845622b2e release 2016.06.11 2016-06-11 02:41:48 +07:00
Sergey M 1058f56e96 Merge pull request #9747 from TRox1972/lynda
[Lynda] Extract course description
2016-06-11 02:34:58 +07:00
TRox1972 0434358823 [Lynda] Extract course description 2016-06-10 19:17:58 +02:00
Sergey M․ 3841256c2c
[lynda] Skip login if already logged in 2016-06-10 23:01:52 +07:00
Sergey M․ bdf16f8140
[lynda] Add support for new authentication (Closes #9740) 2016-06-10 22:40:18 +07:00
Yen Chi Hsuan 836ab0c554
[compat] Import html5 entities correctly 2016-06-10 18:12:57 +08:00
Yen Chi Hsuan 6c0376fe4f
[dw] Skip an invalid test
DW documentaries only last for one or two weeks. See #9475
2016-06-10 16:53:40 +08:00