14bf3fb05b
Add ability to know the locale of an audio stream
...
Getting audio tracks locales by parsing their ID or their label, should not be
done by clients, but by the extractor.
This commit adds the ability to store the Locale of an AudioStream, which is
used to compare similar AudioStreams (in the equalStats method).
2023-02-26 19:06:16 +01:00
f92426560c
Add descriptive audio properties
...
Also improve AudioStream's audio language documentation
2023-02-26 19:06:16 +01:00
a63f289667
[YouTube] Update mocks of YoutubeCommentsExtractorTest.FormattingTest
2023-02-26 18:50:07 +01:00
9483dcd9fa
[YouTube] Update mocks of YoutubeCommentsExtractorTest.RepliesTest
2023-02-26 18:43:36 +01:00
1556adbb2d
[YouTube] Fix hashtags links extraction and escape text in attribute descriptions + HTML links
...
webCommandMetadata object is contained inside a commandMetadata one, so it is
not accessible from the root of the navigationEndpoint object.
The corresponding statement has been moved at the bottom of the specific
endpoints parsing, as the webCommandMetadata object is present almost
everywhere, otherwise URLs of some endpoints would have be changed, such as
uploader URLs (from channel IDs to handles).
As no ParsingException is now thrown by getUrlFromNavigationEndpoint, and so by
getTextFromObject, getUrlFromObject and getTextAtKey, the methods which were
catching ParsingExceptions thrown by these methods had to be updated.
URLs got in the HTML version of getTextFromObject are now escaped properly to
provide valid HTML to clients. This has been also done for attribute
descriptions, with the description text for this type of descriptions.
As YouTube descriptions are in HTML format (except for the fallback on the JSON
player response, which is plain text and only happens when there is no visual
metadata or a breaking change), all URLs returned are escaped, so tests which
are testing presence of URLs with escaped characters had to be updated (it was
only the case for YoutubeStreamExtractorDefaultTest.DescriptionTestUnboxing).
2023-02-26 18:43:36 +01:00
99ab9777ad
Release 0.22.5
2023-02-26 16:33:25 +01:00
39c2e1fda0
Merge pull request #1028 from TeamNewPipe/dependabot/gradle/org.jsoup-jsoup-1.15.4
...
Bump org.jsoup:jsoup from 1.15.3 to 1.15.4
2023-02-26 16:27:31 +01:00
f7a7a236fb
[Bandcamp] Show comments as disabled on radio streams
2023-02-23 18:42:43 +01:00
f5599ff08d
Bump org.jsoup:jsoup from 1.15.3 to 1.15.4
...
Bumps [org.jsoup:jsoup](https://github.com/jhy/jsoup ) from 1.15.3 to 1.15.4.
- [Release notes](https://github.com/jhy/jsoup/releases )
- [Changelog](https://github.com/jhy/jsoup/blob/master/CHANGES )
- [Commits](https://github.com/jhy/jsoup/compare/jsoup-1.15.3...jsoup-1.15.4 )
---
updated-dependencies:
- dependency-name: org.jsoup:jsoup
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-02-20 10:05:26 +00:00
7e793c11ae
Empty commit to make JitPack happy
...
The build for e920ab3f5f
2023-02-08 22:35:26 +01:00
e920ab3f5f
Merge pull request #1021 from TeamNewPipe/fix/yt-comment-text-hashtag
...
[YouTube] Fix getting the comment text if the comment contains a hashtag
2023-01-29 21:47:59 +01:00
3f7df9536e
[YouTube] Fix getting the comment text if the comment contains a hashtag
2023-01-29 20:33:51 +01:00
999fb7f812
Merge pull request #1024 from AudricV/snd_fix-tracks-like-count
...
[SoundCloud] Fix extraction of tracks like count
2023-01-29 10:52:54 +01:00
3519d4c367
Merge pull request #1015 from AudricV/yt_fix-channel-id-rss-feeds
...
[YouTube] Fix channel ID extraction of YouTube channels RSS feeds
2023-01-29 10:41:38 +01:00
9aca710e86
Merge pull request #1013 from Stypox/fix-music-mixes
...
[YouTube] Now music mixes can be treated as normal mixes
2023-01-29 09:48:51 +01:00
76eeabac45
Merge pull request #1020 from TeamNewPipe/fix/yt-subscriber-count
...
[YouTube] Fix NPE in search when getting channel items without subscriber count
2023-01-29 09:44:22 +01:00
676622f6df
[SoundCloud] Fix expectedLikeCountAtLeast tests of SoundcloudStreamExtractorTest test classes
...
As like count is now returned by the extractor, we need to assert a positive
minimum like count, which is close to the actual value, in order to avoid test
failures due to lower like counts than the ones excepted.
2023-01-29 01:08:02 +01:00
2a24d407d5
[SoundCloud] Fix extraction of tracks like count
...
SoundCloud is using likes_count to return the like count of a track, like it
was the case before they switched to favoritings_count.
2023-01-29 01:00:49 +01:00
0e4e6a9bac
Merge pull request #1022 from AudricV/yt_support-live-urls
...
[YouTube] Support live URLs
2023-01-28 21:52:26 +01:00
ba24976e41
[YouTube] Add live URLs test and do minor improvements to YoutubeStreamLinkHandlerFactoryTest
...
- Remove unused imports;
- Replace wildcard imports by single class imports;
- Suppress "HTTP links are not secured" warnings from IDEA IDEs;
- Replace removed video jZViOEv90dI by an existing video, 9Dpqou5cI08 (the
corresponding test has been of course renamed).
2023-01-28 19:36:21 +01:00
57f850bc2d
[YouTube] Support live URLs and do minor improvements to YoutubeStreamLinkHandlerFactory
...
- Move license header at the top;
- Use an unmodifiable set for the subpaths instead of a modifiable list;
- Add missing Nonnull and Nullable annotations;
- Improve exception messages.
2023-01-28 19:36:20 +01:00
1f4ed9dce9
[YouTube] Fix channel ID extraction of YouTube channel RSS feeds
...
The yt:channelId element doesn't provide the channel ID anymore and is empty,
like the id element, so we need now to extract it from the channel URL provided
in two elements: author -> uri and feed -> link.
Also avoid a NullPointerException in getUrl and getName methods.
2023-01-28 11:53:33 +01:00
c589a2c1a2
Merge pull request #1014 from TeamNewPipe/fix/yt-comments
...
[YouTube] Fix getting next comments pages
2023-01-27 11:14:55 +01:00
c2b36fd405
Merge pull request #1016 from lonewolf2208/bug-fix
...
[YouTube] Remove topStandaloneBadge check for view count of stream items
2023-01-25 08:30:36 +01:00
72573932cf
[YouTube] Fix NPE in search when getting channel items without subscriber count
2023-01-24 23:03:45 +01:00
f50b7275af
[YouTube] Fix getting next comments pages
2023-01-24 22:39:08 +01:00
9bdad40b06
Removed topStandaloneBadge
2023-01-20 02:41:21 +05:30
5945057227
[YouTube] Add music mix test
2023-01-15 23:30:30 +01:00
7293991832
[YouTube] Now music mixes can be treated as normal mixes
...
Using a playlist extractor on them would result in "Unviewable playlist" errors
2023-01-15 23:28:59 +01:00
ff94e9f30b
Merge pull request #1009 from TeamNewPipe/dependabot/gradle/com.google.code.gson-gson-2.10.1
...
Bump gson from 2.10 to 2.10.1
2023-01-11 15:35:36 +01:00
c1040bccac
Merge pull request #794 from FireMasterK/comments-count
...
[YouTube] Add support to extract total comment count
2023-01-11 15:32:19 +01:00
6ccc43e57e
Merge pull request #1010 from TeamNewPipe/dependabot/gradle/org.junit-junit-bom-5.9.2
...
Bump junit-bom from 5.9.1 to 5.9.2
2023-01-11 13:19:33 +01:00
1bc44cb949
Bump junit-bom from 5.9.1 to 5.9.2
...
Bumps [junit-bom](https://github.com/junit-team/junit5 ) from 5.9.1 to 5.9.2.
- [Release notes](https://github.com/junit-team/junit5/releases )
- [Commits](https://github.com/junit-team/junit5/compare/r5.9.1...r5.9.2 )
---
updated-dependencies:
- dependency-name: org.junit:junit-bom
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-01-11 09:04:12 +00:00
f43049985e
Bump gson from 2.10 to 2.10.1
...
Bumps [gson](https://github.com/google/gson ) from 2.10 to 2.10.1.
- [Release notes](https://github.com/google/gson/releases )
- [Changelog](https://github.com/google/gson/blob/master/CHANGELOG.md )
- [Commits](https://github.com/google/gson/compare/gson-parent-2.10...gson-parent-2.10.1 )
---
updated-dependencies:
- dependency-name: com.google.code.gson:gson
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-01-09 09:05:55 +00:00
33f9f2cf66
Merge pull request #1006 from TeamNewPipe/yt/fix-html-escape
...
[YouTube] Fix escaping links in YouTubeParsingHelper.getTextFromObject
2023-01-05 19:02:23 +01:00
56aab4d971
[YouTube] Fix escaping links in YouTubeParsingHelper.getTextFromObject
2023-01-05 00:28:12 +01:00
22a47da8c7
Fix requested change and remove outdated comment.
2023-01-02 20:42:32 +00:00
98a90fd9c8
Don't cache comments count and return early on page fetch if no token.
2023-01-02 20:40:48 +00:00
2974dfaa48
Only store ajaxJson for initial page and eager fetch the initial continuation.
2023-01-02 20:40:48 +00:00
64d24aa09e
Fix request changes.
2023-01-02 20:40:48 +00:00
67ef4f4c30
Cleanup and remove optional.
2023-01-02 20:40:48 +00:00
22f71b010c
Fix for requested changes.
2023-01-02 20:40:48 +00:00
656b7c1cd9
Improve method documentation.
2023-01-02 20:40:48 +00:00
981aee4092
Add support to extract total comment count.
2023-01-02 20:40:48 +00:00
45636b0d00
Merge pull request #986 from Isira-Seneviratne/Static_maps
...
Use immutable Map factory methods.
2023-01-02 18:11:14 +01:00
219c5c5be5
Update extractor/src/main/java/org/schabi/newpipe/extractor/services/youtube/YoutubeParsingHelper.java
2023-01-02 18:11:03 +01:00
259de3cba6
Merge pull request #995 from TeamNewPipe/feat/soundcloud-playlistinfoitemextractor
...
[SoundCloud] Implement getUploaderUrl() and isUploaderVerified() for PlaylistInfoItemExtractor
2023-01-02 15:10:40 +01:00
991394b53a
Merge pull request #1005 from FireMasterK/fix-escaping-xss
...
Fix for potential XSS attacks and formatting issues
2023-01-02 15:06:17 +01:00
ce15f7cc50
Merge pull request #996 from TeamNewPipe/feat/peeertube-playlists
...
[PeerTube] Support searching for playlists and channels
2023-01-02 15:04:09 +01:00
d8ce08d969
Use immutable Map factory methods.
2023-01-02 07:50:31 +05:30
AudricV
Stypox
petlyh
dependabot[bot]
TobiGr
Kunal
Kavin
Isira Seneviratne