Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sign in to confirm you’re not a bot #9242

Open
DanielnetoDotCom opened this issue Jul 18, 2024 · 39 comments
Open

Sign in to confirm you’re not a bot #9242

DanielnetoDotCom opened this issue Jul 18, 2024 · 39 comments
Labels

Comments

@DanielnetoDotCom
Copy link
Member

Issue: Unable to Upload/Encode YouTube Videos

Problem Description

Since last night and continuing today, users, including admin, are encountering an error when attempting to share, upload, or encode YouTube videos. The error message displayed is:

Sorry!
ERROR: [youtube] 6R17SNKEbpY: Sign in to confirm you’re not a bot. This helps protect our community. Learn more.

However, the "Learn more" link does not have a hyperlink, and searching online has not provided a solution.

Cause

This issue is a global problem with yt-dlp, which is being blocked by YouTube.

Current Status

I am actively following the issue for a solution. You can track the progress and updates on this issue at the following link: GitHub Issue #10128.

Temporary Solution

As of now, there is no confirmed solution to this problem. Please be patient while the community works on resolving this issue.

Thank you for your understanding and cooperation.

@eitanwa
Copy link

eitanwa commented Jul 20, 2024

hey Daniel
Regarding this issue
Not sure we understood
We have no problem uploading or importing files from YouTube
Our systems are up to date
Could you please help us understand what we missed

@AViSource
Copy link

hey Daniel Regarding this issue Not sure we understood We have no problem uploading or importing files from YouTube Our systems are up to date Could you please help us understand what we missed

That's weird. This is what's happening when I try to upload a video by importing it. (See screenshot.)
Screenshot from 2024-07-21 11-06-29

@DanielnetoDotCom
Copy link
Member Author

hey Daniel Regarding this issue Not sure we understood We have no problem uploading or importing files from YouTube Our systems are up to date Could you please help us understand what we missed

Good for you, in those days YouTube is flagging whoever is using yt-dlp as a bot.
also banning users if you try to use cookies on it

@para2022
Copy link

yes i have this issue too. All my encoders cannot use yt-dlp anymore.

@JoshWho
Copy link
Contributor

JoshWho commented Jul 26, 2024

I think it goes off IP they are starting to figure out what servers are being used to pull their vids and limiting the ip

@gbrn
Copy link
Contributor

gbrn commented Aug 5, 2024

@DanielnetoDotCom This problem has now been resolved, I can use yt-dlp normally.
I recommend updating the encoder servers. Thanks.

@para2022
Copy link

para2022 commented Aug 5, 2024

same problem for me

ERROR: [youtube+oauth2] MttpnjmgOXI: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

@para2022
Copy link

para2022 commented Aug 5, 2024

@DanielnetoDotCom This problem has now been resolved, I can use yt-dlp normally. I recommend updating the encoder servers. Thanks.

still does not work after updating avideo and the encoder servers. The problem is exactly the same.

@gbrn
Copy link
Contributor

gbrn commented Aug 6, 2024

@para2022 The encoder does not only work with files available on Github AVideo Encoder.
yt-dlp is responsible for accessing external downloads. So you have to update it on your server.

Latest version: stable@2024.08.06 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

sudo pip install -U yt-dlp
or
sudo yt-dlp -U
or
sudo curl -L https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp -o /usr/local/bin/yt-dlp && sudo chmod a+rx /usr/local/bin/yt-dlp

@para2022
Copy link

para2022 commented Aug 6, 2024

@para2022 The encoder does not only work with files available on Github AVideo Encoder. yt-dlp is responsible for accessing external downloads. So you have to update it on your server.

Latest version: stable@2024.08.06 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

sudo pip install -U yt-dlp or sudo yt-dlp -U or sudo curl -L https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp -o /usr/local/bin/yt-dlp && sudo chmod a+rx /usr/local/bin/yt-dlp

I have updated yt-dlp already to latest and it still doesnt work. Same error message

@gbrn
Copy link
Contributor

gbrn commented Aug 7, 2024

@para2022 Do a test on your yt-dlp. Here for me it worked normally.
Try checking if your version is stable@2024.08.06, if not, remove and reinstall:
sudo yt-dlp -v

sudo yt-dlp -v
[debug] Command-line config: ['-v']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2024.08.06 from yt-dlp/yt-dlp [4d9231208] (zip)
[debug] Python 3.10.12 (CPython aarch64 64bit) - Linux-6.5.0-1027-oracle-aarch64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.11.0, brotli-1.0.9, certifi-2020.06.20, mutagen-1.45.1, pyxattr-0.7.2, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets
[debug] Loaded 1830 extractors

Test this:

sudo yt-dlp -f 'bestvideo[height=1080]+bestaudio/best[height=1080]' https://www.youtube.com/watch?v=ucZl6vQ_8Uo

image

@para2022
Copy link

para2022 commented Aug 7, 2024

Thanks. I get this:

[youtube+oauth2] Extracting URL: https://www.youtube.com/watch?v=ucZl6vQ_8Uo
[youtube+oauth2] ucZl6vQ_8Uo: Downloading webpage
[youtube+oauth2] ucZl6vQ_8Uo: Downloading ios player API JSON
[youtube+oauth2] ucZl6vQ_8Uo: Downloading tv player API JSON
ERROR: [youtube+oauth2] ucZl6vQ_8Uo: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

@para2022
Copy link

para2022 commented Aug 7, 2024

sudo yt-dlp -v
[debug] Command-line config: ['-v']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2024.08.01 from yt-dlp/yt-dlp [ffd7781d6] (pip)
[debug] Python 3.10.12 (CPython x86_64 64bit) - Linux-5.15.0-117-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2
[debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, mutagen-1.47.0, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets
[debug] Extractor Plugins: oauth2 (YoutubeBaseInfoExtractor), oauth2 (YoutubeClipIE), oauth2 (YoutubeConsentRedirectIE), oauth2 (YoutubeFavouritesIE), oauth2 (YoutubeIE), oauth2 (YoutubeMusicSearchURLIE), oauth2 (YoutubeNotificationsIE), oauth2 (YoutubeSearchDateIE), oauth2 (YoutubeSearchIE), oauth2 (YoutubeSearchURLIE), oauth2 (YoutubeTabBaseInfoExtractor), oauth2 (YoutubeTabIE)
[debug] Plugin directories: ['/usr/local/lib/python3.10/dist-packages/yt_dlp_plugins']
[debug] Loaded 1830 extractors

Usage: yt-dlp [OPTIONS] URL [URL...]

yt-dlp: error: You must provide at least one URL.
Type yt-dlp --help to see a list of all options.

@AViSource
Copy link

sudo yt-dlp -v [debug] Command-line config: ['-v'] [debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8 [debug] yt-dlp version stable@2024.08.01 from yt-dlp/yt-dlp [ffd7781d6] (pip) [debug] Python 3.10.12 (CPython x86_64 64bit) - Linux-5.15.0-117-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35) [debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2 [debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, mutagen-1.47.0, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0 [debug] Proxy map: {} [debug] Request Handlers: urllib, requests, websockets [debug] Extractor Plugins: oauth2 (YoutubeBaseInfoExtractor), oauth2 (YoutubeClipIE), oauth2 (YoutubeConsentRedirectIE), oauth2 (YoutubeFavouritesIE), oauth2 (YoutubeIE), oauth2 (YoutubeMusicSearchURLIE), oauth2 (YoutubeNotificationsIE), oauth2 (YoutubeSearchDateIE), oauth2 (YoutubeSearchIE), oauth2 (YoutubeSearchURLIE), oauth2 (YoutubeTabBaseInfoExtractor), oauth2 (YoutubeTabIE) [debug] Plugin directories: ['/usr/local/lib/python3.10/dist-packages/yt_dlp_plugins'] [debug] Loaded 1830 extractors

Usage: yt-dlp [OPTIONS] URL [URL...]

yt-dlp: error: You must provide at least one URL. Type yt-dlp --help to see a list of all options.

We have also applied all of the above mentioned steps and gotten the same results as you are getting.

@gbrn
Copy link
Contributor

gbrn commented Aug 9, 2024

For me it stopped working again, the last update is not working is:
Latest version: stable@2024.08.06 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

[youtube] FFaRzIHpJno: Downloading webpage
[youtube] FFaRzIHpJno: Downloading ios player API JSON
[youtube] FFaRzIHpJno: Downloading web creator player API JSON
ERROR: [youtube] FFaRzIHpJno: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

@DanielnetoDotCom
Copy link
Member Author

Hi

I just sent some update to youtube can you guys update your Encoder and signing on youtube before download?

image

@para2022
Copy link

It doesnt work for me

Hi

I just sent some update to youtube can you guys update your Encoder and signing on youtube before download?

image

This doesnt work me. Even with the fix i still get the same error:

ERROR: [youtube+oauth2] tMkUIHnv6Yw: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

@para2022
Copy link

[14-Aug-2024 04:39:50 Europe/London] [2024-08-14 04:39:50] getTitleFromLink: Get Title Error: LC_ALL=en_US.UTF-8 yt-dlp --no-check-certificate --no-playlist --force-ipv4 --skip-download -e 'https://www.youtube.com/watch?v=tMkUIHnv6Yw'
Array
(
[0] => ERROR: [youtube+oauth2] tMkUIHnv6Yw: Sign in to confirm you’re not a bot. This helps protect our community. Learn more
)

[14-Aug-2024 04:39:50 Europe/London] youtubeDl::addVideo We could not get the title () of your video (https://www.youtube.com/watch?v=tMkUIHnv6Yw)
[14-Aug-2024 04:39:50 Europe/London] PHP Warning: Undefined variable $encoders_ids in /home/encoder1/public_html/encoder1/objects/functions.php on line 1508
[14-Aug-2024 04:39:50 Europe/London] PHP Stack trace:
[14-Aug-2024 04:39:50 Europe/London] PHP 1. {main}() /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:0
[14-Aug-2024 04:39:50 Europe/London] PHP 2. addVideo($link = 'https://www.youtube.com/watch?v=tMkUIHnv6Yw', $streamers_id = 1, $title = NULL) /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:53
[14-Aug-2024 04:39:50 Europe/London] PHP Warning: Trying to access array offset on null in /home/encoder1/public_html/encoder1/objects/functions.php on line 1508
[14-Aug-2024 04:39:50 Europe/London] PHP Stack trace:
[14-Aug-2024 04:39:50 Europe/London] PHP 1. {main}() /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:0
[14-Aug-2024 04:39:50 Europe/London] PHP 2. addVideo($link = 'https://www.youtube.com/watch?v=tMkUIHnv6Yw', $streamers_id = 1, $title = NULL) /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:53

@DanielnetoDotCom
Copy link
Member Author

make sure you sign in properly, I am not seeing the accessToken in your log.

try also to share more from your logs

@para2022
Copy link

It shows me as properly logged in on my Google account and shows as signed in on the encoder

@DanielnetoDotCom
Copy link
Member Author

Ok, so share more from your logs,

if you have signed in in your yt-dlp should have something like --add-header "Authorization: Bearer...

@gbrn
Copy link
Contributor

gbrn commented Aug 15, 2024

I would like to report my tests... doing Google authentication, it worked perfectly.
I hope that soon this will no longer be necessary.

@DanielnetoDotCom
Copy link
Member Author

It shows me as properly logged in on my Google account and shows as signed in on the encoder

@para2022 please make a git pull again on the encoder

@para2022
Copy link

That last update fixed it. Thanks a lot dan :)

@AViSource
Copy link

AViSource commented Aug 28, 2024

It shows me as properly logged in on my Google account and shows as signed in on the encoder

@para2022 please make a git pull again on the encoder

I am still experiencing the same problem.

Encoder has been updated, I am logged in to my Google account and shows me as signed in on the encoder as well. yet I get the following error when I attempt to share:

Sorry!
WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (1/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (2/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (3/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] Unable to download API page: HTTP Error 401: Unauthorized (caused by ), WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (1/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (2/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (3/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] Unable to download API page: HTTP Error 401: Unauthorized (caused by ), WARNING: Only images are available for download. use --list-formats to see them, ERROR: [youtube] UFDQGBfCd1M: Requested format is not available. Use --list-formats for a list of available formats

What step did I miss?

@DanielnetoDotCom
Copy link
Member Author

DanielnetoDotCom commented Aug 28, 2024

@AViSource What domain is yours?

what youtube URL are you trying to download?

I guess you are from ubaantu, if yes I will look it direcly

@AViSource
Copy link

@AViSource What domain is yours?

what youtube URL are you trying to download?

I guess you are from ubaantu, if yes I will look it direcly

Yes, I am from ubaantu

@DanielnetoDotCom
Copy link
Member Author

What exactly link are you trying to download?

@AViSource
Copy link

What exactly link are you trying to download?
Oh, sorry. This is it.
https://www.youtube.com/watch?v=tKELDE5Hazg

@DanielnetoDotCom
Copy link
Member Author

I went to your encoder and signin with my Google user

image

and it works for me

image

soon you will see it in your library

image

@AViSource
Copy link

I went to your encoder and signin with my Google user

image

and it works for me

image

soon you will see it in your library

image

I'm happy that it worked. I will try to download / share another video. In my attempts, I selected "Import Video", pasted the url link, selected a "Category" and clicked "Share" before getting the error. I give an update.

@AViSource
Copy link

This is weird. I am still getting the same error. There is something off somewhere.

@DanielnetoDotCom
Copy link
Member Author

where you sign in on google, try to delete and add it again.

from your logs, looks like you did not authorize it properly

@AViSource
Copy link

where you sign in on google, try to delete and add it again.

from your logs, looks like you did not authorize it properly

Ok so I deleted it and added it again. But, it did not work. So, used another one of our accounts and it worked. I am happy that it worked; However, I am concerned about why it worked with one account but not the other.

@DanielnetoDotCom
Copy link
Member Author

it is probabaly a google thing.

@gbrn
Copy link
Contributor

gbrn commented Oct 29, 2024

@DanielnetoDotCom Danny the encoder is giving me a different error now.

WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument., WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (1/3)..., WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument., WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (2/3)..., WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument., WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (3/3)..., WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument., WARNING: [youtube] Unable to download API page: HTTP Error 400: Bad Request (caused by ), ERROR: [youtube] 9thU1yw2oU0: Video unavailable. This content isn’t available.

image

LOG:

    [4] => WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
    [5] => WARNING: [youtube] HTTP Error 400: Bad Request. Retrying (3/3)...
    [6] => WARNING: [youtube] YouTube said: ERROR - Request contains an invalid argument.
    [7] => WARNING: [youtube] Unable to download API page: HTTP Error 400: Bad Request (caused by <HTTPError 400: Bad Request>)
    [8] => ERROR: [youtube] 9thU1yw2oU0: Video unavailable. This content isn’t available.
)

[29-Oct-2024 18:43:28 America/Sao_Paulo] youtubeDl::addVideo We could not get the title () of your video (https://www.youtube.com/watch?v=9thU1yw2oU0)
[29-Oct-2024 18:43:28 America/Sao_Paulo] PHP Warning:  Undefined variable $encoders_ids in /var/www/html/AVideo-Encoder/objects/functions.php on line 1508
[29-Oct-2024 18:43:28 America/Sao_Paulo] PHP Warning:  Trying to access array offset on null in /var/www/html/AVideo-Encoder/objects/functions.php on line 1508

@DanielnetoDotCom
Copy link
Member Author

The error is really this Video unavailable. This content isn’t available. probably a location restriction

@gbrn
Copy link
Contributor

gbrn commented Oct 30, 2024

@DanielnetoDotCom That's not it, I've already tested other URLs. Probably a new block.
Can you test this URL on your side?
https://www.youtube.com/watch?v=ucZl6vQ_8Uo

@DanielnetoDotCom
Copy link
Member Author

You can try our public encoders

https://encoder1.wwbn.net/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants