Skip to content

Allow get_next_data to be compatible with endpoints that have a list of commands #71

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Allow get_next_data to be compatible with endpoints that have a list of commands #71

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions scrapetube/scrapetube.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -300,6 +300,22 @@ def get_next_data(data: dict, sort_by: str = None) -> dict:
endpoint = next(search_dict(data, "continuationEndpoint"), None)
if not endpoint:
return None

# Sometimes, the returned endpoint has the continuation command in in the list at endpoint["commandExecutorCommand"]["commands"].
if "continuationCommand" not in endpoint:
# If that exists, iterate that looking for the continuation comand.
if "commandExecutorCommand" not in endpoint or "commands" not in endpoint["commandExecutorCommand"]:
raise Exception(f"Invalid endpoint: f{endpoint}");
found_continuation_endpoint = False
for command in endpoint["commandExecutorCommand"]["commands"]:
if "continuationCommand" not in command:
continue
endpoint = command
found_continuation_endpoint = True
break
if not found_continuation_endpoint:
raise Exception(f"Invalid endpoint, no command with a 'continuationCommand': f{endpoint}");

next_data = {
"token": endpoint["continuationCommand"]["token"],
"click_params": {"clickTrackingParams": endpoint["clickTrackingParams"]},
Expand Down