New uploads being skipped during executions (Caused by setting "Frequency (hours)" column values to "1")

[cam4782]

This has only started happening in the past week or so. Before, all of the new uploads from channels specified in the spreadsheet would be added to the specified playlist whenever the script was triggered, which is set to every hour. Now, I notice that up to around 25% of new uploads are missing from my playlist compared to my subscriptions page. There appears to be no correlation with missing videos and channel source. On the debug sheet, executions that are associated with missing videos are logged as "Acquired 0 videos, Filtering finished, left with 0 videos, No new videos yet."

I'd love to know if this is user error in some way, but due to the fact that I did not change anything between the script functioning normally and the error beginning to occur, I'm not so sure.

[victorjzsun]

If you run the script manually right after it missed videos, will it pick it up? How long does it take the script to pick it up? One hour? Longer?

[cam4782]

If you run the script manually right after it missed videos, will it pick it up? How long does it take the script to pick it up? One hour? Longer?

If the script is run manually right after, I will recieve "Skipped: Not time yet" in the debug log. When an execution happens that results in skipped videos, it still updates the "last update" timestamp on the sheet. This results in those videos not being checked for again, and they never end up being added to the playlist.

I'm going to try another instance of the script on another account to see if I can replicate this. I'm really quite surprised because I've been using this script for years with no issues. Same playlists, same channels. I haven't even touched the spreadsheet since before I started having this issue either.

[cam4782]

So I managed to fix the issue by removing the values in the "Frequency (hours)" column in the spreadsheet. All of my video subscriptions are being added correctly now. Before, I had a value of "1" entered in this column for my playlists, and the execution was also running every hour. It seems that there was a strange interaction between the two every few hours that resulted in a pattern of "Skipped: Not time yet", and "Acquired 0 videos, Filtering finished, left with 0 videos, No new videos yet." There would be a period of several consecutive correctly performed executions, then an execution where no videos were added, yet the timestamp was still updated, leading to those videos never being added in the next execution.

[victorjzsun]

Are you saying that the "Skipped: Not time yet" and "Acquired 0 videos, ..." would show up in the same execution and also have the timestamp updated at the end of the execution?

[cam4782]

Sorry, I meant there would be some consecutive executions that alternate between "Skipped: Not time yet" and "Acquired 0 videos". For example, one hour's execution would result in "Skipped: Not time yet", and then the next hour's execution would result in "Acquired 0 videos". New videos uploaded during this hour would not be added to the playlist and the timestamp would be updated. After this event, there would be a number of executions that are performed successfully, followed by another "Skipped: Not time yet" and "Acquired 0 videos" chain.

After removing the values in the "Frequency (hours)" column in the spreadsheet, I have had zero issues since.

[victorjzsun]

I can see the “Skipped not time yet” happening as a race condition between the trigger and the check for being 1 hour after the last update timestamp. However, the next run should pick any new videos up as the timestamp is not updated when skipping, not sure why it’s not. Will try to do some testing.