tubearchivist/tubearchivist-jf
1
0
Fork 0
mirror of https://github.com/tubearchivist/tubearchivist-jf.git synced 2026-03-24 05:26:49 +00:00
Code Issues Projects Packages Wiki Activity

[GH-ISSUE #17] Can't create seasons in time, when videos count greate then 300 #14

New issue
Closed
opened 2026-03-23 20:32:55 +00:00 by mirror · 5 comments
mirror commented 2026-03-23 20:32:55 +00:00
Owner
Copy link

Originally created by @romanmindiyarov on GitHub (Oct 31, 2023).
Original GitHub issue: https://github.com/tubearchivist/tubearchivist-jf/issues/17

Timeouts accur for folders with a lot of files.
Need to increase number of attempts or sleep timeout in /app/src/series.py, string 212

        for _ in range(1200):
            all_existing: set[str] = set(self._get_existing_seasons())

            if expected_season in all_existing:
                return

            print(f"[setup][{jf_id}] waiting for seasons to be created")
            sleep(5)

        raise TimeoutError("timeout reached for creating season folder")
Originally created by @romanmindiyarov on GitHub (Oct 31, 2023). Original GitHub issue: https://github.com/tubearchivist/tubearchivist-jf/issues/17 Timeouts accur for folders with a lot of files. Need to increase number of attempts or sleep timeout in /app/src/series.py, string 212 ``` for _ in range(1200): all_existing: set[str] = set(self._get_existing_seasons()) if expected_season in all_existing: return print(f"[setup][{jf_id}] waiting for seasons to be created") sleep(5) raise TimeoutError("timeout reached for creating season folder") ```
mirror 2026-03-23 20:32:55 +00:00
mirror commented 2026-03-23 20:32:57 +00:00
Author
Owner
Copy link

@romanmindiyarov commented on GitHub (Oct 31, 2023):

Attempts for 516 videos

[show][UCQwemcJi82TE9-FYNgbg8ug] indexing 516 videos
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
[setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created
<!-- gh-comment-id:1787137922 --> @romanmindiyarov commented on GitHub (Oct 31, 2023): Attempts for 516 videos ``` [show][UCQwemcJi82TE9-FYNgbg8ug] indexing 516 videos [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created [setup][ef6c9dcb0cc6113f7ef8596415f3930f] waiting for seasons to be created ```
mirror commented 2026-03-23 20:32:57 +00:00
Author
Owner
Copy link

@bbilly1 commented on GitHub (Oct 31, 2023):

Does it eventually get created? It shouldn't matter how many videos there are in a season. But yes, if your JF is busy with other things, you'll might need to trigger it again manually: https://github.com/tubearchivist/tubearchivist-jf#limitations

<!-- gh-comment-id:1787169317 --> @bbilly1 commented on GitHub (Oct 31, 2023): Does it eventually get created? It shouldn't matter how many videos there are in a season. But yes, if your JF is busy with other things, you'll might need to trigger it again manually: https://github.com/tubearchivist/tubearchivist-jf#limitations
mirror commented 2026-03-23 20:32:57 +00:00
Author
Owner
Copy link

@romanmindiyarov commented on GitHub (Oct 31, 2023):

Yes, it created successfully, but very slowly. If there are 2040 videos in the folder, then it takes even longer...
And yes, my server is not fast...

<!-- gh-comment-id:1787190074 --> @romanmindiyarov commented on GitHub (Oct 31, 2023): Yes, it created successfully, but very slowly. If there are 2040 videos in the folder, then it takes even longer... And yes, my server is not fast...
mirror commented 2026-03-23 20:32:58 +00:00
Author
Owner
Copy link

@romanmindiyarov commented on GitHub (Oct 31, 2023):

[show][UC3z56zNhqj6Z5IfUEX3ZkNw] indexing 1 videos
[setup][3545b2fbc49425dd66cae0ed36da9bdd] waiting for seasons to be created
[show][UCYUUvwy5FxwWzUCFkG6uGrg] indexing 1 videos
[setup][1e45f0fb0a94a5f74642c87a6d3cfa41] waiting for seasons to be created
[show][UCPx-POFx7eXuQ9Yc7olQlKw] indexing 153 videos
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
[setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created
<!-- gh-comment-id:1787204571 --> @romanmindiyarov commented on GitHub (Oct 31, 2023): ``` [show][UC3z56zNhqj6Z5IfUEX3ZkNw] indexing 1 videos [setup][3545b2fbc49425dd66cae0ed36da9bdd] waiting for seasons to be created [show][UCYUUvwy5FxwWzUCFkG6uGrg] indexing 1 videos [setup][1e45f0fb0a94a5f74642c87a6d3cfa41] waiting for seasons to be created [show][UCPx-POFx7eXuQ9Yc7olQlKw] indexing 153 videos [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created [setup][05486dfcc3696d93c674f9b575ac4bfc] waiting for seasons to be created ```
mirror commented 2026-03-23 20:32:58 +00:00
Author
Owner
Copy link

@bbilly1 commented on GitHub (Oct 31, 2023):

we need to have some sort of a timeout, otherwise this will run indefinitely and never fail, even if it will never create the seasons for reasons outside of the control of this script here. So just increasing the timeout to an arbitrary high number will not solve the problem.

Ultimately I don't assume you read in 2000 videos in batch all too often, so for these cases you should be able to just trigger it again manually, as documented.

Or alternatively you could implement a config var so you can configure the timeout to adjust it to low end hardware.

<!-- gh-comment-id:1787336010 --> @bbilly1 commented on GitHub (Oct 31, 2023): we need to have some sort of a timeout, otherwise this will run indefinitely and never fail, even if it will never create the seasons for reasons outside of the control of this script here. So just increasing the timeout to an arbitrary high number will not solve the problem. Ultimately I don't assume you read in 2000 videos in batch all too often, so for these cases you should be able to just trigger it again manually, as documented. Or alternatively you could implement a config var so you can configure the timeout to adjust it to low end hardware.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
v0.2.0
v0.1.2
v0.1.1
v0.1.0
Labels
Clear labels   
duplicate

   
enhancement

   
help wanted

   
help wanted

   
invalid

   
pull-request

Mirrored from GitHub Pull Request

  
question

   
question

   
wontfix
No labels
duplicate
enhancement
help wanted
help wanted
invalid
pull-request
question
question
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
tubearchivist/tubearchivist-jf#14
No description provided.