Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fragment Errorer 403 #44

Open
elandaa opened this issue Jul 5, 2023 · 6 comments
Open

Fragment Errorer 403 #44

elandaa opened this issue Jul 5, 2023 · 6 comments

Comments

@elandaa
Copy link

elandaa commented Jul 5, 2023

2023-07-05 19:51:31 ←[31m[hls] 0 Fragment 2763 errored: 403 ←[0m←[K
2023-07-05 19:51:31 ←[31m[hls] 0 Fragment 2763 errored: 403 ←[0m←[K
2023-07-05 19:51:31 ←[31m[hls] 0 Fragment 2763 errored: 403 ←[0m←[K
2023-07-05 19:51:31 ←[31m[hls] 0 Gave up on fragment 2763 after 5 tries ←[0m←[K
2023-07-05 19:51:31 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[KMiB ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Fragment 2764 errored: 403 ←[0m←[K
2023-07-05 19:51:32 ←[31m[hls] 0 Gave up on fragment 2764 after 5 tries ←[0m←[K
2023-07-05 19:51:33 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[KMiB ←[0m←[K
2023-07-05 19:51:33 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[K
2023-07-05 19:51:33 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[K
2023-07-05 19:51:33 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[K
2023-07-05 19:51:34 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[K
2023-07-05 19:51:34 ←[31m[hls] 0 Fragment 2765 errored: 403 ←[0m←[K
2023-07-05 19:51:34 ←[31m[hls] 0 Gave up on fragment 2765 after 5 tries ←[0m←[K
2023-07-05 19:51:34 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[KMiB ←[0m←[K
2023-07-05 19:51:34 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[K
2023-07-05 19:51:35 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[K
2023-07-05 19:51:35 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[K
2023-07-05 19:51:36 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[K
2023-07-05 19:51:36 ←[31m[hls] 0 Fragment 2766 errored: 403 ←[0m←[K
2023-07-05 19:51:36 ←[31m[hls] 0 Gave up on fragment 2766 after 5 tries ←[0m←[K
2023-07-05 19:51:37 ←[31m[hls] 0 Fragment 2767 errored: 403 ←[0m←[KMiB ←[0m←[K
2023-07-05 19:51:37 ←[31m[hls] 0 Fragment 2767 errored: 403 ←[0m←[K
2023-07-05 19:51:37 ←[31m[hls] 0 Fragment 2767 errored: 403 ←[0m←[K

Hello, I got this error sometimes, how to fix this issue?

@hizkifw
Copy link
Member

hizkifw commented Jul 6, 2023

Hi can you tell me

  • What OS (Windows/Linux/OSX/others)
  • What Python version you're using
  • fc2-live-dl version (run with --version to check)
  • The command you used to run it

Additionally

  • Does this issue happen all the time or only sometimes?
  • When it's returning 403, can you check with your browser if the stream is working?

@elandaa
Copy link
Author

elandaa commented Jul 6, 2023

Hello, thanks for the reply.

  • What OS (Windows 10 Pro)
  • Python Ver. 3.11 64bit
  • fc2-live-dl Ver. 2.1.3
  • command using pip : fc2-live-dl

Additionally

  • it happens sometimes, i also check the stream and its still live, i did reopen the cmd to start recording again. i don't know if its my connection or something else.

@hizkifw
Copy link
Member

hizkifw commented Jul 6, 2023

Are you using a cookies file? Is the stream you're trying to record a public one or login-only or private?

Does the error happen at the start of recording or does it start after the recording has been going for a while?

@elandaa
Copy link
Author

elandaa commented Jul 6, 2023

Nope, i didnt use cookies since its free paid/public stream, it usually takes around 40 - 60 minutes of recording, i tried both with/without cookies and the error still happen in that stream. next day i tried to record again with the same streamer and no error, i'm very confused. i wonder why it is.

@xxshade
Copy link

xxshade commented Jul 16, 2023

autofc2              | 2023-07-14 10:20:03 [fc2 72364867] Found websocket url
autofc2              | 2023-07-14 10:20:09 [ws] Timeout reached waiting for HLS information, retrying in 1 seconds
autofc2              | 2023-07-14 10:20:12 [fc2 72364867] Requested quality ('2Mbps', 'mid') is not available, waiting (8/5s)
autofc2              | 2023-07-14 10:20:13 [fc2 72364867] Timeout reached, falling back to next best quality ('1.2Mbps', 'mid')
autofc2              | 2023-07-14 10:20:13 [fc2 72364867] Received HLS info
autofc2              | 2023-07-14 10:20:13 [fc2 72364867] Writing stream to /recordings/Uno Sakura 兎野さくら/2023-07-14 102003 ド変態VTuberのエロ配信.ts
autofc2              | 2023-07-14 10:20:13 [hls] Downloading with 4 threads
autofc2              | 2023-07-14 10:20:46 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:46 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:49 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:49 [hls] 3 Fragment 7 errored: 403
autofc2              | 2023-07-14 10:20:50 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:52 [hls] 3 Fragment 7 errored: 403
autofc2              | 2023-07-14 10:20:53 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:53 [hls] 3 Fragment 7 errored: 403
autofc2              | 2023-07-14 10:20:54 [hls] 3 Fragment 7 errored: 403
autofc2              | 2023-07-14 10:20:55 [hls] 2 Fragment 8 errored: 403
autofc2              | 2023-07-14 10:20:55 [hls] 2 Fragment 8 errored: 403
autofc2              | 2023-07-14 10:20:55 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:20:55 [hls] 1 Gave up on fragment 6 after 5 tries
autofc2              | 2023-07-14 10:20:55 [hls] 2 Fragment 8 errored: 403
[...]
autofc2              | 2023-07-14 10:24:50 [hls] 0 Fragment 184 errored: 403
autofc2              | 2023-07-14 10:24:50 [hls] 2 Fragment 186 errored: 403
autofc2              | 2023-07-14 10:33:06 [fc2 72364867] Server disconnected: 4114
autofc2              | 2023-07-14 10:33:06 [fc2 72364867] Done
autofc2              | 2023-07-14 10:33:06 [fc2 72364867] Fetching stream info
autofc2              | 2023-07-14 10:33:07 [fc2 72364867] Found websocket url
autofc2              | 2023-07-14 10:33:15 [ws] Timeout reached waiting for HLS information, retrying in 1 seconds
autofc2              | 2023-07-14 10:33:18 [fc2 72364867] Received HLS info
autofc2              | 2023-07-14 10:33:18 [fc2 72364867] Writing stream to /recordings/Uno Sakura 兎野さくら/2023-07-14 103307 ド変態VTuberのエロ配信.ts
autofc2              | 2023-07-14 10:33:18 [hls] Downloading with 4 threads
autofc2              | 2023-07-14 10:33:59 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:34:03 [hls] 1 Fragment 6 errored: 403
autofc2              | 2023-07-14 10:34:06 [hls] 0 Fragment 7 errored: 403
autofc2              | 2023-07-14 10:34:06 [hls] 1 Fragment 6 errored: 403
[...]
autofc2              | 2023-07-14 10:36:00 [hls] 2 Fragment 69 errored: 403
autofc2              | 2023-07-14 10:45:40 [fc2 72364867] Server disconnected: 4114
autofc2              | 2023-07-14 10:45:40 [fc2 72364867] Done
autofc2              | 2023-07-14 10:45:41 [fc2 72364867] Fetching stream info
autofc2              | 2023-07-14 10:45:42 [fc2 72364867] Found websocket url
autofc2              | 2023-07-14 10:45:56 [ws] Timeout reached waiting for HLS information, retrying in 1 seconds
autofc2              | 2023-07-14 10:46:02 [ws] Timeout reached waiting for HLS information, retrying in 2 seconds
autofc2              | 2023-07-14 10:46:05 [fc2 72364867] Received HLS info
autofc2              | 2023-07-14 10:46:05 [fc2 72364867] Writing stream to /recordings/Uno Sakura 兎野さくら/2023-07-14 104542 ド変態VTuberのエロ配信.ts
autofc2              | 2023-07-14 10:46:05 [hls] Downloading with 4 threads
autofc2              | 2023-07-14 10:46:32 [hls] 3 Fragment 5 errored: 403
autofc2              | 2023-07-14 10:46:33 [hls] 3 Fragment 5 errored: 403
autofc2              | 2023-07-14 10:46:33 [hls] 3 Fragment 5 errored: 403
autofc2              | 2023-07-14 10:46:34 [hls] 3 Fragment 5 errored: 403

Noticed friday that happened to me too and was like that until the stream end.
The same occurred with necoma stream, but after some time it stopped and started working again

autofc2              | 2023-07-14 12:27:16 [hls] 0 Gave up on fragment 49 after 5 tries
autofc2              | 2023-07-14 12:27:16 [hls] 0 Fragment 56 errored: 403
autofc2              | 2023-07-14 12:27:16 [hls] 2 Fragment 53 errored: 403
autofc2              | 2023-07-14 12:36:54 [fc2 91544481] Server disconnected: 4114
autofc2              | 2023-07-14 12:36:54 [fc2 91544481] Done
autofc2              | 2023-07-14 12:36:54 [fc2 91544481] Fetching stream info
autofc2              | 2023-07-14 12:36:55 [fc2 91544481] Found websocket url
autofc2              | 2023-07-14 12:36:57 [fc2 91544481] Received HLS info
autofc2              | 2023-07-14 12:36:57 [fc2 91544481] Writing stream to /recordings/Necoma Karin 猫羽かりん/2023-07-14 123655 猫羽かりん♡快感に貪欲なスケベ女Vtuberの性欲発散ディルドオナニー配信♡おまんこASMR♡.ts
autofc2              | 2023-07-14 12:36:57 [hls] Downloading with 4 threads
autofc2              | 2023-07-14 13:48:46 [fc2 91544481] Stream ended
autofc2              | 2023-07-14 13:48:46 [fc2 91544481] Done

After that no problems.

  • Docker

  • Python 3.11.4

  • fc2-live-dl v2.1.3

  • Just running the docker image with the config

  • Only sometimes, first time that happened like that.

@hizkifw
Copy link
Member

hizkifw commented Jul 16, 2023

Thanks for the logs. Seems to be a disconnection from the server side as indicated with the Server disconnected: 4114.

I'll need to dig deeper and check if FC2 has added some checks to prevent scraping/recording.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants