Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

liveness probe and readiness probe of ks-jenkins failed #70

Open
showjason opened this issue Dec 22, 2021 · 9 comments
Open

liveness probe and readiness probe of ks-jenkins failed #70

showjason opened this issue Dec 22, 2021 · 9 comments
Labels
kind/support Categorizes issue as related to a support request.

Comments

@showjason
Copy link

OS info:
CentOS Linux release 7.9.2009 (Core) , 4C/16G

Kubernetes version:
image

Docker version:
image

KubeSphere version:
v3.1.1

Issue Description:
After I finish KS installation offline, I enable DevOps by following the step of Enable DevOps after Installation

Here list the snapshots:
clusterconfiguration
image
ks-jenkins pod status and events:
image
image
log of ks-jenkins pod
image
Helm list
image
I find that jenkin uc is not deployed, is this the reason why ks-jenkins is not ready
Please, experts come up with some solutions or ideas!

@JohnNiang
Copy link
Member

/kind support
Thanks for reaching out here. There are several step you can try:

  • Describe the Pod ks-jenkins and check the exit code of Container ks-jenkins
  • Check latest events
  • Check full logs of previous Pod ks-jenkins

@ks-ci-bot ks-ci-bot added the kind/support Categorizes issue as related to a support request. label Dec 22, 2021
@LinuxSuRen
Copy link
Member

LinuxSuRen commented Dec 22, 2021

I find that jenkin uc is not deployed, is this the reason why ks-jenkins is not ready

All Jenkins plugins are installed in the ks-jenkins container image since v3.x. So, we don't need a private uc (Jenkins update center) anymore.

@showjason
Copy link
Author

/kind support Thanks for reaching out here. There are several step you can try:

  • Describe the Pod ks-jenkins and check the exit code of Container ks-jenkins
    image
  • Check latest events
    image
  • Check full logs of previous Pod ks-jenkins
    image

@JohnNiang, I did some checks as you said, but still could not get obvious error info. Here screenshots listed above is what I do, please provide some in-deep analysis or directions

@showjason
Copy link
Author

I find that jenkin uc is not deployed, is this the reason why ks-jenkins is not ready

All Jenkins plugins are installed in the ks-jenkins container image since v3.x. So, we don't need a private uc (Jenkins update center) anymore.

Ok, thanks for quick reply!

@LinuxSuRen
Copy link
Member

Try remove liveness probe and readiness probe, then see if it can start successfully.

@showjason
Copy link
Author

Try remove liveness probe and readiness probe, then see if it can start successfully.

It's working now after removing liveness probe and readiness probe. However, I am confused that http://<POD_IP>:8080/login is only used by probes to do health check or also plays other role in jenkins.
If the latter, even though ks-jenkins is ready, http://<POD_IP>:8080/login still refuses connection, will there be potential risk?

@LinuxSuRen
Copy link
Member

I guess your cluster might have a network issue.

@showjason
Copy link
Author

showjason commented Dec 23, 2021

I guess your cluster might have a network issue.

It's weird, in my cluster, every component is running well, I run curl -v http://10.244.179.7:8080/login in my cluster and got response 200.
image

Anyhow, it is runing now, if any new issues I found, I will be back, and ask for support.
@LinuxSuRen, thanks!

@wyuxiao729
Copy link

The same problem was assumed to be caused by the NTP server, but I tried to set jenkinsJavaOpts_Xms and jenkinsJavaOpts_Xmx to less than 1000M, and the problem was resolved。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/support Categorizes issue as related to a support request.
Projects
None yet
Development

No branches or pull requests

5 participants