-
Notifications
You must be signed in to change notification settings - Fork 8.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
slice bounds out of range - Frequent Ingress Controller restarts #12869
Comments
This issue is currently awaiting triage. If Ingress contributors determines this is a relevant issue, they will accept it by applying the The Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
The template of a new bug report asks several questions. Then edit your issue description here and answer those questions. Ensure you answer in markdown so readers can make sense out of the info. Try to provide as much info as possible. Specifically provide info as per the question and so copy/paste the command and its output as it is in markdown format. You can redact where needed. There is not enough info here to classify this as a bug as it is. The info you add may well indicate bug or problems so let us wait for that info to prove that his is a bug, before we can apply the bug label. Have you at least looked and studied the output of /remove-kind bug |
@longwuyuan required description updated in the issue description please procced further |
/triage needs-inormation |
@longwuyuan: The label(s) In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
@longwuyuan description updated |
Hi @naveen2112,
|
What happened:
panic: runtime error: slice bounds out of range [:65283] with capacity 14918
ingress controller restarted frequently with the above error
What you expected to happen:
Should have not restarted.
NGINX Ingress controller version (exec into the pod and run
/nginx-ingress-controller --version
):POD_NAMESPACE=ingress-nginx
POD_NAME=$(kubectl get pods -n $POD_NAMESPACE -l app.kubernetes.io/name=ingress-nginx --field-selector=status.phase=Running -o jsonpath='{.items[0].metadata.name}')
kubectl exec -it $POD_NAME -n $POD_NAMESPACE -- /nginx-ingress-controller --version
Kubernetes version (use
kubectl version
):Client Version: v1.30.1
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: v1.30.2
Environment:
Cloud provider or hardware configuration: hetzner
OS (e.g. from /etc/os-release):
NAME="Alpine Linux"
ID=alpine
VERSION_ID=3.19.1
PRETTY_NAME="Alpine Linux v3.19"
HOME_URL="https://alpinelinux.org/"
BUG_REPORT_URL="https://gitlab.alpinelinux.org/alpine/aports/-/issues"
Kernel (e.g.
uname -a
): Linux ingress-nginx-controller-67857d49bc-fzpds 6.8.0-31-generic Add healthz checker #31-Ubuntu SMP PREEMPT_DYNAMIC Sat Apr 20 00:40:06 UTC 2024 x86_64 LinuxInstall tools:
Basic cluster related info:
kubectl version
:Client Version: v1.30.1
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: v1.30.2
kubectl get nodes -o wide
NAME STATUS ROLES AGE VERSION INTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
master1 Ready control-plane 239d v1.30.1 10.0.0.2 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
master2 Ready control-plane 238d v1.30.1 10.0.0.4 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
master3 Ready control-plane 238d v1.30.1 10.0.0.3 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
opensource-app Ready 238d v1.30.1 10.0.0.7 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
opensource-loki-node Ready 127d v1.30.1 10.0.0.10 Ubuntu 24.04.1 LTS 6.8.0-45-generic containerd://1.7.22
worker1 Ready 238d v1.30.1 10.0.0.8 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
worker2 Ready 238d v1.30.1 10.0.0.9 Ubuntu 24.04 LTS 6.8.0-31-generic containerd://1.6.33
helm ls -A | grep -i ingress
helm -n <ingresscontrollernamespace> get values <helmreleasename>
if you have more than one instance of the ingress-nginx-controller installed in the same cluster, please provide details for all the instances
Current State of the controller:
kubectl describe ingressclasses
Name: nginx
Labels: app.kubernetes.io/component=controller
app.kubernetes.io/instance=ingress-nginx
app.kubernetes.io/name=ingress-nginx
app.kubernetes.io/part-of=ingress-nginx
app.kubernetes.io/version=1.10.1
Annotations:
Controller: k8s.io/ingress-nginx
Events:
kubectl -n <ingresscontrollernamespace> get all -A -o wide
kubectl -n <ingresscontrollernamespace> describe po <ingresscontrollerpodname>
kubectl -n <ingresscontrollernamespace> describe svc <ingresscontrollerservicename>
Current state of ingress object, if applicable:
kubectl -n <appnamespace> get all,ing -o wide
argocd ingress-resource-argocd nginx example1.getgist.com 10.0.0.6,167.235.216.1,2a01:4f8:c01e:71d::1 80, 443 238d
default ingress-resource-chat nginx example2.convertfox.com 10.0.0.6,167.235.216.1,2a01:4f8:c01e:71d::1 80, 443 238d
kubernetes-dashboard ingress-resource-host-dashboard nginx example3.getgist.com 10.0.0.6,167.235.216.1,2a01:4f8:c01e:71d::1 80, 443 238d
prometheus ingress-resource-host nginx example4.getgist.com 10.0.0.6,167.235.216.1,2a01:4f8:c01e:71d::1 80, 443 238d
prometheus ingress-resource-host-prometheus nginx example5.getgist.com 10.0.0.6,167.235.216.1,2a01:4f8:c01e:71d::1 80, 443 238d
kubectl -n <appnamespace> describe ing <ingressname>
If applicable, then, your complete and exact curl/grpcurl command (redacted if required) and the reponse to the curl/grpcurl command with the -v flag
Others:
kubectl describe ...
of any custom configmap(s) created and in useHow to reproduce this issue:
As minimally and precisely as possible. Keep in mind we do not have access to your cluster or application.
Help up us (if possible) reproducing the issue using minikube or kind.
Install minikube/kind
Install the ingress controller
install ingress controller with the above code snipet
Install an application that will act as default backend (is just an echo app)
kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/main/docs/examples/http-svc.yaml
Create an ingress (please add any additional annotation required)
echo "
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: foo-bar
annotations:
kubernetes.io/ingress.class: nginx
spec:
ingressClassName: nginx # omit this if you're on controller version below 1.0.0
rules:
- host: foo.bar
http:
paths:
- path: /
pathType: Prefix
backend:
service:
name: http-svc
port:
number: 80
" | kubectl apply -f -
The text was updated successfully, but these errors were encountered: