kubectl version mismatch

[mgor-tsi]

We are facing an issue with kubectl usage because of mismatch between kuberntes versions for client and server.

Probably https://github.com/edgexr/kubectl can be used so that used kubectl version is adjusted.

[mgor-tsi]

@gainsley Could you please have a look

[mgor-tsi]

https://github.com/edgexr/edge-cloud-platform/blob/main/pkg/k8smgmt/ingress-nginx.go#L85

[gainsley]

The kubectl bundled with our CCRM/CRM images should be https://github.com/edgexr/kubectl. Is that not what you're seeing?

[mgor-tsi]

There is a typo in a link above, it points to some fraudulent site :)

As I understood edgexr/kubectl should dynamically load kubectl version matching the client. But I can see here https://github.com/edgexr/edge-cloud-platform/blob/main/build/docker/Dockerfile.ccrm the used kubectl version is copied from some central location

[gainsley]

Sorry, fixed that typo :) In the ccrm dockerfile, kubectl is copied from the ALLINONE image. If you look at the Makefile, the ALLINONE image comes from $(EDGE_CLOUD_IMAGE):$(VERSION), which is the edge-cloud-platform image build in the build-platform-common target. The dockerfile for edge-cloud-platform copies kubectl from https://github.com/edgexr/kubectl/archive/refs/tags, which is the kubectl wrapper.

You can test kubectl by exec'ing into the ccrm pod.

$ kubectl get pods | grep ccrm
ccrm-7dcf54df5c-489dq                   1/1     Running   0             8d
ccrme-864bf57985-ckch2                  1/1     Running   0             8d
$ kubectl exec -it ccrm-7dcf54df5c-489dq -- bash
root@ccrm-7dcf54df5c-489dq:/# which kubectl
/usr/bin/kubectl
root@ccrm-7dcf54df5c-489dq:/# echo $HOME
/root
root@ccrm-7dcf54df5c-489dq:/# ls /root/bin
kubectl-v1.18.0  kubectl-v1.27.0  kubectl-v1.30.0

You will need some kubeconfig to test against, as the kubectl wrapper checks the version of the server to determine which version of the client to use. Perhaps there is some fault in the logic for that. Please check in your specific case with your specific Kubernetes cluster what the output of kubectl --kubeconfig=mycluster.conf --version shows.

[mgor-tsi]

But in this case, kubectl is used to access kubernetes cluster of k8ssite, not ccrm. And there is when kubectl version mismatch happens.

[gainsley]

Kubectl runs from CCRM for the k8ssite cluster. Version mismatch would be between kubectl being run on the CCRM and the kubernetes cluster you've set up as the k8ssite cluster.