Minikube - Unable to setup foundationdb as Pods failing

Using FoundationDB Kubernetes Operator
1

Hello,
I followed steps given in the docs and ran on my minikube environment. The deployment is trying to create below pods and only some of them created and other returning with errors.
[test-cluster-cluster-controller-1] -created
[test-cluster-log-1] - created
[test-cluster-log-2] -FAILED
[test-cluster-log-3] -FAILED
[test-cluster-log-4]- FAILED
[test-cluster-storage-1] - created
[test-cluster-storage-2] -FAILED
[test-cluster-storage-3]- FAILED
[fdb-kubernetes-operator-controller-manager-cf7785889-qlmkd] -created

Errors:
[test-cluster-log-2] and [test-cluster-storage-2]
0/1 nodes are available: pod has unbound immediate PersistentVolumeClaims. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod…

0/1 nodes are available: 1 Insufficient cpu. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod…

used below code for deployment:
apps.foundationdb.org_foundationdbclusters.yaml
apps.foundationdb.org_foundationdbbackups.yaml
apps.foundationdb.org_foundationdbrestores.yaml
https://raw.githubusercontent.com/foundationdb/fdb-kubernetes-operator/main/config/samples/deployment.yaml

kubectl apply -f https://raw.githubusercontent.com/foundationdb/fdb-kubernetes-operator/main/config/samples/cluster.yaml

Is there anything I should update the code to get all pods running?

2

Could you provide some more details about your setup? What Minikube driver are you using? How many resources are available in your Minikube setup? What architecture is your setup?

3

Hello Johannes,
Thanks for reaching out on this. Based on your info, I got striked and updated the minikube cpu and memory from default to higher and I see now pods executed.
I am now trying to connect to fdb and when I run the ‘status’, I get a message as “Could not communicate with a quorum of coordination servers”.
I am reviewing your document on how to update DNS but so far not successful. Can you tell me which yaml file I need to configure DNS changes? Referred here but not sure on where to make changes - https://github.com/FoundationDB/fdb-kubernetes-operator/blob/main/docs/manual/customization.md

4

Hello Johannes,
Thanks for reaching out on this. Based on your info, I got striked and updated the minikube cpu and memory from default to higher and I see now pods executed.
I am now trying to connect to fdb and when I run the ‘status’, I get a message as “Could not communicate with a quorum of coordination servers”.

Are you trying to connect to the cluster from outside of Minikube? That’s currently not possible, FDB requires to be able to connect to the FDB processes directly and the IP addresses assigned inside the Minikube setup are normally not reachable from your host. There might be a Minikube setup that allows you to do that.

I am reviewing your document on how to update DNS but so far not successful. Can you tell me which yaml file I need to configure DNS changes? Referred here but not sure on where to make changes - https://github.com/FoundationDB/fdb-kubernetes-operator/blob/main/docs/manual/customization.md

By update DNS, you mean you want to enable DNS in your test cluster right? If you followed the default steps, you used this deployment: https://github.com/FoundationDB/fdb-kubernetes-operator/blob/main/config/samples/deployment.yaml and you have to apply those changes: https://github.com/FoundationDB/fdb-kubernetes-operator/blob/main/docs/manual/customization.md#using-dns to the deployment file to make DNS work (the default primary library must be at least 7.1). After that you can set:

  routing:
    useDNSInClusterFile: true

in your FoundationDBCluster Spec.

Could you tell us what steps are unclear? So I can update the docs to make it easier to use this setting?

5

Hello Johannes,
After updating the cluster.yaml with below setting, I was able to configure DNS changes. Thanks for the support.
routing: useDNSInClusterFile: true

https://raw.githubusercontent.com/foundationdb/fdb-kubernetes-operator/main/config/samples/cluster.yaml

Regarding documentation, if you can just update which files to update the change in below documentation that would be great. Also, can you please provide an architecture diagram of k8 services that will be helpful in understanding.
https://github.com/FoundationDB/fdb-kubernetes-operator/blob/main/docs/manual/customization.md#using-dns