Created the "second" cluster.

This commit is contained in:
savagebidoof 2023-08-01 19:58:00 +02:00
parent c68c2c27f1
commit e8729db48f

View File

@ -1429,36 +1429,368 @@ node "slave01.filter.home" deleted
### Part 6
Currently, the resources whereas:
```yaml
192.168.1.2: pi4
192.168.1.10: masterk
192.168.1.11: slave01
```
I will change it to
```yaml
192.168.1.9: masterk / pi4
192.168.1.10: slave01
192.168.1.11: slave02
```
# I am here <----
#### Prepare NVME images etc.
Did the needful.
#### Set up cluster
Used the following ansible script to set up things arround.
https://gitea.filterhome.xyz/ofilter/ansible_kubernetes_cluster
##### run.sh
<pre><span style="color:#FF7F7F"><b></b></span> ./run.sh
PLAY [Pre Setup] *************************************************************************************************************************************************************************************************************************
TASK [apt update] ************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
TASK [apt upgrade] ***********************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Install sudo] **********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [update facts] **********************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Ensure localisation files for &apos;en_US.UTF-8&apos; are available] *************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Ensure localisation files for &apos;en_US.UTF-8&apos; are available] *************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Get current locale and language configuration] *************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Configure locale to &apos;en_US.UTF-8&apos; and language to &apos;en_US.UTF-8&apos;] *******************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Make sure we have a &apos;wheel&apos; group] *************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Allow &apos;wheel&apos; group to have passwordless sudo] *************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Add user new_user_name] ************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">[DEPRECATION WARNING]: Encryption using the Python crypt module is deprecated. The Python crypt module is deprecated and will be removed from Python 3.13. Install the passlib library for continued encryption functionality. This </span>
<span style="color:#7F3FBF">feature will be removed in version 2.17. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.</span>
<span style="color:#7F3FBF">[DEPRECATION WARNING]: Encryption using the Python crypt module is deprecated. The Python crypt module is deprecated and will be removed from Python 3.13. Install the passlib library for continued encryption functionality. This </span>
<span style="color:#7F3FBF">feature will be removed in version 2.17. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.</span>
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [adding user &apos;klussy&apos; to group wheel] ***********************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Change root default password] ******************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">[DEPRECATION WARNING]: Encryption using the Python crypt module is deprecated. The Python crypt module is deprecated and will be removed from Python 3.13. Install the passlib library for continued encryption functionality. This </span>
<span style="color:#7F3FBF">feature will be removed in version 2.17. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.</span>
<span style="color:#7F3FBF">[DEPRECATION WARNING]: Encryption using the Python crypt module is deprecated. The Python crypt module is deprecated and will be removed from Python 3.13. Install the passlib library for continued encryption functionality. This </span>
<span style="color:#7F3FBF">feature will be removed in version 2.17. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.</span>
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [PermitRootLogin = no] **************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [PermitEmptyPasswords = no] *********************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [reboot] ****************************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
</pre>
Pi4 got stuck to waiting for reboot, was expecting this issue already so returned to the old `shell: reboot` command.
Nevertheless, resumed with the next playbook.
<pre>^C<span style="color:#FF7F7F"> [ERROR]: User interrupted execution</span>
PLAY [Preparethings] *********************************************************************************************************************************************************************************************************************
TASK [Gathering Facts] *******************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [debug] *****************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [pi4.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;set_hostname&quot;: &quot;pi4.filter.home&quot;</span>
<span style="color:#7F3FBF">}</span>
<span style="color:#7F3FBF">ok: [slave02.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;set_hostname&quot;: &quot;slave02.filter.home&quot;</span>
<span style="color:#7F3FBF">}</span>
TASK [debug] *****************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [pi4.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;is_master&quot;: true</span>
<span style="color:#7F3FBF">}</span>
<span style="color:#7F3FBF">ok: [slave02.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;is_master&quot;: false</span>
<span style="color:#7F3FBF">}</span>
TASK [Set a hostname] ********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Swapoff] ***************************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Disable ram on boot (orangepi)] ****************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [pi4.filter.home]</span>
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
TASK [Disable ram on boot (armbian)] *****************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [apt prune containerd] **************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [apt update] ************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [apt upgrade] ***********************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [apt install gnupg] *****************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Creating a new directory] **********************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Add Docker GPG key] ****************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Add Docker APT repository] *********************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Add Kubernetes GPG key] ************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Add Kubernetes APT repository] *****************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [apt update] ************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Install Kubelet Kubeadm Kubectl] ***************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Hold kubeadm] **********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Hold kubelet] **********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Hold kubectl] **********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Install Container Runtime] *********************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Containerd set default config] *****************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [SystemdCgroup = true] **************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Iptables thingies (not touching specific firewall rules.)] *************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Iptables thingies] *****************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Add the overlay module] ************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Add the br_netfilter module] *******************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Apply changes (might need to use sysctl module with the reload flag, will try eventually)] *****************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Enable kubelet] ********************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Enable containerd] *****************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [Enable kubelet] ********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Restart containerd] ****************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Set /etc/hosts file content (template/base)] ***************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Init cluster] **********************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Export remote kubeconfig file] *****************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
</pre>
<pre>TASK [Remove Taint (allows deployment in control plane node)] ****************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Calico] ****************************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [MetalLB] ***************************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [Generate join token] ***************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
TASK [set_fact] **************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
TASK [debug] *****************************************************************************************************************************************************************************************************************************
<span style="color:#7F3FBF">ok: [pi4.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;kubeadm_join_command&quot;: &quot;kubeadm join 192.168.1.9:6443 --token abcd1234abcd1234 --discovery-token-ca-cert-hash sha256:abcd1234abcd1234 &quot;</span>
<span style="color:#7F3FBF">}</span>
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
TASK [Store join command in &quot;./Exported/kubeadm-join.command&quot;] ***************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home -&gt; localhost]</span>
TASK [Populate] **************************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [pi4.filter.home]</span>
<span style="color:#7F3FBF">ok: [slave02.filter.home]</span>
TASK [debug] *****************************************************************************************************************************************************************************************************************************
<span style="color:#7f7fff">skipping: [pi4.filter.home]</span>
<span style="color:#7F3FBF">ok: [slave02.filter.home] =&gt; {</span>
<span style="color:#7F3FBF"> &quot;_kubeadm_join_command&quot;: &quot;kubeadm join 192.168.1.9:6443 --token abcd1234abcd1234 --discovery-token-ca-cert-hash sha256:abcd1234abcd1234 &quot;</span>
<span style="color:#7F3FBF">}</span>
TASK [Join kubeadm] **********************************************************************************************************************************************************************************************************************
<span style="color:#7F7FFF">skipping: [pi4.filter.home]</span>
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
TASK [Delete user] ***********************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#7F3FBF">ok: [pi4.filter.home]</span>
TASK [reboot] ****************************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">changed: [slave02.filter.home]</span>
<span style="color:#CC3980">changed: [pi4.filter.home]</span>
PLAY RECAP *******************************************************************************************************************************************************************************************************************************
<span style="color:#CC3980">pi4.filter.home</span> : <span style="color:#7F3FBF">ok=15 </span> <span style="color:#CC3980">changed=31 </span> unreachable=0 failed=0 <span style="color:#7f7fff">skipped=2 </span> rescued=0 ignored=0
<span style="color:#CC3980">slave02.filter.home</span> : <span style="color:#7F3FBF">ok=12 </span> <span style="color:#CC3980">changed=23 </span> unreachable=0 failed=0 <span style="color:#7f7fff">skipped=12 </span> rescued=0 ignored=0
</pre>
#### Check cluster status
Pods are deployed correctly
```shell
kubectl get pods --kubeconfig ksetup/Exported/kubeconfig.conf -A
```
```text
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system calico-kube-controllers-85578c44bf-k5sgl 1/1 Running 1 51m
kube-system calico-node-2tn68 1/1 Running 1 (10m ago) 51m
kube-system calico-node-hksmv 1/1 Running 1 (10m ago) 12m
kube-system coredns-5d78c9869d-tblcq 1/1 Running 1 (10m ago) 71m
kube-system coredns-5d78c9869d-vmx8q 1/1 Running 1 (10m ago) 71m
kube-system etcd-pi4.filter.home 1/1 Running 1 (10m ago) 71m
kube-system kube-apiserver-pi4.filter.home 1/1 Running 1 (10m ago) 71m
kube-system kube-controller-manager-pi4.filter.home 1/1 Running 1 (10m ago) 71m
kube-system kube-proxy-cqvws 1/1 Running 1 (10m ago) 12m
kube-system kube-proxy-vwlkx 1/1 Running 1 (10m ago) 71m
kube-system kube-scheduler-pi4.filter.home 1/1 Running 1 (10m ago) 71m
metallb-system controller-595f88d88f-q87gr 1/1 Running 2 51m
metallb-system speaker-5zptn 1/1 Running 2 (8m29s ago) 50m
metallb-system speaker-whw4n 1/1 Running 2 (8m22s ago) 12m
```
# I am here <----
---
## Should add labels to the SE resources etc.
## Difficulties
The Certificate Manager must be located at the same namespace as the `istiod` service, without the LB location being taken into account.