2026-06-30 17:20:09.197588 | Job console starting 2026-06-30 17:20:09.212374 | Updating git repos 2026-06-30 17:20:09.249579 | Cloning repos into workspace 2026-06-30 17:20:09.309304 | Restoring repo states 2026-06-30 17:20:09.319844 | Merging changes 2026-06-30 17:20:09.839429 | Checking out repos 2026-06-30 17:20:09.884811 | Preparing playbooks 2026-06-30 17:20:10.679228 | Running Ansible setup 2026-06-30 17:20:15.991666 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-06-30 17:20:16.795824 | 2026-06-30 17:20:16.796047 | PLAY [Base pre] 2026-06-30 17:20:16.815411 | 2026-06-30 17:20:16.815563 | TASK [Setup log path fact] 2026-06-30 17:20:16.846139 | ubuntu-noble-large | ok 2026-06-30 17:20:16.863805 | 2026-06-30 17:20:16.863979 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-30 17:20:16.894471 | ubuntu-noble-large | ok 2026-06-30 17:20:16.904865 | 2026-06-30 17:20:16.904986 | TASK [emit-job-header : Print job information] 2026-06-30 17:20:16.947417 | # Job Information 2026-06-30 17:20:16.947664 | Ansible Version: 2.16.14 2026-06-30 17:20:16.947715 | Job: openstack-project-manager-integration 2026-06-30 17:20:16.947765 | Pipeline: check 2026-06-30 17:20:16.947801 | Executor: 521e9411259a 2026-06-30 17:20:16.947832 | Triggered by: https://github.com/osism/openstack-project-manager/pull/294 2026-06-30 17:20:16.947869 | Event ID: d6a84b30-74a7-11f1-8d13-3f2bd7a9f0ef 2026-06-30 17:20:16.954092 | 2026-06-30 17:20:16.954219 | LOOP [emit-job-header : Print node information] 2026-06-30 17:20:17.083229 | ubuntu-noble-large | ok: 2026-06-30 17:20:17.083685 | ubuntu-noble-large | # Node Information 2026-06-30 17:20:17.083750 | ubuntu-noble-large | Inventory Hostname: ubuntu-noble-large 2026-06-30 17:20:17.083777 | ubuntu-noble-large | Hostname: ubuntu 2026-06-30 17:20:17.083800 | ubuntu-noble-large | Username: zuul 2026-06-30 17:20:17.083820 | ubuntu-noble-large | Distro: Ubuntu 24.04 2026-06-30 17:20:17.083844 | ubuntu-noble-large | Provider: regiocloud-a 2026-06-30 17:20:17.083866 | ubuntu-noble-large | Region: 2026-06-30 17:20:17.083887 | ubuntu-noble-large | Label: ubuntu-noble-large 2026-06-30 17:20:17.083908 | ubuntu-noble-large | Product Name: OpenStack Nova 2026-06-30 17:20:17.083928 | ubuntu-noble-large | Interface IP: 2a13:1a81:8000:3124:f816:3eff:fe70:ecfe 2026-06-30 17:20:17.108159 | 2026-06-30 17:20:17.108342 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-06-30 17:20:17.620373 | ubuntu-noble-large -> localhost | changed 2026-06-30 17:20:17.628761 | 2026-06-30 17:20:17.628914 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-06-30 17:20:18.792716 | ubuntu-noble-large -> localhost | changed 2026-06-30 17:20:18.812017 | 2026-06-30 17:20:18.812261 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-06-30 17:20:19.125409 | ubuntu-noble-large -> localhost | ok 2026-06-30 17:20:19.140949 | 2026-06-30 17:20:19.141154 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-06-30 17:20:19.176447 | ubuntu-noble-large | ok 2026-06-30 17:20:19.199793 | ubuntu-noble-large | included: /var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-06-30 17:20:19.206445 | 2026-06-30 17:20:19.206551 | TASK [add-build-sshkey : Create Temp SSH key] 2026-06-30 17:20:21.885591 | ubuntu-noble-large -> localhost | Generating public/private rsa key pair. 2026-06-30 17:20:21.886126 | ubuntu-noble-large -> localhost | Your identification has been saved in /var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/b4976b3b18474449abb37099dc40d426_id_rsa 2026-06-30 17:20:21.886225 | ubuntu-noble-large -> localhost | Your public key has been saved in /var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/b4976b3b18474449abb37099dc40d426_id_rsa.pub 2026-06-30 17:20:21.886296 | ubuntu-noble-large -> localhost | The key fingerprint is: 2026-06-30 17:20:21.886360 | ubuntu-noble-large -> localhost | SHA256:M7iBhmsRzhOrGQz1g/o3bIN8iOe8yD2NzQlqDUh9tI0 zuul-build-sshkey 2026-06-30 17:20:21.886444 | ubuntu-noble-large -> localhost | The key's randomart image is: 2026-06-30 17:20:21.886502 | ubuntu-noble-large -> localhost | +---[RSA 3072]----+ 2026-06-30 17:20:21.886557 | ubuntu-noble-large -> localhost | | . | 2026-06-30 17:20:21.886612 | ubuntu-noble-large -> localhost | | . o . | 2026-06-30 17:20:21.886663 | ubuntu-noble-large -> localhost | |. = + + | 2026-06-30 17:20:21.886713 | ubuntu-noble-large -> localhost | |o= * E o | 2026-06-30 17:20:21.886765 | ubuntu-noble-large -> localhost | |=.B + o S | 2026-06-30 17:20:21.886828 | ubuntu-noble-large -> localhost | |.O X o o | 2026-06-30 17:20:21.886930 | ubuntu-noble-large -> localhost | |+ % & o | 2026-06-30 17:20:21.886984 | ubuntu-noble-large -> localhost | |.O.B B | 2026-06-30 17:20:21.887060 | ubuntu-noble-large -> localhost | |o.+o. | 2026-06-30 17:20:21.887116 | ubuntu-noble-large -> localhost | +----[SHA256]-----+ 2026-06-30 17:20:21.887251 | ubuntu-noble-large -> localhost | ok: Runtime: 0:00:02.118205 2026-06-30 17:20:21.901860 | 2026-06-30 17:20:21.902070 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-06-30 17:20:21.939633 | ubuntu-noble-large | ok 2026-06-30 17:20:21.956077 | ubuntu-noble-large | included: /var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-06-30 17:20:21.965092 | 2026-06-30 17:20:21.965204 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-06-30 17:20:21.989711 | ubuntu-noble-large | skipping: Conditional result was False 2026-06-30 17:20:21.997263 | 2026-06-30 17:20:21.997387 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-06-30 17:20:22.834802 | ubuntu-noble-large | changed 2026-06-30 17:20:22.844020 | 2026-06-30 17:20:22.844175 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-06-30 17:20:23.162280 | ubuntu-noble-large | ok 2026-06-30 17:20:23.169692 | 2026-06-30 17:20:23.169808 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-06-30 17:20:23.948021 | ubuntu-noble-large | changed 2026-06-30 17:20:23.953900 | 2026-06-30 17:20:23.954015 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-06-30 17:20:24.772579 | ubuntu-noble-large | changed 2026-06-30 17:20:24.778802 | 2026-06-30 17:20:24.778951 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-06-30 17:20:24.804156 | ubuntu-noble-large | skipping: Conditional result was False 2026-06-30 17:20:24.813625 | 2026-06-30 17:20:24.813775 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-06-30 17:20:25.308521 | ubuntu-noble-large -> localhost | changed 2026-06-30 17:20:25.322242 | 2026-06-30 17:20:25.322406 | TASK [add-build-sshkey : Add back temp key] 2026-06-30 17:20:25.671012 | ubuntu-noble-large -> localhost | Identity added: /var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/b4976b3b18474449abb37099dc40d426_id_rsa (zuul-build-sshkey) 2026-06-30 17:20:25.671390 | ubuntu-noble-large -> localhost | ok: Runtime: 0:00:00.019000 2026-06-30 17:20:25.678886 | 2026-06-30 17:20:25.678996 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-06-30 17:20:26.187096 | ubuntu-noble-large | ok 2026-06-30 17:20:26.198528 | 2026-06-30 17:20:26.198829 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-06-30 17:20:26.236374 | ubuntu-noble-large | skipping: Conditional result was False 2026-06-30 17:20:26.258326 | 2026-06-30 17:20:26.258493 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-06-30 17:20:26.817408 | ubuntu-noble-large | ok 2026-06-30 17:20:26.832600 | 2026-06-30 17:20:26.832744 | TASK [validate-host : Define zuul_info_dir fact] 2026-06-30 17:20:26.879399 | ubuntu-noble-large | ok 2026-06-30 17:20:26.887698 | 2026-06-30 17:20:26.887843 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-06-30 17:20:27.209281 | ubuntu-noble-large -> localhost | ok 2026-06-30 17:20:27.216968 | 2026-06-30 17:20:27.217113 | TASK [validate-host : Collect information about the host] 2026-06-30 17:20:28.707831 | ubuntu-noble-large | ok 2026-06-30 17:20:28.772537 | 2026-06-30 17:20:28.772687 | TASK [validate-host : Sanitize hostname] 2026-06-30 17:20:28.839378 | ubuntu-noble-large | ok 2026-06-30 17:20:28.848581 | 2026-06-30 17:20:28.848779 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-06-30 17:20:29.443292 | ubuntu-noble-large -> localhost | changed 2026-06-30 17:20:29.458715 | 2026-06-30 17:20:29.458924 | TASK [validate-host : Collect information about zuul worker] 2026-06-30 17:20:29.952501 | ubuntu-noble-large | ok 2026-06-30 17:20:29.960109 | 2026-06-30 17:20:29.960272 | TASK [validate-host : Write out all zuul information for each host] 2026-06-30 17:20:30.573268 | ubuntu-noble-large -> localhost | changed 2026-06-30 17:20:30.586709 | 2026-06-30 17:20:30.586895 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-06-30 17:20:30.927570 | ubuntu-noble-large | ok 2026-06-30 17:20:30.938168 | 2026-06-30 17:20:30.938344 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-06-30 17:20:31.891759 | ubuntu-noble-large | changed: 2026-06-30 17:20:31.892465 | ubuntu-noble-large | cd+++++++++ src/ 2026-06-30 17:20:31.892567 | ubuntu-noble-large | cd+++++++++ src/github.com/ 2026-06-30 17:20:31.892616 | ubuntu-noble-large | cd+++++++++ src/github.com/osism/ 2026-06-30 17:20:31.892655 | ubuntu-noble-large | cd+++++++++ src/github.com/osism/openstack-project-manager/ 2026-06-30 17:20:31.892690 | ubuntu-noble-large | 2026-06-30 17:27:38.931023 | ubuntu-noble-large | deletion_time n/a 2026-06-30 17:27:38.931039 | ubuntu-noble-large | destroyed false 2026-06-30 17:27:38.931052 | ubuntu-noble-large | version 1 2026-06-30 17:27:38.952328 | ubuntu-noble-large | [2026-06-30T17:27:38Z] Secret 'kv-v2/infrastructure/mariadb' written. 2026-06-30 17:27:38.956921 | ubuntu-noble-large | [2026-06-30T17:27:38Z] --- Seeding ControlPlane 'openstack/controlplane' (keystone='controlplane-keystone') --- 2026-06-30 17:27:39.427193 | ubuntu-noble-large | [2026-06-30T17:27:39Z] Writing secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin'... 2026-06-30 17:27:40.084680 | ubuntu-noble-large | ======================= Secret Path ======================= 2026-06-30 17:27:40.084846 | ubuntu-noble-large | kv-v2/data/bootstrap/openstack/controlplane-keystone/admin 2026-06-30 17:27:40.084870 | ubuntu-noble-large | 2026-06-30 17:27:40.084978 | ubuntu-noble-large | ======= Metadata ======= 2026-06-30 17:27:40.084999 | ubuntu-noble-large | Key Value 2026-06-30 17:27:40.085021 | ubuntu-noble-large | --- ----- 2026-06-30 17:27:40.085039 | ubuntu-noble-large | created_time 2026-06-30T17:27:40.066278622Z 2026-06-30 17:27:40.085056 | ubuntu-noble-large | custom_metadata 2026-06-30 17:27:40.085081 | ubuntu-noble-large | deletion_time n/a 2026-06-30 17:27:40.085099 | ubuntu-noble-large | destroyed false 2026-06-30 17:27:40.085116 | ubuntu-noble-large | version 1 2026-06-30 17:27:40.105380 | ubuntu-noble-large | [2026-06-30T17:27:40Z] Secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' written. 2026-06-30 17:27:40.107987 | ubuntu-noble-large | [2026-06-30T17:27:40Z] Marking 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' as managed-by=external-secrets (ESO PushSecret adoption)... 2026-06-30 17:27:40.530245 | ubuntu-noble-large | Success! Data written to: kv-v2/metadata/bootstrap/openstack/controlplane-keystone/admin 2026-06-30 17:27:40.550641 | ubuntu-noble-large | [2026-06-30T17:27:40Z] Secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' marked ESO-managed. 2026-06-30 17:27:40.985865 | ubuntu-noble-large | [2026-06-30T17:27:40Z] Writing secret 'kv-v2/openstack/keystone/openstack/controlplane/db'... 2026-06-30 17:27:41.708251 | ubuntu-noble-large | ===================== Secret Path ===================== 2026-06-30 17:27:41.708349 | ubuntu-noble-large | kv-v2/data/openstack/keystone/openstack/controlplane/db 2026-06-30 17:27:41.708366 | ubuntu-noble-large | 2026-06-30 17:27:41.708379 | ubuntu-noble-large | ======= Metadata ======= 2026-06-30 17:27:41.708390 | ubuntu-noble-large | Key Value 2026-06-30 17:27:41.708400 | ubuntu-noble-large | --- ----- 2026-06-30 17:27:41.708410 | ubuntu-noble-large | created_time 2026-06-30T17:27:41.641184471Z 2026-06-30 17:27:41.708422 | ubuntu-noble-large | custom_metadata 2026-06-30 17:27:41.708432 | ubuntu-noble-large | deletion_time n/a 2026-06-30 17:27:41.708441 | ubuntu-noble-large | destroyed false 2026-06-30 17:27:41.708451 | ubuntu-noble-large | version 1 2026-06-30 17:27:41.730580 | ubuntu-noble-large | [2026-06-30T17:27:41Z] Secret 'kv-v2/openstack/keystone/openstack/controlplane/db' written. 2026-06-30 17:27:41.735167 | ubuntu-noble-large | [2026-06-30T17:27:41Z] Marking 'kv-v2/openstack/keystone/openstack/controlplane/db' as managed-by=external-secrets (ESO PushSecret adoption)... 2026-06-30 17:27:42.210516 | ubuntu-noble-large | Success! Data written to: kv-v2/metadata/openstack/keystone/openstack/controlplane/db 2026-06-30 17:27:42.230319 | ubuntu-noble-large | [2026-06-30T17:27:42Z] Secret 'kv-v2/openstack/keystone/openstack/controlplane/db' marked ESO-managed. 2026-06-30 17:27:42.234123 | ubuntu-noble-large | [2026-06-30T17:27:42Z] === Done === 2026-06-30 17:27:42.239930 | ubuntu-noble-large | [2026-06-30T17:27:42Z] write-bootstrap-secrets.sh completed. 2026-06-30 17:27:42.244840 | ubuntu-noble-large | [2026-06-30T17:27:42Z] All bootstrap scripts completed. 2026-06-30 17:27:42.254475 | ubuntu-noble-large | [2026-06-30T17:27:42Z] Waiting up to 300s for pods with selector 'app.kubernetes.io/name=openbao' in namespace 'openbao-system' to be Ready... 2026-06-30 17:27:42.544686 | ubuntu-noble-large | [2026-06-30T17:27:42Z] All 1 pod(s) with selector 'app.kubernetes.io/name=openbao' in 'openbao-system' are Ready. 2026-06-30 17:27:42.552783 | ubuntu-noble-large | [2026-06-30T17:27:42Z] Forcing ESO ClusterSecretStore re-validation and ExternalSecret re-sync... 2026-06-30 17:27:42.678590 | ubuntu-noble-large | clustersecretstore.external-secrets.io/openbao-cluster-store annotated 2026-06-30 17:27:42.893784 | ubuntu-noble-large | clustersecretstore.external-secrets.io/openbao-cluster-store condition met 2026-06-30 17:27:43.051212 | ubuntu-noble-large | externalsecret.external-secrets.io/keystone-admin annotated 2026-06-30 17:27:43.193989 | ubuntu-noble-large | externalsecret.external-secrets.io/keystone-db annotated 2026-06-30 17:27:43.349984 | ubuntu-noble-large | externalsecret.external-secrets.io/mariadb-root-password annotated 2026-06-30 17:27:43.360169 | ubuntu-noble-large | [2026-06-30T17:27:43Z] === Step 8/8: Wait for ExternalSecrets === 2026-06-30 17:27:43.370374 | ubuntu-noble-large | [2026-06-30T17:27:43Z] Waiting up to 120s for ExternalSecrets to sync in namespace 'openstack': keystone-admin keystone-db mariadb-root-password 2026-06-30 17:27:43.893029 | ubuntu-noble-large | [2026-06-30T17:27:43Z] ExternalSecret 'mariadb-root-password' not synced yet (reason: SecretSynced). 2026-06-30 17:27:54.373101 | ubuntu-noble-large | [2026-06-30T17:27:54Z] All ExternalSecrets are synced. 2026-06-30 17:27:54.378356 | ubuntu-noble-large | [2026-06-30T17:27:54Z] === WITH_CONTROLPLANE: bringing up the c5c3 ControlPlane stack === 2026-06-30 17:27:54.625578 | ubuntu-noble-large | helmrelease.helm.toolkit.fluxcd.io/keystone-operator condition met 2026-06-30 17:27:54.843662 | ubuntu-noble-large | kustomization.kustomize.toolkit.fluxcd.io/k-orc condition met 2026-06-30 17:27:55.091863 | ubuntu-noble-large | helmrelease.helm.toolkit.fluxcd.io/c5c3-operator condition met 2026-06-30 17:28:21.190599 | ubuntu-noble-large | [2026-06-30T17:28:21Z] Preloaded ghcr.io/c5c3/keystone:2025.2 into kind. 2026-06-30 17:28:21.194576 | ubuntu-noble-large | [2026-06-30T17:28:21Z] Operator stack is up. The ControlPlane CR is NOT applied automatically — 2026-06-30 17:28:21.199140 | ubuntu-noble-large | [2026-06-30T17:28:21Z] create and apply it yourself (see docs/quick-start-controlplane.md), e.g.: 2026-06-30 17:28:21.203252 | ubuntu-noble-large | [2026-06-30T17:28:21Z] kubectl apply -f deploy/kind/controlplane/controlplane.yaml 2026-06-30 17:28:21.208436 | ubuntu-noble-large | [2026-06-30T17:28:21Z] Name the CR 'controlplane' (CONTROLPLANE_NAME must match the applied 2026-06-30 17:28:21.212773 | ubuntu-noble-large | [2026-06-30T17:28:21Z] CR name — the per-CR Model B admin-password bootstrap path and the projected 2026-06-30 17:28:21.216088 | ubuntu-noble-large | [2026-06-30T17:28:21Z] controlplane-keystone Service both derive from it; set CONTROLPLANE_NAME 2026-06-30 17:28:21.219790 | ubuntu-noble-large | [2026-06-30T17:28:21Z] to change it); 2026-06-30 17:28:21.223078 | ubuntu-noble-large | [2026-06-30T17:28:21Z] on a KIND_HOST_PORT override set spec.services.keystone.publicEndpoint to 2026-06-30 17:28:21.226049 | ubuntu-noble-large | [2026-06-30T17:28:21Z] the matching : URL. Or re-run with WITH_CONTROLPLANE_CR=true to apply 2026-06-30 17:28:21.231079 | ubuntu-noble-large | [2026-06-30T17:28:21Z] the bundled CR for you. 2026-06-30 17:28:21.233955 | ubuntu-noble-large | [2026-06-30T17:28:21Z] 2026-06-30 17:28:21.237835 | ubuntu-noble-large | [2026-06-30T17:28:21Z] ========================================== 2026-06-30 17:28:21.240921 | ubuntu-noble-large | [2026-06-30T17:28:21Z] Infrastructure deployment complete! 2026-06-30 17:28:21.244213 | ubuntu-noble-large | [2026-06-30T17:28:21Z] ========================================== 2026-06-30 17:28:21.247361 | ubuntu-noble-large | [2026-06-30T17:28:21Z] Cluster: forge 2026-06-30 17:28:21.252190 | ubuntu-noble-large | [2026-06-30T17:28:21Z] To tear down: make teardown-infra 2026-06-30 17:28:21.254191 | ubuntu-noble-large | make[1]: Leaving directory '/tmp/opm-forge' 2026-06-30 17:28:21.622196 | ubuntu-noble-large | controlplane.c5c3.io/controlplane created 2026-06-30 17:28:21.892415 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:28:37.168157 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:28:52.434503 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:29:07.690611 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:29:22.955260 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:29:38.200010 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:29:53.439391 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:30:08.687924 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:30:23.943193 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-06-30 17:30:39.221948 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:30:54.486732 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:31:09.738118 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:31:25.038035 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:31:40.297985 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:31:55.564747 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:32:10.825797 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:32:26.091687 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:32:41.337926 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:32:56.593191 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:33:11.835766 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:33:27.083963 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:33:42.333432 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:33:57.582944 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:34:12.835389 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:34:28.099505 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:34:43.368718 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:34:58.645001 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:35:13.887960 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:35:29.156605 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:35:44.391395 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:35:59.656094 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:36:14.903923 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:36:30.182915 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:36:45.426700 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:37:00.686501 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:37:15.930794 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:37:31.208161 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:37:46.470777 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:38:01.718794 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:38:16.982079 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:38:32.234228 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:38:47.502326 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:39:02.758617 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:39:18.032418 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:39:33.285682 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:39:48.514870 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:40:03.756753 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:40:19.033547 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:40:34.315334 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:40:49.560102 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:41:04.820957 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:41:20.095352 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:41:35.328274 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:41:50.560646 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:42:05.802839 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:42:21.089742 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:42:36.350076 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:42:51.610067 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:43:06.889952 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:43:22.152334 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-06-30 17:43:22.156753 | ubuntu-noble-large | ERROR: ControlPlane/controlplane not Ready after 900s. 2026-06-30 17:43:22.253969 | ubuntu-noble-large | apiVersion: c5c3.io/v1alpha1 2026-06-30 17:43:22.254080 | ubuntu-noble-large | kind: ControlPlane 2026-06-30 17:43:22.254099 | ubuntu-noble-large | metadata: 2026-06-30 17:43:22.254136 | ubuntu-noble-large | annotations: 2026-06-30 17:43:22.254150 | ubuntu-noble-large | kubectl.kubernetes.io/last-applied-configuration: | 2026-06-30 17:43:22.254195 | ubuntu-noble-large | {"apiVersion":"c5c3.io/v1alpha1","kind":"ControlPlane","metadata":{"annotations":{},"name":"controlplane","namespace":"openstack"},"spec":{"openStackRelease":"2025.2","services":{"keystone":{"gateway":{"hostname":"keystone.127-0-0-1.nip.io","parentRef":{"name":"openstack-gw"},"path":"/"},"publicEndpoint":"https://keystone.127-0-0-1.nip.io:8443/v3","replicas":1}}}} 2026-06-30 17:43:22.254214 | ubuntu-noble-large | creationTimestamp: "2026-06-30T17:28:21Z" 2026-06-30 17:43:22.254228 | ubuntu-noble-large | generation: 1 2026-06-30 17:43:22.254241 | ubuntu-noble-large | name: controlplane 2026-06-30 17:43:22.254253 | ubuntu-noble-large | namespace: openstack 2026-06-30 17:43:22.254265 | ubuntu-noble-large | resourceVersion: "4967" 2026-06-30 17:43:22.254277 | ubuntu-noble-large | uid: 509f0d79-e2f9-4fa2-8629-2e5c434d8d33 2026-06-30 17:43:22.254290 | ubuntu-noble-large | spec: 2026-06-30 17:43:22.254302 | ubuntu-noble-large | infrastructure: 2026-06-30 17:43:22.254314 | ubuntu-noble-large | cache: 2026-06-30 17:43:22.254327 | ubuntu-noble-large | backend: dogpile.cache.pymemcache 2026-06-30 17:43:22.254342 | ubuntu-noble-large | clusterRef: 2026-06-30 17:43:22.254357 | ubuntu-noble-large | name: openstack-memcached 2026-06-30 17:43:22.254369 | ubuntu-noble-large | replicas: 3 2026-06-30 17:43:22.254381 | ubuntu-noble-large | database: 2026-06-30 17:43:22.254394 | ubuntu-noble-large | clusterRef: 2026-06-30 17:43:22.254406 | ubuntu-noble-large | name: openstack-db 2026-06-30 17:43:22.254418 | ubuntu-noble-large | database: keystone 2026-06-30 17:43:22.254430 | ubuntu-noble-large | secretRef: 2026-06-30 17:43:22.254442 | ubuntu-noble-large | name: keystone-db 2026-06-30 17:43:22.254454 | ubuntu-noble-large | korc: 2026-06-30 17:43:22.254466 | ubuntu-noble-large | adminCredential: 2026-06-30 17:43:22.254478 | ubuntu-noble-large | applicationCredential: 2026-06-30 17:43:22.254491 | ubuntu-noble-large | restricted: true 2026-06-30 17:43:22.254503 | ubuntu-noble-large | rotation: 2026-06-30 17:43:22.254514 | ubuntu-noble-large | mode: PasswordDriven 2026-06-30 17:43:22.254526 | ubuntu-noble-large | cloudCredentialsRef: 2026-06-30 17:43:22.254538 | ubuntu-noble-large | cloudName: admin 2026-06-30 17:43:22.254551 | ubuntu-noble-large | secretName: k-orc-clouds-yaml 2026-06-30 17:43:22.254563 | ubuntu-noble-large | passwordSecretRef: 2026-06-30 17:43:22.254576 | ubuntu-noble-large | key: password 2026-06-30 17:43:22.254588 | ubuntu-noble-large | name: keystone-admin 2026-06-30 17:43:22.254600 | ubuntu-noble-large | openStackRelease: "2025.2" 2026-06-30 17:43:22.254611 | ubuntu-noble-large | region: RegionOne 2026-06-30 17:43:22.254624 | ubuntu-noble-large | services: 2026-06-30 17:43:22.254636 | ubuntu-noble-large | keystone: 2026-06-30 17:43:22.254648 | ubuntu-noble-large | gateway: 2026-06-30 17:43:22.254660 | ubuntu-noble-large | hostname: keystone.127-0-0-1.nip.io 2026-06-30 17:43:22.254672 | ubuntu-noble-large | parentRef: 2026-06-30 17:43:22.254684 | ubuntu-noble-large | name: openstack-gw 2026-06-30 17:43:22.254696 | ubuntu-noble-large | path: / 2026-06-30 17:43:22.254708 | ubuntu-noble-large | publicEndpoint: https://keystone.127-0-0-1.nip.io:8443/v3 2026-06-30 17:43:22.254720 | ubuntu-noble-large | replicas: 1 2026-06-30 17:43:22.254732 | ubuntu-noble-large | status: 2026-06-30 17:43:22.254744 | ubuntu-noble-large | conditions: 2026-06-30 17:43:22.254756 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:37Z" 2026-06-30 17:43:22.254768 | ubuntu-noble-large | message: All managed backing services are ensured and ready 2026-06-30 17:43:22.254780 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.254792 | ubuntu-noble-large | reason: InfrastructureReady 2026-06-30 17:43:22.254830 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.254841 | ubuntu-noble-large | type: InfrastructureReady 2026-06-30 17:43:22.254851 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:28:21Z" 2026-06-30 17:43:22.254861 | ubuntu-noble-large | message: One or more sub-conditions are not ready 2026-06-30 17:43:22.254871 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.254923 | ubuntu-noble-large | reason: NotAllReady 2026-06-30 17:43:22.254934 | ubuntu-noble-large | status: "False" 2026-06-30 17:43:22.254944 | ubuntu-noble-large | type: Ready 2026-06-30 17:43:22.254954 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:37Z" 2026-06-30 17:43:22.254964 | ubuntu-noble-large | message: DB credential ExternalSecret is Ready 2026-06-30 17:43:22.254974 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.254983 | ubuntu-noble-large | reason: DBCredentialsReady 2026-06-30 17:43:22.254993 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.255003 | ubuntu-noble-large | type: DBCredentialsReady 2026-06-30 17:43:22.255013 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:38Z" 2026-06-30 17:43:22.255022 | ubuntu-noble-large | message: admin password ExternalSecret is Ready 2026-06-30 17:43:22.255032 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.255042 | ubuntu-noble-large | reason: AdminPasswordReady 2026-06-30 17:43:22.255052 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.255061 | ubuntu-noble-large | type: AdminPasswordReady 2026-06-30 17:43:22.255071 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:38Z" 2026-06-30 17:43:22.255081 | ubuntu-noble-large | message: Keystone "controlplane-keystone" is not ready 2026-06-30 17:43:22.255091 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.255100 | ubuntu-noble-large | reason: WaitingForKeystone 2026-06-30 17:43:22.255175 | ubuntu-noble-large | status: "False" 2026-06-30 17:43:22.255188 | ubuntu-noble-large | type: KeystoneReady 2026-06-30 17:43:22.255198 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.255208 | ubuntu-noble-large | services: 2026-06-30 17:43:22.255218 | ubuntu-noble-large | - name: keystone 2026-06-30 17:43:22.255229 | ubuntu-noble-large | ready: false 2026-06-30 17:43:22.255239 | ubuntu-noble-large | release: "2025.2" 2026-06-30 17:43:22.255248 | ubuntu-noble-large | updatePhase: Idle 2026-06-30 17:43:22.260549 | ubuntu-noble-large | === Diagnostics for kind cluster forge === 2026-06-30 17:43:22.392978 | ubuntu-noble-large | NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME 2026-06-30 17:43:22.393085 | ubuntu-noble-large | forge-control-plane Ready control-plane 20m v1.36.1 172.18.0.2 Debian GNU/Linux 13 (trixie) 6.8.0-124-generic (amd64) containerd://2.3.1 2026-06-30 17:43:22.573227 | ubuntu-noble-large | NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES 2026-06-30 17:43:22.573336 | ubuntu-noble-large | c5c3-system c5c3-operator-575bfd968-gtmwg 1/1 Running 0 16m 10.244.0.30 forge-control-plane 2026-06-30 17:43:22.573351 | ubuntu-noble-large | c5c3-system c5c3-operator-575bfd968-lskhv 1/1 Running 0 16m 10.244.0.29 forge-control-plane 2026-06-30 17:43:22.573361 | ubuntu-noble-large | cert-manager cert-manager-c767877bd-cstm9 1/1 Running 0 19m 10.244.0.13 forge-control-plane 2026-06-30 17:43:22.573370 | ubuntu-noble-large | cert-manager cert-manager-cainjector-78fdbbf665-cvwwl 1/1 Running 0 19m 10.244.0.12 forge-control-plane 2026-06-30 17:43:22.573380 | ubuntu-noble-large | cert-manager cert-manager-webhook-66986b64b9-v5kvj 1/1 Running 0 19m 10.244.0.14 forge-control-plane 2026-06-30 17:43:22.573388 | ubuntu-noble-large | envoy-gateway-system envoy-gateway-5649586748-vh4tj 1/1 Running 0 18m 10.244.0.24 forge-control-plane 2026-06-30 17:43:22.573397 | ubuntu-noble-large | envoy-gateway-system envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz 2/2 Running 0 17m 10.244.0.26 forge-control-plane 2026-06-30 17:43:22.573465 | ubuntu-noble-large | external-secrets external-secrets-5958b59f7d-99snd 1/1 Running 0 18m 10.244.0.21 forge-control-plane 2026-06-30 17:43:22.573476 | ubuntu-noble-large | external-secrets external-secrets-cert-controller-97b69894c-bgqpp 1/1 Running 0 18m 10.244.0.22 forge-control-plane 2026-06-30 17:43:22.573500 | ubuntu-noble-large | external-secrets external-secrets-webhook-6955d84bd5-nkw8q 1/1 Running 0 18m 10.244.0.20 forge-control-plane 2026-06-30 17:43:22.573517 | ubuntu-noble-large | flux-system flux-operator-6d97c88bb-4td2g 1/1 Running 0 19m 10.244.0.5 forge-control-plane 2026-06-30 17:43:22.573527 | ubuntu-noble-large | flux-system flux-web-f67d8b54-qgs4k 1/1 Running 0 19m 10.244.0.10 forge-control-plane 2026-06-30 17:43:22.573536 | ubuntu-noble-large | flux-system helm-controller-5b8ccd78f5-s5kgf 1/1 Running 0 19m 10.244.0.6 forge-control-plane 2026-06-30 17:43:22.573545 | ubuntu-noble-large | flux-system kustomize-controller-6d4c587654-hq25t 1/1 Running 0 19m 10.244.0.7 forge-control-plane 2026-06-30 17:43:22.573553 | ubuntu-noble-large | flux-system notification-controller-9655667cb-wvkvm 1/1 Running 0 19m 10.244.0.8 forge-control-plane 2026-06-30 17:43:22.573562 | ubuntu-noble-large | flux-system source-controller-7664869465-7l9z5 1/1 Running 0 19m 10.244.0.9 forge-control-plane 2026-06-30 17:43:22.573571 | ubuntu-noble-large | headlamp-system headlamp-796ff44f7b-p8tzk 1/1 Running 0 19m 10.244.0.11 forge-control-plane 2026-06-30 17:43:22.573580 | ubuntu-noble-large | keystone-system keystone-operator-66cf7cbc64-nfjgj 1/1 Running 0 16m 10.244.0.27 forge-control-plane 2026-06-30 17:43:22.573589 | ubuntu-noble-large | keystone-system keystone-operator-66cf7cbc64-nrgp8 1/1 Running 0 16m 10.244.0.28 forge-control-plane 2026-06-30 17:43:22.573598 | ubuntu-noble-large | kube-system coredns-589f44dc88-cvvzv 1/1 Running 0 20m 10.244.0.2 forge-control-plane 2026-06-30 17:43:22.573607 | ubuntu-noble-large | kube-system coredns-589f44dc88-k47gc 1/1 Running 0 20m 10.244.0.4 forge-control-plane 2026-06-30 17:43:22.573615 | ubuntu-noble-large | kube-system etcd-forge-control-plane 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573624 | ubuntu-noble-large | kube-system kindnet-xkrds 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573633 | ubuntu-noble-large | kube-system kube-apiserver-forge-control-plane 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573642 | ubuntu-noble-large | kube-system kube-controller-manager-forge-control-plane 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573656 | ubuntu-noble-large | kube-system kube-proxy-2kffz 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573665 | ubuntu-noble-large | kube-system kube-scheduler-forge-control-plane 1/1 Running 0 20m 172.18.0.2 forge-control-plane 2026-06-30 17:43:22.573681 | ubuntu-noble-large | local-path-storage local-path-provisioner-855c7b7774-76gqd 1/1 Running 0 20m 10.244.0.3 forge-control-plane 2026-06-30 17:43:22.573690 | ubuntu-noble-large | mariadb-system mariadb-operator-756fd78967-5ckvj 1/1 Running 0 18m 10.244.0.18 forge-control-plane 2026-06-30 17:43:22.573699 | ubuntu-noble-large | mariadb-system mariadb-operator-cert-controller-58b95fd98-8cp66 1/1 Running 0 18m 10.244.0.19 forge-control-plane 2026-06-30 17:43:22.573708 | ubuntu-noble-large | mariadb-system mariadb-operator-webhook-67d6d5db7b-jjz64 1/1 Running 0 18m 10.244.0.23 forge-control-plane 2026-06-30 17:43:22.573717 | ubuntu-noble-large | memcached-system memcached-operator-869dfff548-bz9mc 1/1 Running 0 18m 10.244.0.25 forge-control-plane 2026-06-30 17:43:22.573726 | ubuntu-noble-large | openbao-system openbao-0 1/1 Running 0 18m 10.244.0.31 forge-control-plane 2026-06-30 17:43:22.573735 | ubuntu-noble-large | openstack controlplane-keystone-6d68dcd67c-7p6jq 0/1 OOMKilled 7 (5m23s ago) 11m 10.244.0.47 forge-control-plane 2026-06-30 17:43:22.573754 | ubuntu-noble-large | openstack controlplane-keystone-db-sync-q9p8d 0/1 Completed 0 12m 10.244.0.45 forge-control-plane 2026-06-30 17:43:22.573763 | ubuntu-noble-large | openstack controlplane-keystone-schema-check-7gg4q 0/1 Completed 0 11m 10.244.0.46 forge-control-plane 2026-06-30 17:43:22.573777 | ubuntu-noble-large | openstack openstack-db-0 2/2 Running 0 14m 10.244.0.42 forge-control-plane 2026-06-30 17:43:22.573786 | ubuntu-noble-large | openstack openstack-db-1 2/2 Running 0 14m 10.244.0.43 forge-control-plane 2026-06-30 17:43:22.573805 | ubuntu-noble-large | openstack openstack-db-2 2/2 Running 0 14m 10.244.0.44 forge-control-plane 2026-06-30 17:43:22.573814 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-l95d8 1/1 Running 0 15m 10.244.0.32 forge-control-plane 2026-06-30 17:43:22.573823 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-n9kjr 1/1 Running 0 15m 10.244.0.34 forge-control-plane 2026-06-30 17:43:22.573832 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-pljfj 1/1 Running 0 15m 10.244.0.33 forge-control-plane 2026-06-30 17:43:22.573841 | ubuntu-noble-large | orc-system orc-controller-manager-7bd5ff7754-47mgx 1/1 Running 0 19m 10.244.0.15 forge-control-plane 2026-06-30 17:43:22.701637 | ubuntu-noble-large | apiVersion: v1 2026-06-30 17:43:22.701731 | ubuntu-noble-large | items: 2026-06-30 17:43:22.701744 | ubuntu-noble-large | - apiVersion: c5c3.io/v1alpha1 2026-06-30 17:43:22.701755 | ubuntu-noble-large | kind: ControlPlane 2026-06-30 17:43:22.701763 | ubuntu-noble-large | metadata: 2026-06-30 17:43:22.701771 | ubuntu-noble-large | annotations: 2026-06-30 17:43:22.701780 | ubuntu-noble-large | kubectl.kubernetes.io/last-applied-configuration: | 2026-06-30 17:43:22.701791 | ubuntu-noble-large | {"apiVersion":"c5c3.io/v1alpha1","kind":"ControlPlane","metadata":{"annotations":{},"name":"controlplane","namespace":"openstack"},"spec":{"openStackRelease":"2025.2","services":{"keystone":{"gateway":{"hostname":"keystone.127-0-0-1.nip.io","parentRef":{"name":"openstack-gw"},"path":"/"},"publicEndpoint":"https://keystone.127-0-0-1.nip.io:8443/v3","replicas":1}}}} 2026-06-30 17:43:22.701842 | ubuntu-noble-large | creationTimestamp: "2026-06-30T17:28:21Z" 2026-06-30 17:43:22.701853 | ubuntu-noble-large | generation: 1 2026-06-30 17:43:22.701861 | ubuntu-noble-large | name: controlplane 2026-06-30 17:43:22.701869 | ubuntu-noble-large | namespace: openstack 2026-06-30 17:43:22.701909 | ubuntu-noble-large | resourceVersion: "4967" 2026-06-30 17:43:22.701922 | ubuntu-noble-large | uid: 509f0d79-e2f9-4fa2-8629-2e5c434d8d33 2026-06-30 17:43:22.701930 | ubuntu-noble-large | spec: 2026-06-30 17:43:22.701938 | ubuntu-noble-large | infrastructure: 2026-06-30 17:43:22.701946 | ubuntu-noble-large | cache: 2026-06-30 17:43:22.701953 | ubuntu-noble-large | backend: dogpile.cache.pymemcache 2026-06-30 17:43:22.701961 | ubuntu-noble-large | clusterRef: 2026-06-30 17:43:22.701969 | ubuntu-noble-large | name: openstack-memcached 2026-06-30 17:43:22.701977 | ubuntu-noble-large | replicas: 3 2026-06-30 17:43:22.701985 | ubuntu-noble-large | database: 2026-06-30 17:43:22.701992 | ubuntu-noble-large | clusterRef: 2026-06-30 17:43:22.702000 | ubuntu-noble-large | name: openstack-db 2026-06-30 17:43:22.702008 | ubuntu-noble-large | database: keystone 2026-06-30 17:43:22.702016 | ubuntu-noble-large | secretRef: 2026-06-30 17:43:22.702023 | ubuntu-noble-large | name: keystone-db 2026-06-30 17:43:22.702031 | ubuntu-noble-large | korc: 2026-06-30 17:43:22.702039 | ubuntu-noble-large | adminCredential: 2026-06-30 17:43:22.702047 | ubuntu-noble-large | applicationCredential: 2026-06-30 17:43:22.702054 | ubuntu-noble-large | restricted: true 2026-06-30 17:43:22.702062 | ubuntu-noble-large | rotation: 2026-06-30 17:43:22.702070 | ubuntu-noble-large | mode: PasswordDriven 2026-06-30 17:43:22.702078 | ubuntu-noble-large | cloudCredentialsRef: 2026-06-30 17:43:22.702086 | ubuntu-noble-large | cloudName: admin 2026-06-30 17:43:22.702093 | ubuntu-noble-large | secretName: k-orc-clouds-yaml 2026-06-30 17:43:22.702101 | ubuntu-noble-large | passwordSecretRef: 2026-06-30 17:43:22.702158 | ubuntu-noble-large | key: password 2026-06-30 17:43:22.702167 | ubuntu-noble-large | name: keystone-admin 2026-06-30 17:43:22.702175 | ubuntu-noble-large | openStackRelease: "2025.2" 2026-06-30 17:43:22.702183 | ubuntu-noble-large | region: RegionOne 2026-06-30 17:43:22.702191 | ubuntu-noble-large | services: 2026-06-30 17:43:22.702198 | ubuntu-noble-large | keystone: 2026-06-30 17:43:22.702206 | ubuntu-noble-large | gateway: 2026-06-30 17:43:22.702214 | ubuntu-noble-large | hostname: keystone.127-0-0-1.nip.io 2026-06-30 17:43:22.702222 | ubuntu-noble-large | parentRef: 2026-06-30 17:43:22.702229 | ubuntu-noble-large | name: openstack-gw 2026-06-30 17:43:22.702237 | ubuntu-noble-large | path: / 2026-06-30 17:43:22.702245 | ubuntu-noble-large | publicEndpoint: https://keystone.127-0-0-1.nip.io:8443/v3 2026-06-30 17:43:22.702253 | ubuntu-noble-large | replicas: 1 2026-06-30 17:43:22.702261 | ubuntu-noble-large | status: 2026-06-30 17:43:22.702269 | ubuntu-noble-large | conditions: 2026-06-30 17:43:22.702277 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:37Z" 2026-06-30 17:43:22.702285 | ubuntu-noble-large | message: All managed backing services are ensured and ready 2026-06-30 17:43:22.702292 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702300 | ubuntu-noble-large | reason: InfrastructureReady 2026-06-30 17:43:22.702308 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.702316 | ubuntu-noble-large | type: InfrastructureReady 2026-06-30 17:43:22.702324 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:28:21Z" 2026-06-30 17:43:22.702332 | ubuntu-noble-large | message: One or more sub-conditions are not ready 2026-06-30 17:43:22.702340 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702348 | ubuntu-noble-large | reason: NotAllReady 2026-06-30 17:43:22.702356 | ubuntu-noble-large | status: "False" 2026-06-30 17:43:22.702364 | ubuntu-noble-large | type: Ready 2026-06-30 17:43:22.702371 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:37Z" 2026-06-30 17:43:22.702379 | ubuntu-noble-large | message: DB credential ExternalSecret is Ready 2026-06-30 17:43:22.702387 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702395 | ubuntu-noble-large | reason: DBCredentialsReady 2026-06-30 17:43:22.702402 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.702410 | ubuntu-noble-large | type: DBCredentialsReady 2026-06-30 17:43:22.702418 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:38Z" 2026-06-30 17:43:22.702426 | ubuntu-noble-large | message: admin password ExternalSecret is Ready 2026-06-30 17:43:22.702433 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702441 | ubuntu-noble-large | reason: AdminPasswordReady 2026-06-30 17:43:22.702449 | ubuntu-noble-large | status: "True" 2026-06-30 17:43:22.702457 | ubuntu-noble-large | type: AdminPasswordReady 2026-06-30 17:43:22.702473 | ubuntu-noble-large | - lastTransitionTime: "2026-06-30T17:30:38Z" 2026-06-30 17:43:22.702482 | ubuntu-noble-large | message: Keystone "controlplane-keystone" is not ready 2026-06-30 17:43:22.702489 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702497 | ubuntu-noble-large | reason: WaitingForKeystone 2026-06-30 17:43:22.702505 | ubuntu-noble-large | status: "False" 2026-06-30 17:43:22.702513 | ubuntu-noble-large | type: KeystoneReady 2026-06-30 17:43:22.702520 | ubuntu-noble-large | observedGeneration: 1 2026-06-30 17:43:22.702528 | ubuntu-noble-large | services: 2026-06-30 17:43:22.702536 | ubuntu-noble-large | - name: keystone 2026-06-30 17:43:22.702544 | ubuntu-noble-large | ready: false 2026-06-30 17:43:22.702551 | ubuntu-noble-large | release: "2025.2" 2026-06-30 17:43:22.702559 | ubuntu-noble-large | updatePhase: Idle 2026-06-30 17:43:22.702567 | ubuntu-noble-large | kind: List 2026-06-30 17:43:22.702575 | ubuntu-noble-large | metadata: 2026-06-30 17:43:22.702582 | ubuntu-noble-large | resourceVersion: "" 2026-06-30 17:43:22.979479 | ubuntu-noble-large | NAMESPACE LAST SEEN TYPE REASON OBJECT MESSAGE 2026-06-30 17:43:22.979542 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-06-30 17:43:22.979550 | ubuntu-noble-large | default 20m Normal Starting node/forge-control-plane 2026-06-30 17:43:22.979560 | ubuntu-noble-large | openstack 15m Normal Created memcached/openstack-memcached Created Deployment openstack-memcached 2026-06-30 17:43:22.979565 | ubuntu-noble-large | openstack 15m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-06-30 17:43:22.979569 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-06-30 17:43:22.979573 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-06-30 17:43:22.979578 | ubuntu-noble-large | default 20m Normal NodeHasSufficientMemory node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientMemory 2026-06-30 17:43:22.979590 | ubuntu-noble-large | default 20m Normal NodeHasNoDiskPressure node/forge-control-plane Node forge-control-plane status is now: NodeHasNoDiskPressure 2026-06-30 17:43:22.979594 | ubuntu-noble-large | default 20m Normal NodeAllocatableEnforced node/forge-control-plane Updated Node Allocatable limit across pods 2026-06-30 17:43:22.979598 | ubuntu-noble-large | default 20m Normal Starting node/forge-control-plane Starting kubelet. 2026-06-30 17:43:22.979602 | ubuntu-noble-large | default 20m Normal NodeHasSufficientPID node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientPID 2026-06-30 17:43:22.979624 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/kube-scheduler-forge-control-plane Container image "registry.k8s.io/kube-scheduler:v1.36.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.979639 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/kube-controller-manager-forge-control-plane Container image "registry.k8s.io/kube-controller-manager:v1.36.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.979644 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/etcd-forge-control-plane Container image "registry.k8s.io/etcd:3.6.8-0" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.979664 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/kube-apiserver-forge-control-plane Container image "registry.k8s.io/kube-apiserver:v1.36.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.979669 | ubuntu-noble-large | kube-system 20m Normal Created pod/etcd-forge-control-plane Container created 2026-06-30 17:43:22.979673 | ubuntu-noble-large | kube-system 20m Normal Started pod/etcd-forge-control-plane Container started 2026-06-30 17:43:22.979677 | ubuntu-noble-large | kube-system 20m Normal Created pod/kube-controller-manager-forge-control-plane Container created 2026-06-30 17:43:22.979682 | ubuntu-noble-large | kube-system 20m Normal Started pod/kube-apiserver-forge-control-plane Container started 2026-06-30 17:43:22.979686 | ubuntu-noble-large | kube-system 20m Normal Started pod/kube-controller-manager-forge-control-plane Container started 2026-06-30 17:43:22.979694 | ubuntu-noble-large | kube-system 20m Normal Started pod/kube-scheduler-forge-control-plane Container started 2026-06-30 17:43:22.979697 | ubuntu-noble-large | kube-system 20m Normal Created pod/kube-scheduler-forge-control-plane Container created 2026-06-30 17:43:22.979701 | ubuntu-noble-large | kube-system 20m Normal Created pod/kube-apiserver-forge-control-plane Container created 2026-06-30 17:43:22.979708 | ubuntu-noble-large | default 20m Normal NodeHasSufficientMemory node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientMemory 2026-06-30 17:43:22.979712 | ubuntu-noble-large | default 20m Normal NodeHasNoDiskPressure node/forge-control-plane Node forge-control-plane status is now: NodeHasNoDiskPressure 2026-06-30 17:43:22.979716 | ubuntu-noble-large | default 20m Normal NodeAllocatableEnforced node/forge-control-plane Updated Node Allocatable limit across pods 2026-06-30 17:43:22.979722 | ubuntu-noble-large | kube-system 20m Normal LeaderElection lease/kube-controller-manager forge-control-plane_f1b6068c-2e08-427f-8571-ee8a84cb1a78 became leader 2026-06-30 17:43:22.979726 | ubuntu-noble-large | default 20m Normal Starting node/forge-control-plane Starting kubelet. 2026-06-30 17:43:22.979730 | ubuntu-noble-large | default 20m Normal NodeHasSufficientPID node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientPID 2026-06-30 17:43:22.979736 | ubuntu-noble-large | kube-system 20m Warning Unhealthy pod/kube-scheduler-forge-control-plane Readiness probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:22.979744 | ubuntu-noble-large | kube-system 20m Normal LeaderElection lease/kube-scheduler forge-control-plane_0c333d98-ebf5-4d45-bf74-c34598a1e148 became leader 2026-06-30 17:43:22.979761 | ubuntu-noble-large | default 20m Normal RegisteredNode node/forge-control-plane Node forge-control-plane event: Registered Node forge-control-plane in Controller 2026-06-30 17:43:22.979770 | ubuntu-noble-large | kube-system 20m Normal SuccessfulCreate daemonset/kube-proxy Created pod: kube-proxy-2kffz 2026-06-30 17:43:22.979788 | ubuntu-noble-large | kube-system 20m Warning FailedScheduling pod/coredns-589f44dc88-k47gc 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-06-30 17:43:22.979797 | ubuntu-noble-large | local-path-storage 20m Normal SuccessfulCreate replicaset/local-path-provisioner-855c7b7774 Created pod: local-path-provisioner-855c7b7774-76gqd 2026-06-30 17:43:22.979803 | ubuntu-noble-large | kube-system 20m Normal Scheduled pod/kube-proxy-2kffz Successfully assigned kube-system/kube-proxy-2kffz to forge-control-plane 2026-06-30 17:43:22.979814 | ubuntu-noble-large | local-path-storage 20m Normal ScalingReplicaSet deployment/local-path-provisioner Scaled up replica set local-path-provisioner-855c7b7774 from 0 to 1 2026-06-30 17:43:22.979828 | ubuntu-noble-large | local-path-storage 20m Warning FailedScheduling pod/local-path-provisioner-855c7b7774-76gqd 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-06-30 17:43:22.979843 | ubuntu-noble-large | kube-system 20m Warning FailedScheduling pod/coredns-589f44dc88-cvvzv 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-06-30 17:43:22.979859 | ubuntu-noble-large | kube-system 20m Normal SuccessfulCreate replicaset/coredns-589f44dc88 Created pod: coredns-589f44dc88-cvvzv 2026-06-30 17:43:22.979893 | ubuntu-noble-large | kube-system 20m Normal SuccessfulCreate replicaset/coredns-589f44dc88 Created pod: coredns-589f44dc88-k47gc 2026-06-30 17:43:22.979903 | ubuntu-noble-large | kube-system 20m Normal ScalingReplicaSet deployment/coredns Scaled up replica set coredns-589f44dc88 from 0 to 2 2026-06-30 17:43:22.979919 | ubuntu-noble-large | kube-system 20m Normal SuccessfulCreate daemonset/kindnet Created pod: kindnet-xkrds 2026-06-30 17:43:22.979944 | ubuntu-noble-large | kube-system 20m Normal Scheduled pod/kindnet-xkrds Successfully assigned kube-system/kindnet-xkrds to forge-control-plane 2026-06-30 17:43:22.980010 | ubuntu-noble-large | kube-system 20m Normal Created pod/kube-proxy-2kffz Container created 2026-06-30 17:43:22.980016 | ubuntu-noble-large | kube-system 20m Normal Started pod/kube-proxy-2kffz Container started 2026-06-30 17:43:22.980020 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/kube-proxy-2kffz Container image "registry.k8s.io/kube-proxy:v1.36.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.980025 | ubuntu-noble-large | kube-system 20m Normal Pulled pod/kindnet-xkrds Container image "docker.io/kindest/kindnetd:v20260528-9350166c" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.980029 | ubuntu-noble-large | kube-system 20m Normal Created pod/kindnet-xkrds Container created 2026-06-30 17:43:22.980033 | ubuntu-noble-large | kube-system 20m Normal Started pod/kindnet-xkrds Container started 2026-06-30 17:43:22.980044 | ubuntu-noble-large | kube-system 19m Normal Scheduled pod/coredns-589f44dc88-cvvzv Successfully assigned kube-system/coredns-589f44dc88-cvvzv to forge-control-plane 2026-06-30 17:43:22.980049 | ubuntu-noble-large | local-path-storage 19m Normal Scheduled pod/local-path-provisioner-855c7b7774-76gqd Successfully assigned local-path-storage/local-path-provisioner-855c7b7774-76gqd to forge-control-plane 2026-06-30 17:43:22.980059 | ubuntu-noble-large | kube-system 19m Normal Scheduled pod/coredns-589f44dc88-k47gc Successfully assigned kube-system/coredns-589f44dc88-k47gc to forge-control-plane 2026-06-30 17:43:22.980067 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/coredns-589f44dc88-cvvzv Container image "registry.k8s.io/coredns/coredns:v1.14.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.980081 | ubuntu-noble-large | default 19m Normal NodeReady node/forge-control-plane Node forge-control-plane status is now: NodeReady 2026-06-30 17:43:22.980088 | ubuntu-noble-large | local-path-storage 19m Normal Pulled pod/local-path-provisioner-855c7b7774-76gqd Container image "docker.io/kindest/local-path-provisioner:v20260521-9fb22683" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.980097 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/coredns-589f44dc88-k47gc Container image "registry.k8s.io/coredns/coredns:v1.14.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.980129 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/flux-operator Scaled up replica set flux-operator-6d97c88bb from 0 to 1 2026-06-30 17:43:22.980181 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/flux-operator-6d97c88bb Created pod: flux-operator-6d97c88bb-4td2g 2026-06-30 17:43:22.980190 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/flux-operator-6d97c88bb-4td2g Successfully assigned flux-system/flux-operator-6d97c88bb-4td2g to forge-control-plane 2026-06-30 17:43:22.980199 | ubuntu-noble-large | kube-system 19m Normal Started pod/coredns-589f44dc88-cvvzv Container started 2026-06-30 17:43:22.980219 | ubuntu-noble-large | kube-system 19m Warning Unhealthy pod/coredns-589f44dc88-cvvzv Readiness probe failed: Get "http://10.244.0.2:8181/ready": dial tcp 10.244.0.2:8181: connect: connection refused 2026-06-30 17:43:22.980237 | ubuntu-noble-large | local-path-storage 19m Normal Started pod/local-path-provisioner-855c7b7774-76gqd Container started 2026-06-30 17:43:22.980260 | ubuntu-noble-large | local-path-storage 19m Normal Created pod/local-path-provisioner-855c7b7774-76gqd Container created 2026-06-30 17:43:22.980283 | ubuntu-noble-large | kube-system 19m Normal Created pod/coredns-589f44dc88-cvvzv Container created 2026-06-30 17:43:22.980308 | ubuntu-noble-large | flux-system 19m Normal Pulling pod/flux-operator-6d97c88bb-4td2g Pulling image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" 2026-06-30 17:43:22.980328 | ubuntu-noble-large | kube-system 19m Normal Created pod/coredns-589f44dc88-k47gc Container created 2026-06-30 17:43:22.980361 | ubuntu-noble-large | kube-system 19m Warning Unhealthy pod/coredns-589f44dc88-k47gc Readiness probe failed: Get "http://10.244.0.4:8181/ready": dial tcp 10.244.0.4:8181: connect: connection refused 2026-06-30 17:43:22.980377 | ubuntu-noble-large | kube-system 19m Normal Started pod/coredns-589f44dc88-k47gc Container started 2026-06-30 17:43:22.980406 | ubuntu-noble-large | flux-system 19m Normal LeaderElection lease/flux-operator flux-operator-6d97c88bb-4td2g_e547a671-fd47-471c-842c-0b2386edbf8f became leader 2026-06-30 17:43:22.980429 | ubuntu-noble-large | flux-system 19m Normal Started pod/flux-operator-6d97c88bb-4td2g Container started 2026-06-30 17:43:22.980452 | ubuntu-noble-large | flux-system 19m Normal Created pod/flux-operator-6d97c88bb-4td2g Container created 2026-06-30 17:43:22.980479 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/flux-operator-6d97c88bb-4td2g Successfully pulled image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" in 3.573s (3.573s including waiting). Image size: 28865342 bytes. 2026-06-30 17:43:22.980504 | ubuntu-noble-large | flux-system 19m Normal Progressing fluxinstance/flux Installing revision v2.8.8@sha256:f9561cf88335caa347a61eed1c7fdcdcaf21e0b143cead9002c3ca5c644e0ad9 2026-06-30 17:43:22.980525 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/source-controller-7664869465 Created pod: source-controller-7664869465-7l9z5 2026-06-30 17:43:22.980552 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/helm-controller Scaled up replica set helm-controller-5b8ccd78f5 from 0 to 1 2026-06-30 17:43:22.980573 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/notification-controller-9655667cb Created pod: notification-controller-9655667cb-wvkvm 2026-06-30 17:43:22.980597 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/notification-controller-9655667cb-wvkvm Successfully assigned flux-system/notification-controller-9655667cb-wvkvm to forge-control-plane 2026-06-30 17:43:22.980621 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/source-controller-7664869465-7l9z5 Successfully assigned flux-system/source-controller-7664869465-7l9z5 to forge-control-plane 2026-06-30 17:43:22.980644 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/helm-controller-5b8ccd78f5-s5kgf Successfully assigned flux-system/helm-controller-5b8ccd78f5-s5kgf to forge-control-plane 2026-06-30 17:43:22.980693 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/source-controller Scaled up replica set source-controller-7664869465 from 0 to 1 2026-06-30 17:43:22.980700 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/kustomize-controller Scaled up replica set kustomize-controller-6d4c587654 from 0 to 1 2026-06-30 17:43:22.980718 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/kustomize-controller-6d4c587654 Created pod: kustomize-controller-6d4c587654-hq25t 2026-06-30 17:43:22.980750 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/kustomize-controller-6d4c587654-hq25t Successfully assigned flux-system/kustomize-controller-6d4c587654-hq25t to forge-control-plane 2026-06-30 17:43:22.980795 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/notification-controller Scaled up replica set notification-controller-9655667cb from 0 to 1 2026-06-30 17:43:22.980830 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/helm-controller-5b8ccd78f5 Created pod: helm-controller-5b8ccd78f5-s5kgf 2026-06-30 17:43:22.980901 | ubuntu-noble-large | flux-system 19m Normal Pulling pod/helm-controller-5b8ccd78f5-s5kgf Pulling image "ghcr.io/fluxcd/helm-controller:v1.5.5@sha256:b4b8f7715cc7cb61382eeb82bea108d1bdd965b00e7192c5dc9ab7436a33658b" 2026-06-30 17:43:22.980925 | ubuntu-noble-large | flux-system 19m Normal Pulling pod/kustomize-controller-6d4c587654-hq25t Pulling image "ghcr.io/fluxcd/kustomize-controller:v1.8.5@sha256:70e2a25edeee82690e68662409fb1b60f7d3084c93435e8ab5337a6e0244ffed" 2026-06-30 17:43:22.980944 | ubuntu-noble-large | flux-system 19m Normal Pulling pod/source-controller-7664869465-7l9z5 Pulling image "ghcr.io/fluxcd/source-controller:v1.8.5@sha256:65172e2405cf95b92c4b00cefd28d5e8ffd1f81d6d097f85c6e83a9c557c9def" 2026-06-30 17:43:22.980973 | ubuntu-noble-large | flux-system 19m Normal Pulling pod/notification-controller-9655667cb-wvkvm Pulling image "ghcr.io/fluxcd/notification-controller:v1.8.4@sha256:75842ecfcca4397a788051d6b00ec34f96ea74788c92d9c360fc4d196ea04551" 2026-06-30 17:43:22.981000 | ubuntu-noble-large | flux-system 19m Warning Unhealthy pod/helm-controller-5b8ccd78f5-s5kgf Readiness probe failed: Get "http://10.244.0.6:9440/readyz": dial tcp 10.244.0.6:9440: connect: connection refused 2026-06-30 17:43:22.981040 | ubuntu-noble-large | flux-system 19m Normal Started pod/helm-controller-5b8ccd78f5-s5kgf Container started 2026-06-30 17:43:22.981080 | ubuntu-noble-large | flux-system 19m Normal Created pod/helm-controller-5b8ccd78f5-s5kgf Container created 2026-06-30 17:43:22.981176 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/helm-controller-5b8ccd78f5-s5kgf Successfully pulled image "ghcr.io/fluxcd/helm-controller:v1.5.5@sha256:b4b8f7715cc7cb61382eeb82bea108d1bdd965b00e7192c5dc9ab7436a33658b" in 4.259s (4.259s including waiting). Image size: 51275265 bytes. 2026-06-30 17:43:22.981188 | ubuntu-noble-large | flux-system 19m Normal LeaderElection lease/helm-controller-leader-election helm-controller-5b8ccd78f5-s5kgf_802f6083-2510-47b9-841b-d686fbd6c2c8 became leader 2026-06-30 17:43:22.981212 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/kustomize-controller-6d4c587654-hq25t Successfully pulled image "ghcr.io/fluxcd/kustomize-controller:v1.8.5@sha256:70e2a25edeee82690e68662409fb1b60f7d3084c93435e8ab5337a6e0244ffed" in 4.075s (8.295s including waiting). Image size: 68335774 bytes. 2026-06-30 17:43:22.981236 | ubuntu-noble-large | flux-system 19m Normal Created pod/kustomize-controller-6d4c587654-hq25t Container created 2026-06-30 17:43:22.981260 | ubuntu-noble-large | flux-system 19m Warning Unhealthy pod/kustomize-controller-6d4c587654-hq25t Readiness probe failed: Get "http://10.244.0.7:9440/readyz": dial tcp 10.244.0.7:9440: connect: connection refused 2026-06-30 17:43:22.981284 | ubuntu-noble-large | flux-system 19m Normal Started pod/kustomize-controller-6d4c587654-hq25t Container started 2026-06-30 17:43:22.981307 | ubuntu-noble-large | flux-system 19m Normal LeaderElection lease/kustomize-controller-leader-election kustomize-controller-6d4c587654-hq25t_fc82bc89-6547-4775-b959-c5fe37489503 became leader 2026-06-30 17:43:22.981355 | ubuntu-noble-large | flux-system 19m Warning Unhealthy pod/notification-controller-9655667cb-wvkvm Readiness probe failed: Get "http://10.244.0.8:9440/readyz": dial tcp 10.244.0.8:9440: connect: connection refused 2026-06-30 17:43:22.981363 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/notification-controller-9655667cb-wvkvm Successfully pulled image "ghcr.io/fluxcd/notification-controller:v1.8.4@sha256:75842ecfcca4397a788051d6b00ec34f96ea74788c92d9c360fc4d196ea04551" in 4.619s (12.877s including waiting). Image size: 49859918 bytes. 2026-06-30 17:43:22.981368 | ubuntu-noble-large | flux-system 19m Normal Created pod/notification-controller-9655667cb-wvkvm Container created 2026-06-30 17:43:22.981374 | ubuntu-noble-large | flux-system 19m Normal Started pod/notification-controller-9655667cb-wvkvm Container started 2026-06-30 17:43:22.981388 | ubuntu-noble-large | flux-system 19m Normal LeaderElection lease/notification-controller-leader-election notification-controller-9655667cb-wvkvm_08dcf4cf-62bc-4385-be7c-f03dae35a0ad became leader 2026-06-30 17:43:22.981412 | ubuntu-noble-large | flux-system 19m Normal Created pod/source-controller-7664869465-7l9z5 Container created 2026-06-30 17:43:22.981436 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/source-controller-7664869465-7l9z5 Successfully pulled image "ghcr.io/fluxcd/source-controller:v1.8.5@sha256:65172e2405cf95b92c4b00cefd28d5e8ffd1f81d6d097f85c6e83a9c557c9def" in 4.46s (17.321s including waiting). Image size: 63986975 bytes. 2026-06-30 17:43:22.981458 | ubuntu-noble-large | flux-system 19m Normal LeaderElection lease/source-controller-leader-election source-controller-7664869465-7l9z5_1d5e1698-4661-42f5-b0ae-ed6f60397bfc became leader 2026-06-30 17:43:22.981482 | ubuntu-noble-large | flux-system 19m Warning Unhealthy pod/source-controller-7664869465-7l9z5 Readiness probe failed: Get "http://10.244.0.9:9090/": dial tcp 10.244.0.9:9090: connect: connection refused 2026-06-30 17:43:22.981505 | ubuntu-noble-large | flux-system 19m Normal Started pod/source-controller-7664869465-7l9z5 Container started 2026-06-30 17:43:22.981531 | ubuntu-noble-large | flux-system 19m Normal ReconciliationSucceeded fluxinstance/flux Flux v2.8.8 installed... 2026-06-30 17:43:22.981554 | ubuntu-noble-large | flux-system 19m Normal ReconciliationSucceeded fluxinstance/flux Reconciliation finished in 22s 2026-06-30 17:43:22.981577 | ubuntu-noble-large | cert-manager 19m Normal HelmChartCreated helmrelease/cert-manager Created HelmChart/flux-system/cert-manager-cert-manager with SourceRef 'HelmRepository/flux-system/cert-manager' 2026-06-30 17:43:22.981603 | ubuntu-noble-large | c5c3-system 19m Normal HelmChartCreated helmrelease/c5c3-operator Created HelmChart/flux-system/c5c3-system-c5c3-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-06-30 17:43:22.981627 | ubuntu-noble-large | flux-system 19m Normal ApplySucceeded resourceset/flux-web HelmRelease/flux-system/flux-web created... 2026-06-30 17:43:22.981667 | ubuntu-noble-large | flux-system 19m Normal ReconciliationSucceeded resourceset/flux-web Reconciliation finished in 83ms 2026-06-30 17:43:22.981672 | ubuntu-noble-large | keystone-system 19m Normal HelmChartCreated helmrelease/keystone-operator Created HelmChart/flux-system/keystone-system-keystone-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-06-30 17:43:22.981686 | ubuntu-noble-large | headlamp-system 19m Normal HelmChartCreated helmrelease/headlamp Created HelmChart/flux-system/headlamp-system-headlamp with SourceRef 'HelmRepository/flux-system/headlamp' 2026-06-30 17:43:22.981702 | ubuntu-noble-large | openbao-system 19m Normal HelmChartCreated helmrelease/openbao Created HelmChart/flux-system/openbao-system-openbao with SourceRef 'HelmRepository/flux-system/openbao' 2026-06-30 17:43:22.981726 | ubuntu-noble-large | flux-system 19m Normal NewArtifact helmrepository/headlamp stored fetched index of size 98.89kB from 'https://kubernetes-sigs.github.io/headlamp/' 2026-06-30 17:43:22.982410 | ubuntu-noble-large | mariadb-system 19m Normal HelmChartCreated helmrelease/mariadb-operator-crds Created HelmChart/flux-system/mariadb-system-mariadb-operator-crds with SourceRef 'HelmRepository/flux-system/mariadb-operator' 2026-06-30 17:43:22.982472 | ubuntu-noble-large | envoy-gateway-system 19m Normal HelmChartCreated helmrelease/envoy-gateway Created HelmChart/flux-system/envoy-gateway-system-envoy-gateway with SourceRef 'HelmRepository/flux-system/envoy-gateway-charts' 2026-06-30 17:43:22.982483 | ubuntu-noble-large | external-secrets 19m Normal HelmChartCreated helmrelease/external-secrets Created HelmChart/flux-system/external-secrets-external-secrets with SourceRef 'HelmRepository/flux-system/external-secrets' 2026-06-30 17:43:22.982490 | ubuntu-noble-large | mariadb-system 19m Normal HelmChartCreated helmrelease/mariadb-operator Created HelmChart/flux-system/mariadb-system-mariadb-operator with SourceRef 'HelmRepository/flux-system/mariadb-operator' 2026-06-30 17:43:22.982509 | ubuntu-noble-large | flux-system 19m Normal NewArtifact helmrepository/mariadb-operator stored fetched index of size 105.7kB from 'https://mariadb-operator.github.io/mariadb-operator' 2026-06-30 17:43:22.982516 | ubuntu-noble-large | memcached-system 19m Normal HelmChartCreated helmrelease/memcached-operator Created HelmChart/flux-system/memcached-system-memcached-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-06-30 17:43:22.982523 | ubuntu-noble-large | flux-system 19m Normal NewArtifact helmrepository/external-secrets stored fetched index of size 143.9kB from 'https://charts.external-secrets.io' 2026-06-30 17:43:22.982531 | ubuntu-noble-large | flux-system 19m Normal NewArtifact helmrepository/cert-manager stored fetched index of size 570.3kB from 'https://charts.jetstack.io' 2026-06-30 17:43:22.982537 | ubuntu-noble-large | monitoring 19m Normal HelmChartCreated helmrelease/prometheus-operator-crds Created HelmChart/flux-system/monitoring-prometheus-operator-crds with SourceRef 'HelmRepository/flux-system/prometheus-community' 2026-06-30 17:43:22.982721 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/cert-manager-cert-manager pulled 'cert-manager' chart with version 'v1.20.3' 2026-06-30 17:43:22.982733 | ubuntu-noble-large | flux-system 19m Normal ArtifactUpToDate helmrepository/headlamp artifact up-to-date with remote revision: 'sha256:7d33b5253b618e96c774f0f782a22e0c3863fca0095f3aa46faf6c005b39c27b' 2026-06-30 17:43:22.982741 | ubuntu-noble-large | flux-system 19m Normal ArtifactUpToDate helmrepository/openbao artifact up-to-date with remote revision: 'sha256:2c3c2150dbd2cd38ff701bac5bcb7ed3d8aafbb0e4a4f152b583c6282f372868' 2026-06-30 17:43:22.982764 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/external-secrets-external-secrets pulled 'external-secrets' chart with version '0.20.4' 2026-06-30 17:43:22.982771 | ubuntu-noble-large | flux-system 19m Normal ArtifactUpToDate helmrepository/external-secrets artifact up-to-date with remote revision: 'sha256:172e4dbf6ac03ea2cf1cfd3d835f31c56dadd9698185fd667744845938cc055a' 2026-06-30 17:43:22.982798 | ubuntu-noble-large | flux-system 19m Normal ArtifactUpToDate helmrepository/mariadb-operator artifact up-to-date with remote revision: 'sha256:7f48d1a62b45a948ed6f710145ee3f36da382fa5cfab9a48aad0917244bf94c8' 2026-06-30 17:43:22.982806 | ubuntu-noble-large | flux-system 19m Normal NewArtifact helmrepository/openbao stored fetched index of size 93.63kB from 'https://openbao.github.io/openbao-helm' 2026-06-30 17:43:22.982812 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/keystone-system-keystone-operator pulled 'keystone-operator' chart with version '0.5.0' 2026-06-30 17:43:22.982829 | ubuntu-noble-large | flux-system 19m Normal NewArtifact ocirepository/flux-web stored artifact with revision '0.52.0@sha256:e25cf78b888fb82afadcb0c06bbb3dce8c5c5d0313e304ce67b6a7744977e458' from 'oci://ghcr.io/controlplaneio-fluxcd/charts/flux-operator' 2026-06-30 17:43:22.982837 | ubuntu-noble-large | flux-system 19m Normal SuccessfulCreate replicaset/flux-web-f67d8b54 Created pod: flux-web-f67d8b54-qgs4k 2026-06-30 17:43:22.982843 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/c5c3-system-c5c3-operator pulled 'c5c3-operator' chart with version '0.3.0' 2026-06-30 17:43:22.982849 | ubuntu-noble-large | flux-system 19m Normal Scheduled pod/flux-web-f67d8b54-qgs4k Successfully assigned flux-system/flux-web-f67d8b54-qgs4k to forge-control-plane 2026-06-30 17:43:22.982855 | ubuntu-noble-large | flux-system 19m Normal NewArtifact gitrepository/k-orc stored artifact for commit 'Release v2.5.0' 2026-06-30 17:43:22.982862 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/envoy-gateway-system-envoy-gateway pulled 'gateway-helm' chart with version '1.8.1' 2026-06-30 17:43:22.982868 | ubuntu-noble-large | flux-system 19m Normal ScalingReplicaSet deployment/flux-web Scaled up replica set flux-web-f67d8b54 from 0 to 1 2026-06-30 17:43:22.982875 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/mariadb-system-mariadb-operator pulled 'mariadb-operator' chart with version '0.38.1' 2026-06-30 17:43:22.982918 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/headlamp-system-headlamp pulled 'headlamp' chart with version '0.43.0' 2026-06-30 17:43:22.982929 | ubuntu-noble-large | flux-system 19m Normal Pulled pod/flux-web-f67d8b54-qgs4k Container image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.982940 | ubuntu-noble-large | flux-system 19m Normal Started pod/flux-web-f67d8b54-qgs4k Container started 2026-06-30 17:43:22.982961 | ubuntu-noble-large | flux-system 19m Normal Created pod/flux-web-f67d8b54-qgs4k Container created 2026-06-30 17:43:22.982971 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/mariadb-system-mariadb-operator-crds pulled 'mariadb-operator-crds' chart with version '0.38.1' 2026-06-30 17:43:22.982981 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/memcached-system-memcached-operator pulled 'memcached-operator' chart with version '0.4.0' 2026-06-30 17:43:22.982992 | ubuntu-noble-large | headlamp-system 19m Normal Pulling pod/headlamp-796ff44f7b-p8tzk Pulling image "ghcr.io/headlamp-k8s/headlamp-plugin-flux:v0.6.0" 2026-06-30 17:43:22.983003 | ubuntu-noble-large | headlamp-system 19m Normal SuccessfulCreate replicaset/headlamp-796ff44f7b Created pod: headlamp-796ff44f7b-p8tzk 2026-06-30 17:43:22.983013 | ubuntu-noble-large | headlamp-system 19m Normal Scheduled pod/headlamp-796ff44f7b-p8tzk Successfully assigned headlamp-system/headlamp-796ff44f7b-p8tzk to forge-control-plane 2026-06-30 17:43:22.983025 | ubuntu-noble-large | headlamp-system 19m Normal ScalingReplicaSet deployment/headlamp Scaled up replica set headlamp-796ff44f7b from 0 to 1 2026-06-30 17:43:22.983036 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/monitoring-prometheus-operator-crds pulled 'prometheus-operator-crds' chart with version '19.1.0' 2026-06-30 17:43:22.983047 | ubuntu-noble-large | flux-system 19m Normal ChartPullSucceeded helmchart/openbao-system-openbao pulled 'openbao' chart with version '0.28.4' 2026-06-30 17:43:22.983066 | ubuntu-noble-large | cert-manager 19m Normal ScalingReplicaSet deployment/cert-manager-webhook Scaled up replica set cert-manager-webhook-66986b64b9 from 0 to 1 2026-06-30 17:43:22.983078 | ubuntu-noble-large | cert-manager 19m Normal ScalingReplicaSet deployment/cert-manager Scaled up replica set cert-manager-c767877bd from 0 to 1 2026-06-30 17:43:22.983088 | ubuntu-noble-large | cert-manager 19m Normal SuccessfulCreate replicaset/cert-manager-webhook-66986b64b9 Created pod: cert-manager-webhook-66986b64b9-v5kvj 2026-06-30 17:43:22.983143 | ubuntu-noble-large | cert-manager 19m Normal ScalingReplicaSet deployment/cert-manager-cainjector Scaled up replica set cert-manager-cainjector-78fdbbf665 from 0 to 1 2026-06-30 17:43:22.983156 | ubuntu-noble-large | cert-manager 19m Normal SuccessfulCreate replicaset/cert-manager-cainjector-78fdbbf665 Created pod: cert-manager-cainjector-78fdbbf665-cvwwl 2026-06-30 17:43:22.983167 | ubuntu-noble-large | cert-manager 19m Normal SuccessfulCreate replicaset/cert-manager-c767877bd Created pod: cert-manager-c767877bd-cstm9 2026-06-30 17:43:22.983183 | ubuntu-noble-large | cert-manager 19m Normal Pulling pod/cert-manager-webhook-66986b64b9-v5kvj Pulling image "quay.io/jetstack/cert-manager-webhook:v1.20.3" 2026-06-30 17:43:22.983194 | ubuntu-noble-large | cert-manager 19m Normal Scheduled pod/cert-manager-webhook-66986b64b9-v5kvj Successfully assigned cert-manager/cert-manager-webhook-66986b64b9-v5kvj to forge-control-plane 2026-06-30 17:43:22.983205 | ubuntu-noble-large | cert-manager 19m Normal Pulling pod/cert-manager-cainjector-78fdbbf665-cvwwl Pulling image "quay.io/jetstack/cert-manager-cainjector:v1.20.3" 2026-06-30 17:43:22.983224 | ubuntu-noble-large | cert-manager 19m Normal Scheduled pod/cert-manager-cainjector-78fdbbf665-cvwwl Successfully assigned cert-manager/cert-manager-cainjector-78fdbbf665-cvwwl to forge-control-plane 2026-06-30 17:43:22.983236 | ubuntu-noble-large | cert-manager 19m Normal Pulling pod/cert-manager-c767877bd-cstm9 Pulling image "quay.io/jetstack/cert-manager-controller:v1.20.3" 2026-06-30 17:43:22.983247 | ubuntu-noble-large | cert-manager 19m Normal Scheduled pod/cert-manager-c767877bd-cstm9 Successfully assigned cert-manager/cert-manager-c767877bd-cstm9 to forge-control-plane 2026-06-30 17:43:22.983258 | ubuntu-noble-large | headlamp-system 19m Normal Pulled pod/headlamp-796ff44f7b-p8tzk Successfully pulled image "ghcr.io/headlamp-k8s/headlamp-plugin-flux:v0.6.0" in 2.14s (2.14s including waiting). Image size: 3930787 bytes. 2026-06-30 17:43:22.983268 | ubuntu-noble-large | headlamp-system 19m Normal Created pod/headlamp-796ff44f7b-p8tzk Container created 2026-06-30 17:43:22.983279 | ubuntu-noble-large | headlamp-system 19m Normal Started pod/headlamp-796ff44f7b-p8tzk Container started 2026-06-30 17:43:22.983289 | ubuntu-noble-large | orc-system 19m Normal SuccessfulCreate replicaset/orc-controller-manager-7bd5ff7754 Created pod: orc-controller-manager-7bd5ff7754-47mgx 2026-06-30 17:43:22.983300 | ubuntu-noble-large | orc-system 19m Normal ScalingReplicaSet deployment/orc-controller-manager Scaled up replica set orc-controller-manager-7bd5ff7754 from 0 to 1 2026-06-30 17:43:22.983311 | ubuntu-noble-large | headlamp-system 19m Normal Pulling pod/headlamp-796ff44f7b-p8tzk Pulling image "ghcr.io/headlamp-k8s/headlamp:v0.43.0" 2026-06-30 17:43:22.983322 | ubuntu-noble-large | flux-system 19m Normal Progressing kustomization/k-orc CustomResourceDefinition/addressscopes.openstack.k-orc.cloud created... 2026-06-30 17:43:22.983333 | ubuntu-noble-large | orc-system 19m Normal Pulling pod/orc-controller-manager-7bd5ff7754-47mgx Pulling image "quay.io/orc/openstack-resource-controller:v2.5.0" 2026-06-30 17:43:22.983350 | ubuntu-noble-large | orc-system 19m Normal Scheduled pod/orc-controller-manager-7bd5ff7754-47mgx Successfully assigned orc-system/orc-controller-manager-7bd5ff7754-47mgx to forge-control-plane 2026-06-30 17:43:22.983361 | ubuntu-noble-large | cert-manager 18m Normal Started pod/cert-manager-c767877bd-cstm9 Container started 2026-06-30 17:43:22.983373 | ubuntu-noble-large | kube-system 18m Normal LeaderElection lease/cert-manager-controller cert-manager-c767877bd-cstm9-external-cert-manager-controller became leader 2026-06-30 17:43:22.983382 | ubuntu-noble-large | cert-manager 18m Normal Created pod/cert-manager-c767877bd-cstm9 Container created 2026-06-30 17:43:22.983393 | ubuntu-noble-large | cert-manager 18m Normal Pulled pod/cert-manager-c767877bd-cstm9 Successfully pulled image "quay.io/jetstack/cert-manager-controller:v1.20.3" in 4.211s (4.431s including waiting). Image size: 23662428 bytes. 2026-06-30 17:43:22.983409 | ubuntu-noble-large | mariadb-system 18m Normal InstallSucceeded helmrelease/mariadb-operator-crds Helm install succeeded for release mariadb-system/mariadb-operator-crds.v1 with chart mariadb-operator-crds@0.38.1 2026-06-30 17:43:22.983429 | ubuntu-noble-large | cert-manager 18m Normal Pulled pod/cert-manager-webhook-66986b64b9-v5kvj Successfully pulled image "quay.io/jetstack/cert-manager-webhook:v1.20.3" in 2.56s (6.932s including waiting). Image size: 19511753 bytes. 2026-06-30 17:43:22.983440 | ubuntu-noble-large | cert-manager 18m Normal Created pod/cert-manager-webhook-66986b64b9-v5kvj Container created 2026-06-30 17:43:22.983451 | ubuntu-noble-large | cert-manager 18m Normal Started pod/cert-manager-webhook-66986b64b9-v5kvj Container started 2026-06-30 17:43:22.983462 | ubuntu-noble-large | cert-manager 18m Normal Started pod/cert-manager-cainjector-78fdbbf665-cvwwl Container started 2026-06-30 17:43:22.983473 | ubuntu-noble-large | cert-manager 18m Normal Pulled pod/cert-manager-cainjector-78fdbbf665-cvwwl Successfully pulled image "quay.io/jetstack/cert-manager-cainjector:v1.20.3" in 2.762s (9.682s including waiting). Image size: 16409208 bytes. 2026-06-30 17:43:22.983483 | ubuntu-noble-large | cert-manager 18m Normal Created pod/cert-manager-cainjector-78fdbbf665-cvwwl Container created 2026-06-30 17:43:22.983493 | ubuntu-noble-large | kube-system 18m Normal LeaderElection lease/cert-manager-cainjector-leader-election cert-manager-cainjector-78fdbbf665-cvwwl_1c0e2903-9446-48a0-9cc9-2dd1183af00b became leader 2026-06-30 17:43:22.983504 | ubuntu-noble-large | openbao-system 18m Normal DependencyNotReady helmrelease/openbao dependency 'cert-manager/cert-manager' is not ready 2026-06-30 17:43:22.983515 | ubuntu-noble-large | flux-system 18m Normal InstallSucceeded helmrelease/flux-web Helm install succeeded for release flux-system/flux-web.v1 with chart flux-operator@0.52.0+e25cf78b888f 2026-06-30 17:43:22.983526 | ubuntu-noble-large | keystone-system 18m Normal DependencyNotReady helmrelease/keystone-operator dependency 'cert-manager/cert-manager' is not ready 2026-06-30 17:43:22.983537 | ubuntu-noble-large | mariadb-system 18m Normal DependencyNotReady helmrelease/mariadb-operator dependency 'cert-manager/cert-manager' is not ready 2026-06-30 17:43:22.983548 | ubuntu-noble-large | external-secrets 18m Normal DependencyNotReady helmrelease/external-secrets dependency 'cert-manager/cert-manager' is not ready 2026-06-30 17:43:22.983558 | ubuntu-noble-large | headlamp-system 18m Normal Pulled pod/headlamp-796ff44f7b-p8tzk Successfully pulled image "ghcr.io/headlamp-k8s/headlamp:v0.43.0" in 5.609s (13.415s including waiting). Image size: 96655717 bytes. 2026-06-30 17:43:22.983576 | ubuntu-noble-large | headlamp-system 18m Warning Unhealthy pod/headlamp-796ff44f7b-p8tzk Readiness probe failed: Get "http://10.244.0.11:4466/": dial tcp 10.244.0.11:4466: connect: connection refused 2026-06-30 17:43:22.983587 | ubuntu-noble-large | memcached-system 18m Normal DependencyNotReady helmrelease/memcached-operator dependency 'cert-manager/cert-manager' is not ready 2026-06-30 17:43:22.983597 | ubuntu-noble-large | headlamp-system 18m Normal Created pod/headlamp-796ff44f7b-p8tzk Container created 2026-06-30 17:43:22.983609 | ubuntu-noble-large | headlamp-system 18m Normal Started pod/headlamp-796ff44f7b-p8tzk Container started 2026-06-30 17:43:22.983620 | ubuntu-noble-large | envoy-gateway-system 18m Normal Scheduled pod/envoy-gateway-gateway-helm-certgen-5sjvj Successfully assigned envoy-gateway-system/envoy-gateway-gateway-helm-certgen-5sjvj to forge-control-plane 2026-06-30 17:43:22.983638 | ubuntu-noble-large | envoy-gateway-system 18m Normal SuccessfulCreate job/envoy-gateway-gateway-helm-certgen Created pod: envoy-gateway-gateway-helm-certgen-5sjvj 2026-06-30 17:43:22.983649 | ubuntu-noble-large | headlamp-system 18m Normal InstallSucceeded helmrelease/headlamp Helm install succeeded for release headlamp-system/headlamp.v1 with chart headlamp@0.43.0 2026-06-30 17:43:22.983660 | ubuntu-noble-large | envoy-gateway-system 18m Normal Pulling pod/envoy-gateway-gateway-helm-certgen-5sjvj Pulling image "docker.io/envoyproxy/gateway:v1.8.1" 2026-06-30 17:43:22.983670 | ubuntu-noble-large | cert-manager 18m Normal InstallSucceeded helmrelease/cert-manager Helm install succeeded for release cert-manager/cert-manager.v1 with chart cert-manager@v1.20.3 2026-06-30 17:43:22.983681 | ubuntu-noble-large | orc-system 18m Normal Created pod/orc-controller-manager-7bd5ff7754-47mgx Container created 2026-06-30 17:43:22.983691 | ubuntu-noble-large | orc-system 18m Normal Started pod/orc-controller-manager-7bd5ff7754-47mgx Container started 2026-06-30 17:43:22.983702 | ubuntu-noble-large | orc-system 18m Normal Pulled pod/orc-controller-manager-7bd5ff7754-47mgx Successfully pulled image "quay.io/orc/openstack-resource-controller:v2.5.0" in 3.335s (16.714s including waiting). Image size: 38987232 bytes. 2026-06-30 17:43:22.983714 | ubuntu-noble-large | orc-system 18m Normal LeaderElection lease/f35396c5.k-orc.cloud orc-controller-manager-7bd5ff7754-47mgx_5e816e98-4816-437e-8fc7-1869845568e6 became leader 2026-06-30 17:43:22.983725 | ubuntu-noble-large | openbao-system 18m Normal Provisioning persistentvolumeclaim/data-openbao-0 External provisioner is provisioning volume for claim "openbao-system/data-openbao-0" 2026-06-30 17:43:22.983735 | ubuntu-noble-large | openbao-system 18m Normal SuccessfulCreate statefulset/openbao Create Pod openbao-0 in StatefulSet openbao successful 2026-06-30 17:43:22.983759 | ubuntu-noble-large | openbao-system 18m Normal SuccessfulCreate statefulset/openbao Create Claim data-openbao-0 Pod openbao-0 in StatefulSet openbao success 2026-06-30 17:43:22.983770 | ubuntu-noble-large | openbao-system 18m Normal WaitForFirstConsumer persistentvolumeclaim/data-openbao-0 waiting for first consumer to be created before binding 2026-06-30 17:43:22.983781 | ubuntu-noble-large | local-path-storage 18m Normal Pulled pod/helper-pod-create-pvc-c723181f-2c45-4132-aa0b-3c820de10cfe Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.983791 | ubuntu-noble-large | openbao-system 18m Normal InstallSucceeded helmrelease/openbao Helm install succeeded for release openbao-system/openbao.v1 with chart openbao@0.28.4 2026-06-30 17:43:22.983803 | ubuntu-noble-large | envoy-gateway-system 18m Normal Started pod/envoy-gateway-gateway-helm-certgen-5sjvj Container started 2026-06-30 17:43:22.983820 | ubuntu-noble-large | envoy-gateway-system 18m Normal Created pod/envoy-gateway-gateway-helm-certgen-5sjvj Container created 2026-06-30 17:43:22.983831 | ubuntu-noble-large | envoy-gateway-system 18m Normal Pulled pod/envoy-gateway-gateway-helm-certgen-5sjvj Successfully pulled image "docker.io/envoyproxy/gateway:v1.8.1" in 4.683s (5.884s including waiting). Image size: 72818892 bytes. 2026-06-30 17:43:22.983848 | ubuntu-noble-large | local-path-storage 18m Normal Started pod/helper-pod-create-pvc-c723181f-2c45-4132-aa0b-3c820de10cfe Container started 2026-06-30 17:43:22.983859 | ubuntu-noble-large | local-path-storage 18m Normal Created pod/helper-pod-create-pvc-c723181f-2c45-4132-aa0b-3c820de10cfe Container created 2026-06-30 17:43:22.983870 | ubuntu-noble-large | cert-manager 18m Normal Requested certificate/openbao-ca Created new CertificateRequest resource "openbao-ca-1" 2026-06-30 17:43:22.983928 | ubuntu-noble-large | cert-manager 18m Normal CertificateIssued certificaterequest/openbao-ca-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.983945 | ubuntu-noble-large | mariadb-system 18m Normal SuccessfulCreate replicaset/mariadb-operator-756fd78967 Created pod: mariadb-operator-756fd78967-5ckvj 2026-06-30 17:43:22.983956 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.983966 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.983977 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.983988 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.983997 | ubuntu-noble-large | mariadb-system 18m Normal Scheduled pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Successfully assigned mariadb-system/mariadb-operator-cert-controller-58b95fd98-8cp66 to forge-control-plane 2026-06-30 17:43:22.984007 | ubuntu-noble-large | mariadb-system 18m Normal Pulling pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Pulling image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" 2026-06-30 17:43:22.984017 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984023 | ubuntu-noble-large | mariadb-system 18m Normal Pulling pod/mariadb-operator-756fd78967-5ckvj Pulling image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" 2026-06-30 17:43:22.984029 | ubuntu-noble-large | mariadb-system 18m Normal SuccessfulCreate replicaset/mariadb-operator-webhook-67d6d5db7b Created pod: mariadb-operator-webhook-67d6d5db7b-jjz64 2026-06-30 17:43:22.984035 | ubuntu-noble-large | mariadb-system 18m Normal ScalingReplicaSet deployment/mariadb-operator-webhook Scaled up replica set mariadb-operator-webhook-67d6d5db7b from 0 to 1 2026-06-30 17:43:22.984042 | ubuntu-noble-large | mariadb-system 18m Normal Scheduled pod/mariadb-operator-756fd78967-5ckvj Successfully assigned mariadb-system/mariadb-operator-756fd78967-5ckvj to forge-control-plane 2026-06-30 17:43:22.984228 | ubuntu-noble-large | mariadb-system 18m Normal SuccessfulCreate replicaset/mariadb-operator-cert-controller-58b95fd98 Created pod: mariadb-operator-cert-controller-58b95fd98-8cp66 2026-06-30 17:43:22.984237 | ubuntu-noble-large | mariadb-system 18m Normal ScalingReplicaSet deployment/mariadb-operator Scaled up replica set mariadb-operator-756fd78967 from 0 to 1 2026-06-30 17:43:22.984261 | ubuntu-noble-large | mariadb-system 18m Normal ScalingReplicaSet deployment/mariadb-operator-cert-controller Scaled up replica set mariadb-operator-cert-controller-58b95fd98 from 0 to 1 2026-06-30 17:43:22.984276 | ubuntu-noble-large | memcached-system 18m Normal DependencyNotReady helmrelease/memcached-operator dependency 'monitoring/prometheus-operator-crds' is not ready 2026-06-30 17:43:22.984282 | ubuntu-noble-large | openbao-system 18m Normal Issuing certificate/openbao-tls Issuing certificate as Secret does not exist 2026-06-30 17:43:22.984288 | ubuntu-noble-large | default 18m Warning ErrGetKeyPair clusterissuer/openbao-ca-issuer Error getting keypair for CA issuer: secrets "openbao-ca" not found 2026-06-30 17:43:22.984294 | ubuntu-noble-large | cert-manager 18m Normal cert-manager.io certificaterequest/openbao-ca-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.984300 | ubuntu-noble-large | cert-manager 18m Normal Issuing certificate/openbao-ca The certificate has been successfully issued 2026-06-30 17:43:22.984312 | ubuntu-noble-large | mariadb-system 18m Normal Scheduled pod/mariadb-operator-webhook-67d6d5db7b-jjz64 Successfully assigned mariadb-system/mariadb-operator-webhook-67d6d5db7b-jjz64 to forge-control-plane 2026-06-30 17:43:22.984318 | ubuntu-noble-large | cert-manager 18m Normal Generated certificate/openbao-ca Stored new private key in temporary Secret resource "openbao-ca-jghjk" 2026-06-30 17:43:22.984324 | ubuntu-noble-large | cert-manager 18m Normal Issuing certificate/openbao-ca Issuing certificate as Secret does not exist 2026-06-30 17:43:22.984330 | ubuntu-noble-large | default 18m Warning ErrInitIssuer clusterissuer/openbao-ca-issuer Error initializing issuer: secrets "openbao-ca" not found 2026-06-30 17:43:22.984337 | ubuntu-noble-large | openbao-system 18m Normal ExternalProvisioning persistentvolumeclaim/data-openbao-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.984345 | ubuntu-noble-large | openbao-system 18m Normal Generated certificate/openbao-tls Stored new private key in temporary Secret resource "openbao-tls-txrnv" 2026-06-30 17:43:22.984351 | ubuntu-noble-large | default 18m Warning ErrGetKeyPair clusterissuer/openstack-db-ca-issuer Error getting keypair for CA issuer: secrets "openstack-db-ca" not found 2026-06-30 17:43:22.984357 | ubuntu-noble-large | cert-manager 18m Normal cert-manager.io certificaterequest/openstack-db-ca-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.984363 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984370 | ubuntu-noble-large | openbao-system 18m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984376 | ubuntu-noble-large | openbao-system 18m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984388 | ubuntu-noble-large | openbao-system 18m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984399 | ubuntu-noble-large | cert-manager 18m Normal Requested certificate/openstack-db-ca Created new CertificateRequest resource "openstack-db-ca-1" 2026-06-30 17:43:22.984410 | ubuntu-noble-large | cert-manager 18m Normal Generated certificate/openstack-db-ca Stored new private key in temporary Secret resource "openstack-db-ca-xmwcb" 2026-06-30 17:43:22.984427 | ubuntu-noble-large | cert-manager 18m Normal Issuing certificate/openstack-db-ca The certificate has been successfully issued 2026-06-30 17:43:22.984437 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984447 | ubuntu-noble-large | openbao-system 18m Normal Requested certificate/openbao-tls Created new CertificateRequest resource "openbao-tls-1" 2026-06-30 17:43:22.984457 | ubuntu-noble-large | openbao-system 18m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984468 | ubuntu-noble-large | cert-manager 18m Normal Issuing certificate/openstack-db-ca Issuing certificate as Secret does not exist 2026-06-30 17:43:22.984478 | ubuntu-noble-large | cert-manager 18m Normal CertificateIssued certificaterequest/openstack-db-ca-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.984488 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984514 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984521 | ubuntu-noble-large | cert-manager 18m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984527 | ubuntu-noble-large | default 18m Warning ErrInitIssuer clusterissuer/openstack-db-ca-issuer Error initializing issuer: secrets "openstack-db-ca" not found 2026-06-30 17:43:22.984541 | ubuntu-noble-large | openbao-system 18m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.984548 | ubuntu-noble-large | monitoring 18m Normal InstallSucceeded helmrelease/prometheus-operator-crds Helm install succeeded for release monitoring/prometheus-operator-crds.v1 with chart prometheus-operator-crds@19.1.0 2026-06-30 17:43:22.984555 | ubuntu-noble-large | openbao-system 18m Normal Issuing certificate/openbao-tls The certificate has been successfully issued 2026-06-30 17:43:22.984561 | ubuntu-noble-large | openbao-system 18m Normal CertificateIssued certificaterequest/openbao-tls-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.984577 | ubuntu-noble-large | openbao-system 18m Normal cert-manager.io certificaterequest/openbao-tls-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.984595 | ubuntu-noble-large | mariadb-system 18m Warning FailedMount pod/mariadb-operator-webhook-67d6d5db7b-jjz64 MountVolume.SetUp failed for volume "cert" : secret "mariadb-operator-webhook-cert" not found 2026-06-30 17:43:22.984606 | ubuntu-noble-large | openbao-system 18m Normal Scheduled pod/openbao-0 Successfully assigned openbao-system/openbao-0 to forge-control-plane 2026-06-30 17:43:22.984616 | ubuntu-noble-large | envoy-gateway-system 18m Normal Completed job/envoy-gateway-gateway-helm-certgen Job completed 2026-06-30 17:43:22.984627 | ubuntu-noble-large | openbao-system 18m Normal ProvisioningSucceeded persistentvolumeclaim/data-openbao-0 Successfully provisioned volume pvc-c723181f-2c45-4132-aa0b-3c820de10cfe 2026-06-30 17:43:22.984638 | ubuntu-noble-large | mariadb-system 18m Warning FailedMount pod/mariadb-operator-webhook-67d6d5db7b-jjz64 MountVolume.SetUp failed for volume "ca" : secret "mariadb-operator-webhook-ca" not found 2026-06-30 17:43:22.984648 | ubuntu-noble-large | external-secrets 18m Normal SuccessfulCreate replicaset/external-secrets-webhook-6955d84bd5 Created pod: external-secrets-webhook-6955d84bd5-nkw8q 2026-06-30 17:43:22.984670 | ubuntu-noble-large | external-secrets 18m Normal ScalingReplicaSet deployment/external-secrets-cert-controller Scaled up replica set external-secrets-cert-controller-97b69894c from 0 to 1 2026-06-30 17:43:22.984681 | ubuntu-noble-large | external-secrets 18m Normal ScalingReplicaSet deployment/external-secrets Scaled up replica set external-secrets-5958b59f7d from 0 to 1 2026-06-30 17:43:22.984693 | ubuntu-noble-large | external-secrets 18m Normal ScalingReplicaSet deployment/external-secrets-webhook Scaled up replica set external-secrets-webhook-6955d84bd5 from 0 to 1 2026-06-30 17:43:22.984704 | ubuntu-noble-large | external-secrets 18m Normal Scheduled pod/external-secrets-webhook-6955d84bd5-nkw8q Successfully assigned external-secrets/external-secrets-webhook-6955d84bd5-nkw8q to forge-control-plane 2026-06-30 17:43:22.984715 | ubuntu-noble-large | external-secrets 18m Normal SuccessfulCreate replicaset/external-secrets-cert-controller-97b69894c Created pod: external-secrets-cert-controller-97b69894c-bgqpp 2026-06-30 17:43:22.984732 | ubuntu-noble-large | external-secrets 18m Normal Scheduled pod/external-secrets-cert-controller-97b69894c-bgqpp Successfully assigned external-secrets/external-secrets-cert-controller-97b69894c-bgqpp to forge-control-plane 2026-06-30 17:43:22.984744 | ubuntu-noble-large | external-secrets 18m Normal SuccessfulCreate replicaset/external-secrets-5958b59f7d Created pod: external-secrets-5958b59f7d-99snd 2026-06-30 17:43:22.984755 | ubuntu-noble-large | external-secrets 18m Normal Scheduled pod/external-secrets-5958b59f7d-99snd Successfully assigned external-secrets/external-secrets-5958b59f7d-99snd to forge-control-plane 2026-06-30 17:43:22.984766 | ubuntu-noble-large | external-secrets 18m Normal Pulling pod/external-secrets-cert-controller-97b69894c-bgqpp Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-06-30 17:43:22.984776 | ubuntu-noble-large | external-secrets 18m Normal Pulling pod/external-secrets-webhook-6955d84bd5-nkw8q Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-06-30 17:43:22.984787 | ubuntu-noble-large | mariadb-system 18m Normal Created pod/mariadb-operator-756fd78967-5ckvj Container created 2026-06-30 17:43:22.984806 | ubuntu-noble-large | mariadb-system 18m Normal Pulled pod/mariadb-operator-756fd78967-5ckvj Successfully pulled image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" in 4.262s (4.263s including waiting). Image size: 36312327 bytes. 2026-06-30 17:43:22.984827 | ubuntu-noble-large | mariadb-system 18m Normal Created pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Container created 2026-06-30 17:43:22.984839 | ubuntu-noble-large | external-secrets 18m Normal Pulling pod/external-secrets-5958b59f7d-99snd Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-06-30 17:43:22.984850 | ubuntu-noble-large | mariadb-system 18m Normal Started pod/mariadb-operator-756fd78967-5ckvj Container started 2026-06-30 17:43:22.984861 | ubuntu-noble-large | default 18m Normal KeyPairVerified clusterissuer/openbao-ca-issuer Signing CA verified 2026-06-30 17:43:22.984872 | ubuntu-noble-large | mariadb-system 18m Normal Pulled pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Successfully pulled image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" in 773ms (4.919s including waiting). Image size: 36312327 bytes. 2026-06-30 17:43:22.984917 | ubuntu-noble-large | envoy-gateway-system 18m Normal SuccessfulCreate replicaset/envoy-gateway-5649586748 Created pod: envoy-gateway-5649586748-vh4tj 2026-06-30 17:43:22.984929 | ubuntu-noble-large | flux-system 18m Normal ReconciliationSucceeded kustomization/k-orc Reconciliation finished in 35.806058291s, next run in 30m0s 2026-06-30 17:43:22.984948 | ubuntu-noble-large | envoy-gateway-system 18m Normal ScalingReplicaSet deployment/envoy-gateway Scaled up replica set envoy-gateway-5649586748 from 0 to 1 2026-06-30 17:43:22.984959 | ubuntu-noble-large | default 18m Normal KeyPairVerified clusterissuer/openstack-db-ca-issuer Signing CA verified 2026-06-30 17:43:22.984970 | ubuntu-noble-large | mariadb-system 18m Normal Started pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Container started 2026-06-30 17:43:22.984981 | ubuntu-noble-large | flux-system 18m Normal Progressing kustomization/k-orc Health check passed in 30.313572258s 2026-06-30 17:43:22.984992 | ubuntu-noble-large | envoy-gateway-system 18m Normal Scheduled pod/envoy-gateway-5649586748-vh4tj Successfully assigned envoy-gateway-system/envoy-gateway-5649586748-vh4tj to forge-control-plane 2026-06-30 17:43:22.985002 | ubuntu-noble-large | envoy-gateway-system 18m Normal Created pod/envoy-gateway-5649586748-vh4tj Container created 2026-06-30 17:43:22.985022 | ubuntu-noble-large | envoy-gateway-system 18m Normal Started pod/envoy-gateway-5649586748-vh4tj Container started 2026-06-30 17:43:22.985035 | ubuntu-noble-large | mariadb-system 18m Normal Pulled pod/mariadb-operator-webhook-67d6d5db7b-jjz64 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.985046 | ubuntu-noble-large | mariadb-system 18m Normal Created pod/mariadb-operator-webhook-67d6d5db7b-jjz64 Container created 2026-06-30 17:43:22.985056 | ubuntu-noble-large | mariadb-system 18m Normal Started pod/mariadb-operator-webhook-67d6d5db7b-jjz64 Container started 2026-06-30 17:43:22.985075 | ubuntu-noble-large | envoy-gateway-system 18m Normal Pulled pod/envoy-gateway-5649586748-vh4tj Container image "docker.io/envoyproxy/gateway:v1.8.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.985087 | ubuntu-noble-large | envoy-gateway-system 18m Normal LeaderElection lease/5b9825d2.gateway.envoyproxy.io envoy-gateway-5649586748-vh4tj_5f065ab2-9da4-42bd-b8e2-896a98a25db6 became leader 2026-06-30 17:43:22.985094 | ubuntu-noble-large | external-secrets 18m Normal Created pod/external-secrets-5958b59f7d-99snd Container created 2026-06-30 17:43:22.985117 | ubuntu-noble-large | external-secrets 18m Normal Pulled pod/external-secrets-5958b59f7d-99snd Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 6.591s (6.864s including waiting). Image size: 89583295 bytes. 2026-06-30 17:43:22.985124 | ubuntu-noble-large | external-secrets 18m Normal Started pod/external-secrets-5958b59f7d-99snd Container started 2026-06-30 17:43:22.985130 | ubuntu-noble-large | external-secrets 18m Normal Started pod/external-secrets-cert-controller-97b69894c-bgqpp Container started 2026-06-30 17:43:22.985136 | ubuntu-noble-large | external-secrets 18m Normal Pulled pod/external-secrets-cert-controller-97b69894c-bgqpp Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 569ms (8.019s including waiting). Image size: 89583295 bytes. 2026-06-30 17:43:22.985142 | ubuntu-noble-large | external-secrets 18m Normal Created pod/external-secrets-cert-controller-97b69894c-bgqpp Container created 2026-06-30 17:43:22.985149 | ubuntu-noble-large | external-secrets 18m Normal Started pod/external-secrets-webhook-6955d84bd5-nkw8q Container started 2026-06-30 17:43:22.985155 | ubuntu-noble-large | external-secrets 18m Normal Created pod/external-secrets-webhook-6955d84bd5-nkw8q Container created 2026-06-30 17:43:22.985161 | ubuntu-noble-large | external-secrets 18m Normal Pulled pod/external-secrets-webhook-6955d84bd5-nkw8q Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 601ms (7.462s including waiting). Image size: 89583295 bytes. 2026-06-30 17:43:22.985173 | ubuntu-noble-large | default 18m Warning UpdateFailed validatingwebhookconfiguration/externalsecret-validate ca cert not yet ready 2026-06-30 17:43:22.985180 | ubuntu-noble-large | default 18m Warning UpdateFailed validatingwebhookconfiguration/secretstore-validate ca cert not yet ready 2026-06-30 17:43:22.985186 | ubuntu-noble-large | memcached-system 18m Normal Scheduled pod/memcached-operator-869dfff548-bz9mc Successfully assigned memcached-system/memcached-operator-869dfff548-bz9mc to forge-control-plane 2026-06-30 17:43:22.985192 | ubuntu-noble-large | memcached-system 18m Normal ScalingReplicaSet deployment/memcached-operator Scaled up replica set memcached-operator-869dfff548 from 0 to 1 2026-06-30 17:43:22.985198 | ubuntu-noble-large | memcached-system 18m Normal SuccessfulCreate replicaset/memcached-operator-869dfff548 Created pod: memcached-operator-869dfff548-bz9mc 2026-06-30 17:43:22.985204 | ubuntu-noble-large | memcached-system 18m Normal Pulling pod/memcached-operator-869dfff548-bz9mc Pulling image "ghcr.io/c5c3/memcached-operator:0.4.0" 2026-06-30 17:43:22.985210 | ubuntu-noble-large | memcached-system 18m Normal Started pod/memcached-operator-869dfff548-bz9mc Container started 2026-06-30 17:43:22.985223 | ubuntu-noble-large | memcached-system 18m Normal Created pod/memcached-operator-869dfff548-bz9mc Container created 2026-06-30 17:43:22.985229 | ubuntu-noble-large | memcached-system 18m Normal Pulled pod/memcached-operator-869dfff548-bz9mc Successfully pulled image "ghcr.io/c5c3/memcached-operator:0.4.0" in 2.96s (2.96s including waiting). Image size: 17406523 bytes. 2026-06-30 17:43:22.985236 | ubuntu-noble-large | memcached-system 18m Normal LeaderElection lease/d4f3c8a2.c5c3.io memcached-operator-869dfff548-bz9mc_4b983e3a-2767-40c5-939b-a6bae4f9300b became leader 2026-06-30 17:43:22.985242 | ubuntu-noble-large | envoy-gateway-system 18m Normal InstallSucceeded helmrelease/envoy-gateway Helm install succeeded for release envoy-gateway-system/envoy-gateway.v1 with chart gateway-helm@1.8.1 2026-06-30 17:43:22.985248 | ubuntu-noble-large | keystone-system 18m Normal DependencyNotReady helmrelease/keystone-operator dependency 'mariadb-system/mariadb-operator' is not ready 2026-06-30 17:43:22.985254 | ubuntu-noble-large | mariadb-system 18m Warning Unhealthy pod/mariadb-operator-cert-controller-58b95fd98-8cp66 Readiness probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:22.985260 | ubuntu-noble-large | memcached-system 18m Normal InstallSucceeded helmrelease/memcached-operator Helm install succeeded for release memcached-system/memcached-operator.v1 with chart memcached-operator@0.4.0 2026-06-30 17:43:22.985267 | ubuntu-noble-large | mariadb-system 18m Normal InstallSucceeded helmrelease/mariadb-operator Helm install succeeded for release mariadb-system/mariadb-operator.v1 with chart mariadb-operator@0.38.1 2026-06-30 17:43:22.985273 | ubuntu-noble-large | openbao-system 17m Warning FailedMount pod/openbao-0 MountVolume.SetUp failed for volume "client-tls" : secret "openbao-client-tls" not found 2026-06-30 17:43:22.985279 | ubuntu-noble-large | external-secrets 17m Warning Unhealthy pod/external-secrets-webhook-6955d84bd5-nkw8q Readiness probe failed: Get "http://10.244.0.20:8081/readyz": dial tcp 10.244.0.20:8081: connect: connection refused 2026-06-30 17:43:22.985285 | ubuntu-noble-large | external-secrets 17m Warning Unhealthy pod/external-secrets-cert-controller-97b69894c-bgqpp Readiness probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:22.985296 | ubuntu-noble-large | keystone-system 17m Normal DependencyNotReady helmrelease/keystone-operator dependency 'external-secrets/external-secrets' is not ready 2026-06-30 17:43:22.985309 | ubuntu-noble-large | external-secrets 17m Normal InstallSucceeded helmrelease/external-secrets Helm install succeeded for release external-secrets/external-secrets.v1 with chart external-secrets@0.20.4 2026-06-30 17:43:22.985316 | ubuntu-noble-large | openstack 17m Normal Generated certificate/keystone-nip-io-tls Stored new private key in temporary Secret resource "keystone-nip-io-tls-m7778" 2026-06-30 17:43:22.985322 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985328 | ubuntu-noble-large | openstack 17m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985338 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985345 | ubuntu-noble-large | openbao-system 17m Normal CertificateIssued certificaterequest/openbao-client-tls-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.985359 | ubuntu-noble-large | openbao-system 17m Normal cert-manager.io certificaterequest/openbao-client-tls-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.985365 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985371 | ubuntu-noble-large | openbao-system 17m Normal Requested certificate/openbao-client-tls Created new CertificateRequest resource "openbao-client-tls-1" 2026-06-30 17:43:22.985377 | ubuntu-noble-large | openbao-system 17m Normal Generated certificate/openbao-client-tls Stored new private key in temporary Secret resource "openbao-client-tls-dhfs6" 2026-06-30 17:43:22.985383 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/openbao-client-tls Issuing certificate as Secret does not exist 2026-06-30 17:43:22.985389 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985395 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/eso-openbao-client-tls Issuing certificate as Secret does not exist 2026-06-30 17:43:22.985401 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985407 | ubuntu-noble-large | openstack 17m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985413 | ubuntu-noble-large | openstack 17m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985419 | ubuntu-noble-large | openstack 17m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985425 | ubuntu-noble-large | openstack 17m Normal Requested certificate/keystone-nip-io-tls Created new CertificateRequest resource "keystone-nip-io-tls-1" 2026-06-30 17:43:22.985435 | ubuntu-noble-large | openstack 17m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985442 | ubuntu-noble-large | openstack 17m Normal Issuing certificate/keystone-nip-io-tls Issuing certificate as Secret does not exist 2026-06-30 17:43:22.985448 | ubuntu-noble-large | openstack 17m Normal CertificateIssued certificaterequest/keystone-nip-io-tls-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.985454 | ubuntu-noble-large | openstack 17m Warning BadConfig certificaterequest/keystone-nip-io-tls-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-06-30 17:43:22.985460 | ubuntu-noble-large | openstack 17m Normal cert-manager.io certificaterequest/keystone-nip-io-tls-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.985470 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985477 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985483 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985489 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/eso-openbao-client-tls The certificate has been successfully issued 2026-06-30 17:43:22.985502 | ubuntu-noble-large | openbao-system 17m Normal Requested certificate/eso-openbao-client-tls Created new CertificateRequest resource "eso-openbao-client-tls-1" 2026-06-30 17:43:22.985509 | ubuntu-noble-large | default 17m Warning InvalidProviderConfig clustersecretstore/openbao-cluster-store cannot get Kubernetes secret "eso-openbao-client-tls" from namespace "openbao-system": secrets "eso-openbao-client-tls" not found 2026-06-30 17:43:22.985515 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985521 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985530 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/openbao-client-tls The certificate has been successfully issued 2026-06-30 17:43:22.985536 | ubuntu-noble-large | openbao-system 17m Normal Generated certificate/eso-openbao-client-tls Stored new private key in temporary Secret resource "eso-openbao-client-tls-ls9cr" 2026-06-30 17:43:22.985542 | ubuntu-noble-large | openbao-system 17m Normal CertificateIssued certificaterequest/eso-openbao-client-tls-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.985551 | ubuntu-noble-large | openbao-system 17m Normal cert-manager.io certificaterequest/eso-openbao-client-tls-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.985561 | ubuntu-noble-large | envoy-gateway-system 17m Normal Scheduled pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Successfully assigned envoy-gateway-system/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz to forge-control-plane 2026-06-30 17:43:22.985576 | ubuntu-noble-large | openstack 17m Normal Issuing certificate/keystone-nip-io-tls The certificate has been successfully issued 2026-06-30 17:43:22.985590 | ubuntu-noble-large | envoy-gateway-system 17m Normal SuccessfulCreate replicaset/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb Created pod: envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz 2026-06-30 17:43:22.985605 | ubuntu-noble-large | envoy-gateway-system 17m Normal ScalingReplicaSet deployment/envoy-openstack-openstack-gw-b67dc6f3 Scaled up replica set envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb from 0 to 1 2026-06-30 17:43:22.985621 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulling pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Pulling image "docker.io/envoyproxy/envoy:distroless-v1.38.1" 2026-06-30 17:43:22.985636 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulled pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Successfully pulled image "docker.io/envoyproxy/envoy:distroless-v1.38.1" in 3.519s (3.519s including waiting). Image size: 41894283 bytes. 2026-06-30 17:43:22.985649 | ubuntu-noble-large | envoy-gateway-system 16m Normal Created pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Container created 2026-06-30 17:43:22.985668 | ubuntu-noble-large | envoy-gateway-system 16m Normal Created pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Container created 2026-06-30 17:43:22.985684 | ubuntu-noble-large | envoy-gateway-system 16m Normal Started pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Container started 2026-06-30 17:43:22.985704 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulled pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Container image "docker.io/envoyproxy/gateway:v1.8.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.985719 | ubuntu-noble-large | envoy-gateway-system 16m Normal Started pod/envoy-openstack-openstack-gw-b67dc6f3-6b9d4ff9cb-9blkz Container started 2026-06-30 17:43:22.985741 | ubuntu-noble-large | keystone-system 16m Normal NoPods poddisruptionbudget/keystone-operator No matching pods found 2026-06-30 17:43:22.985761 | ubuntu-noble-large | keystone-system 16m Warning FailedMount pod/keystone-operator-66cf7cbc64-nrgp8 MountVolume.SetUp failed for volume "webhook-certs" : secret "keystone-operator-webhook-cert" not found 2026-06-30 17:43:22.985771 | ubuntu-noble-large | keystone-system 16m Normal SuccessfulCreate replicaset/keystone-operator-66cf7cbc64 Created pod: keystone-operator-66cf7cbc64-nrgp8 2026-06-30 17:43:22.985791 | ubuntu-noble-large | keystone-system 16m Normal Scheduled pod/keystone-operator-66cf7cbc64-nrgp8 Successfully assigned keystone-system/keystone-operator-66cf7cbc64-nrgp8 to forge-control-plane 2026-06-30 17:43:22.985809 | ubuntu-noble-large | keystone-system 16m Normal Requested certificate/keystone-operator-webhook Created new CertificateRequest resource "keystone-operator-webhook-1" 2026-06-30 17:43:22.985825 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985848 | ubuntu-noble-large | keystone-system 16m Normal Scheduled pod/keystone-operator-66cf7cbc64-nfjgj Successfully assigned keystone-system/keystone-operator-66cf7cbc64-nfjgj to forge-control-plane 2026-06-30 17:43:22.985894 | ubuntu-noble-large | keystone-system 16m Warning FailedMount pod/keystone-operator-66cf7cbc64-nfjgj MountVolume.SetUp failed for volume "webhook-certs" : secret "keystone-operator-webhook-cert" not found 2026-06-30 17:43:22.985921 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.985989 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986003 | ubuntu-noble-large | keystone-system 16m Normal Generated certificate/keystone-operator-webhook Stored new private key in temporary Secret resource "keystone-operator-webhook-k8kzb" 2026-06-30 17:43:22.986018 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986033 | ubuntu-noble-large | keystone-system 16m Normal Issuing certificate/keystone-operator-webhook Issuing certificate as Secret does not exist 2026-06-30 17:43:22.986051 | ubuntu-noble-large | keystone-system 16m Normal cert-manager.io certificaterequest/keystone-operator-webhook-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.986067 | ubuntu-noble-large | keystone-system 16m Warning BadConfig certificaterequest/keystone-operator-webhook-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-06-30 17:43:22.986087 | ubuntu-noble-large | keystone-system 16m Normal SuccessfulCreate replicaset/keystone-operator-66cf7cbc64 Created pod: keystone-operator-66cf7cbc64-nfjgj 2026-06-30 17:43:22.986167 | ubuntu-noble-large | keystone-system 16m Normal Issuing certificate/keystone-operator-webhook The certificate has been successfully issued 2026-06-30 17:43:22.986176 | ubuntu-noble-large | keystone-system 16m Normal CertificateIssued certificaterequest/keystone-operator-webhook-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.986187 | ubuntu-noble-large | keystone-system 16m Normal ScalingReplicaSet deployment/keystone-operator Scaled up replica set keystone-operator-66cf7cbc64 from 0 to 2 2026-06-30 17:43:22.986193 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986202 | ubuntu-noble-large | keystone-system 16m Normal Pulling pod/keystone-operator-66cf7cbc64-nfjgj Pulling image "ghcr.io/c5c3/keystone-operator:latest" 2026-06-30 17:43:22.986216 | ubuntu-noble-large | keystone-system 16m Normal Pulling pod/keystone-operator-66cf7cbc64-nrgp8 Pulling image "ghcr.io/c5c3/keystone-operator:latest" 2026-06-30 17:43:22.986236 | ubuntu-noble-large | keystone-system 16m Normal Pulled pod/keystone-operator-66cf7cbc64-nrgp8 Successfully pulled image "ghcr.io/c5c3/keystone-operator:latest" in 3.546s (3.547s including waiting). Image size: 28825964 bytes. 2026-06-30 17:43:22.986254 | ubuntu-noble-large | c5c3-system 16m Normal DependencyNotReady helmrelease/c5c3-operator dependency 'keystone-system/keystone-operator' is not ready 2026-06-30 17:43:22.986276 | ubuntu-noble-large | keystone-system 16m Warning Unhealthy pod/keystone-operator-66cf7cbc64-nfjgj Readiness probe failed: Get "http://10.244.0.27:8081/readyz": dial tcp 10.244.0.27:8081: connect: connection refused 2026-06-30 17:43:22.986327 | ubuntu-noble-large | keystone-system 16m Normal Created pod/keystone-operator-66cf7cbc64-nfjgj Container created 2026-06-30 17:43:22.986338 | ubuntu-noble-large | keystone-system 16m Warning Unhealthy pod/keystone-operator-66cf7cbc64-nrgp8 Readiness probe failed: Get "http://10.244.0.28:8081/readyz": dial tcp 10.244.0.28:8081: connect: connection refused 2026-06-30 17:43:22.986444 | ubuntu-noble-large | keystone-system 16m Normal Pulled pod/keystone-operator-66cf7cbc64-nfjgj Successfully pulled image "ghcr.io/c5c3/keystone-operator:latest" in 508ms (4.044s including waiting). Image size: 28825964 bytes. 2026-06-30 17:43:22.986457 | ubuntu-noble-large | keystone-system 16m Normal Started pod/keystone-operator-66cf7cbc64-nfjgj Container started 2026-06-30 17:43:22.986469 | ubuntu-noble-large | keystone-system 16m Normal Started pod/keystone-operator-66cf7cbc64-nrgp8 Container started 2026-06-30 17:43:22.986475 | ubuntu-noble-large | keystone-system 16m Normal LeaderElection lease/keystone.openstack.c5c3.io keystone-operator-66cf7cbc64-nrgp8_097e1b93-75e1-4036-9c52-5d31e464909c became leader 2026-06-30 17:43:22.986485 | ubuntu-noble-large | keystone-system 16m Normal Created pod/keystone-operator-66cf7cbc64-nrgp8 Container created 2026-06-30 17:43:22.986491 | ubuntu-noble-large | keystone-system 16m Normal InstallSucceeded helmrelease/keystone-operator Helm install succeeded for release keystone-system/keystone-operator.v1 with chart keystone-operator@0.5.0 2026-06-30 17:43:22.986501 | ubuntu-noble-large | c5c3-system 16m Normal NoPods poddisruptionbudget/c5c3-operator No matching pods found 2026-06-30 17:43:22.986507 | ubuntu-noble-large | c5c3-system 16m Normal CertificateIssued certificaterequest/c5c3-operator-webhook-1 Certificate fetched from issuer successfully 2026-06-30 17:43:22.986516 | ubuntu-noble-large | c5c3-system 16m Normal Issuing certificate/c5c3-operator-webhook The certificate has been successfully issued 2026-06-30 17:43:22.986527 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986542 | ubuntu-noble-large | c5c3-system 16m Normal cert-manager.io certificaterequest/c5c3-operator-webhook-1 Certificate request has been approved by cert-manager.io 2026-06-30 17:43:22.986559 | ubuntu-noble-large | c5c3-system 16m Warning BadConfig certificaterequest/c5c3-operator-webhook-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-06-30 17:43:22.986575 | ubuntu-noble-large | c5c3-system 16m Normal Scheduled pod/c5c3-operator-575bfd968-gtmwg Successfully assigned c5c3-system/c5c3-operator-575bfd968-gtmwg to forge-control-plane 2026-06-30 17:43:22.986591 | ubuntu-noble-large | c5c3-system 16m Warning FailedMount pod/c5c3-operator-575bfd968-lskhv MountVolume.SetUp failed for volume "webhook-certs" : secret "c5c3-operator-webhook-cert" not found 2026-06-30 17:43:22.986608 | ubuntu-noble-large | c5c3-system 16m Normal ScalingReplicaSet deployment/c5c3-operator Scaled up replica set c5c3-operator-575bfd968 from 0 to 2 2026-06-30 17:43:22.986623 | ubuntu-noble-large | c5c3-system 16m Normal Scheduled pod/c5c3-operator-575bfd968-lskhv Successfully assigned c5c3-system/c5c3-operator-575bfd968-lskhv to forge-control-plane 2026-06-30 17:43:22.986641 | ubuntu-noble-large | c5c3-system 16m Normal Issuing certificate/c5c3-operator-webhook Issuing certificate as Secret does not exist 2026-06-30 17:43:22.986658 | ubuntu-noble-large | c5c3-system 16m Normal Generated certificate/c5c3-operator-webhook Stored new private key in temporary Secret resource "c5c3-operator-webhook-7ttdc" 2026-06-30 17:43:22.986675 | ubuntu-noble-large | c5c3-system 16m Normal Requested certificate/c5c3-operator-webhook Created new CertificateRequest resource "c5c3-operator-webhook-1" 2026-06-30 17:43:22.986689 | ubuntu-noble-large | c5c3-system 16m Warning FailedMount pod/c5c3-operator-575bfd968-gtmwg MountVolume.SetUp failed for volume "webhook-certs" : secret "c5c3-operator-webhook-cert" not found 2026-06-30 17:43:22.986702 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986721 | ubuntu-noble-large | c5c3-system 16m Normal SuccessfulCreate replicaset/c5c3-operator-575bfd968 Created pod: c5c3-operator-575bfd968-lskhv 2026-06-30 17:43:22.986736 | ubuntu-noble-large | c5c3-system 16m Normal SuccessfulCreate replicaset/c5c3-operator-575bfd968 Created pod: c5c3-operator-575bfd968-gtmwg 2026-06-30 17:43:22.986751 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986766 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986781 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-06-30 17:43:22.986796 | ubuntu-noble-large | c5c3-system 16m Normal Pulling pod/c5c3-operator-575bfd968-gtmwg Pulling image "ghcr.io/c5c3/c5c3-operator:latest" 2026-06-30 17:43:22.986814 | ubuntu-noble-large | c5c3-system 16m Normal Pulling pod/c5c3-operator-575bfd968-lskhv Pulling image "ghcr.io/c5c3/c5c3-operator:latest" 2026-06-30 17:43:22.986831 | ubuntu-noble-large | c5c3-system 16m Normal Pulled pod/c5c3-operator-575bfd968-gtmwg Successfully pulled image "ghcr.io/c5c3/c5c3-operator:latest" in 539ms (4.552s including waiting). Image size: 28597000 bytes. 2026-06-30 17:43:22.986847 | ubuntu-noble-large | c5c3-system 16m Normal Created pod/c5c3-operator-575bfd968-gtmwg Container created 2026-06-30 17:43:22.986864 | ubuntu-noble-large | c5c3-system 16m Normal Pulled pod/c5c3-operator-575bfd968-lskhv Successfully pulled image "ghcr.io/c5c3/c5c3-operator:latest" in 4.034s (4.034s including waiting). Image size: 28597000 bytes. 2026-06-30 17:43:22.986901 | ubuntu-noble-large | c5c3-system 16m Warning Unhealthy pod/c5c3-operator-575bfd968-lskhv Readiness probe failed: Get "http://10.244.0.29:8081/readyz": dial tcp 10.244.0.29:8081: connect: connection refused 2026-06-30 17:43:22.986915 | ubuntu-noble-large | c5c3-system 16m Normal Started pod/c5c3-operator-575bfd968-lskhv Container started 2026-06-30 17:43:22.986928 | ubuntu-noble-large | c5c3-system 16m Normal Created pod/c5c3-operator-575bfd968-lskhv Container created 2026-06-30 17:43:22.986938 | ubuntu-noble-large | c5c3-system 16m Normal Started pod/c5c3-operator-575bfd968-gtmwg Container started 2026-06-30 17:43:22.986959 | ubuntu-noble-large | c5c3-system 16m Warning Unhealthy pod/c5c3-operator-575bfd968-gtmwg Readiness probe failed: Get "http://10.244.0.30:8081/readyz": dial tcp 10.244.0.30:8081: connect: connection refused 2026-06-30 17:43:22.986998 | ubuntu-noble-large | c5c3-system 16m Normal LeaderElection lease/c5c3.openstack.c5c3.io c5c3-operator-575bfd968-gtmwg_63b1ef07-ea59-4951-8d7f-042dde44634e became leader 2026-06-30 17:43:22.987013 | ubuntu-noble-large | c5c3-system 16m Normal InstallSucceeded helmrelease/c5c3-operator Helm install succeeded for release c5c3-system/c5c3-operator.v1 with chart c5c3-operator@0.3.0 2026-06-30 17:43:22.987023 | ubuntu-noble-large | default 16m Warning InvalidProviderConfig clustersecretstore/openbao-cluster-store unable to log in to auth method: unable to log in with Kubernetes auth: Put "https://openbao.openbao-system.svc:8200/v1/auth/kubernetes/management/login": dial tcp 10.96.159.0:8200: connect: connection refused 2026-06-30 17:43:22.987054 | ubuntu-noble-large | openbao-system 16m Normal Pulling pod/openbao-0 Pulling image "quay.io/openbao/openbao:2.5.5" 2026-06-30 17:43:22.987093 | ubuntu-noble-large | openbao-system 16m Normal Pulled pod/openbao-0 Successfully pulled image "quay.io/openbao/openbao:2.5.5" in 4.861s (4.861s including waiting). Image size: 76859931 bytes. 2026-06-30 17:43:22.987164 | ubuntu-noble-large | openbao-system 16m Normal Created pod/openbao-0 Container created 2026-06-30 17:43:22.987177 | ubuntu-noble-large | openbao-system 16m Normal Started pod/openbao-0 Container started 2026-06-30 17:43:22.987227 | ubuntu-noble-large | openbao-system 16m Warning Unhealthy pod/openbao-0 Readiness probe failed: Key Value... 2026-06-30 17:43:22.987240 | ubuntu-noble-large | openbao-system 16m Warning Unhealthy pod/openbao-0 Readiness probe failed: Key Value... 2026-06-30 17:43:22.987251 | ubuntu-noble-large | openstack 16m Warning UpdateFailed externalsecret/keystone-admin error processing spec.data[0] (key: bootstrap/openstack/controlplane-keystone/admin), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-06-30 17:43:22.987261 | ubuntu-noble-large | openstack 16m Warning UpdateFailed externalsecret/mariadb-root-password error processing spec.data[0] (key: infrastructure/mariadb), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-06-30 17:43:22.987271 | ubuntu-noble-large | openstack 16m Warning UpdateFailed externalsecret/keystone-db error processing spec.data[0] (key: openstack/keystone/openstack/controlplane/db), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-06-30 17:43:22.987290 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/keystone-db secret created 2026-06-30 17:43:22.987303 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/mariadb-root-password secret created 2026-06-30 17:43:22.987312 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/keystone-admin secret created 2026-06-30 17:43:22.987322 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-n9kjr Successfully assigned openstack/openstack-memcached-f654cd846-n9kjr to forge-control-plane 2026-06-30 17:43:22.987339 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-l95d8 2026-06-30 17:43:22.987353 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-pljfj 2026-06-30 17:43:22.987372 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-n9kjr 2026-06-30 17:43:22.987383 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-pljfj Successfully assigned openstack/openstack-memcached-f654cd846-pljfj to forge-control-plane 2026-06-30 17:43:22.987393 | ubuntu-noble-large | openstack 15m Normal ScalingReplicaSet deployment/openstack-memcached Scaled up replica set openstack-memcached-f654cd846 from 0 to 3 2026-06-30 17:43:22.987402 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-l95d8 Successfully assigned openstack/openstack-memcached-f654cd846-l95d8 to forge-control-plane 2026-06-30 17:43:22.987416 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-l95d8 Pulling image "memcached:1.6" 2026-06-30 17:43:22.987422 | ubuntu-noble-large | local-path-storage 15m Normal Pulled pod/helper-pod-create-pvc-2b0ffb54-5a29-4254-99aa-871525bf7765 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.987428 | ubuntu-noble-large | openstack 15m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.987435 | ubuntu-noble-large | openstack 15m Normal Provisioning persistentvolumeclaim/storage-openstack-db-0 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-0" 2026-06-30 17:43:22.987441 | ubuntu-noble-large | default 15m Warning OwnerRefInvalidNamespace clusterrolebinding/openstack-db-openstack-fec49d98:auth-delegator ownerRef [k8s.mariadb.com/v1alpha1/MariaDB, namespace: , name: openstack-db, uid: fec49d98-754b-425b-9558-f0efd43d5d51] does not exist in namespace "" 2026-06-30 17:43:22.987450 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate job/openstack-db-init Created pod: openstack-db-init-6l8cp 2026-06-30 17:43:22.987456 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-n9kjr Pulling image "memcached:1.6" 2026-06-30 17:43:22.987462 | ubuntu-noble-large | local-path-storage 15m Normal Created pod/helper-pod-create-pvc-2b0ffb54-5a29-4254-99aa-871525bf7765 Container created 2026-06-30 17:43:22.987471 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-pljfj Pulling image "memcached:1.6" 2026-06-30 17:43:22.987476 | ubuntu-noble-large | openstack 15m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-0 waiting for first consumer to be created before binding 2026-06-30 17:43:22.987485 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-2b0ffb54-5a29-4254-99aa-871525bf7765 Container started 2026-06-30 17:43:22.987494 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-0 Successfully provisioned volume pvc-2b0ffb54-5a29-4254-99aa-871525bf7765 2026-06-30 17:43:22.987508 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-init-6l8cp Successfully assigned openstack/openstack-db-init-6l8cp to forge-control-plane 2026-06-30 17:43:22.987522 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-n9kjr Successfully pulled image "memcached:1.6" in 4.275s (4.275s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:22.987539 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-n9kjr Container created 2026-06-30 17:43:22.987555 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-n9kjr Container started 2026-06-30 17:43:22.987574 | ubuntu-noble-large | openstack 14m Normal Pulling pod/openstack-db-init-6l8cp Pulling image "docker-registry1.mariadb.com/library/mariadb:11.4.5" 2026-06-30 17:43:22.987588 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-pljfj Container started 2026-06-30 17:43:22.987605 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-pljfj Successfully pulled image "memcached:1.6" in 733ms (4.994s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:22.987623 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-pljfj Container created 2026-06-30 17:43:22.987641 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-l95d8 Successfully pulled image "memcached:1.6" in 724ms (5.689s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:22.987657 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-l95d8 Container created 2026-06-30 17:43:22.987675 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-l95d8 Container started 2026-06-30 17:43:22.987695 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-init-6l8cp Successfully pulled image "docker-registry1.mariadb.com/library/mariadb:11.4.5" in 7.216s (8.631s including waiting). Image size: 104480028 bytes. 2026-06-30 17:43:22.987715 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-init-6l8cp Container created 2026-06-30 17:43:22.987748 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-init-6l8cp Container started 2026-06-30 17:43:22.987757 | ubuntu-noble-large | openstack 14m Normal Completed job/openstack-db-init Job completed 2026-06-30 17:43:22.987767 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-2 in StatefulSet openstack-db successful 2026-06-30 17:43:22.987794 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-2 Pod openstack-db-2 in StatefulSet openstack-db success 2026-06-30 17:43:22.987807 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.987821 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-2 waiting for first consumer to be created before binding 2026-06-30 17:43:22.987832 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-2 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.987848 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-2 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-2" 2026-06-30 17:43:22.987872 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-0 Pod openstack-db-0 in StatefulSet openstack-db success 2026-06-30 17:43:22.987913 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-0 in StatefulSet openstack-db successful 2026-06-30 17:43:22.987927 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim storage-openstack-db-2 Pod openstack-db-2 in StatefulSet openstack-db success 2026-06-30 17:43:22.987941 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim storage-openstack-db-1 Pod openstack-db-1 in StatefulSet openstack-db success 2026-06-30 17:43:22.987956 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-0 waiting for first consumer to be created before binding 2026-06-30 17:43:22.987971 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-1 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.987986 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-0 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-0" 2026-06-30 17:43:22.987996 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-1 waiting for first consumer to be created before binding 2026-06-30 17:43:22.988007 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-1 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.988016 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/storage-openstack-db-1 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-1" 2026-06-30 17:43:22.988026 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-2 waiting for first consumer to be created before binding 2026-06-30 17:43:22.988034 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-2 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-06-30 17:43:22.988050 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-1 Pod openstack-db-1 in StatefulSet openstack-db success 2026-06-30 17:43:22.988060 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-1 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-1" 2026-06-30 17:43:22.988082 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-1 in StatefulSet openstack-db successful 2026-06-30 17:43:22.988095 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-1 waiting for first consumer to be created before binding 2026-06-30 17:43:22.988123 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-22021448-d2ca-4e43-923d-cc7646ac8464 Container created 2026-06-30 17:43:22.988137 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-8ab35a40-ca24-4a2a-bba6-f44957fe6869 Container created 2026-06-30 17:43:22.988146 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-7fc4dc4a-fa11-464e-a214-7bf9386f2656 Container started 2026-06-30 17:43:22.988155 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-8ab35a40-ca24-4a2a-bba6-f44957fe6869 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988164 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-7fc4dc4a-fa11-464e-a214-7bf9386f2656 Container created 2026-06-30 17:43:22.988173 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-7fc4dc4a-fa11-464e-a214-7bf9386f2656 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988352 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-8ab35a40-ca24-4a2a-bba6-f44957fe6869 Container started 2026-06-30 17:43:22.988376 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-22021448-d2ca-4e43-923d-cc7646ac8464 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988386 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-22021448-d2ca-4e43-923d-cc7646ac8464 Container started 2026-06-30 17:43:22.988396 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-255e60b7-f63c-4cb1-8ec4-63b1282f6692 Container created 2026-06-30 17:43:22.988406 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-255e60b7-f63c-4cb1-8ec4-63b1282f6692 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988415 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-255e60b7-f63c-4cb1-8ec4-63b1282f6692 Container started 2026-06-30 17:43:22.988425 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-2 Successfully provisioned volume pvc-8ab35a40-ca24-4a2a-bba6-f44957fe6869 2026-06-30 17:43:22.988448 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/storage-openstack-db-2 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-2" 2026-06-30 17:43:22.988458 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-24cc9035-ca39-4e99-b1a8-cb78e3c9c3ff Container created 2026-06-30 17:43:22.988469 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-24cc9035-ca39-4e99-b1a8-cb78e3c9c3ff Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988479 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-1 Successfully provisioned volume pvc-22021448-d2ca-4e43-923d-cc7646ac8464 2026-06-30 17:43:22.988488 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-24cc9035-ca39-4e99-b1a8-cb78e3c9c3ff Container started 2026-06-30 17:43:22.988497 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-0 Successfully assigned openstack/openstack-db-0 to forge-control-plane 2026-06-30 17:43:22.988506 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-1 Successfully provisioned volume pvc-255e60b7-f63c-4cb1-8ec4-63b1282f6692 2026-06-30 17:43:22.988518 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-0 Successfully provisioned volume pvc-7fc4dc4a-fa11-464e-a214-7bf9386f2656 2026-06-30 17:43:22.988530 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-1 Successfully assigned openstack/openstack-db-1 to forge-control-plane 2026-06-30 17:43:22.988539 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-1 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988556 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-2 Successfully provisioned volume pvc-24cc9035-ca39-4e99-b1a8-cb78e3c9c3ff 2026-06-30 17:43:22.988567 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988576 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-06-30 17:43:22.988586 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-06-30 17:43:22.988596 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-1 Container created 2026-06-30 17:43:22.988606 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-1 Container started 2026-06-30 17:43:22.988616 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-06-30 17:43:22.988626 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-2 Successfully assigned openstack/openstack-db-2 to forge-control-plane 2026-06-30 17:43:22.988643 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-06-30 17:43:22.988652 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988663 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-06-30 17:43:22.988673 | ubuntu-noble-large | openstack 14m Warning Unhealthy pod/openstack-db-0 Readiness probe failed: Get "http://10.244.0.42:5566/health": dial tcp 10.244.0.42:5566: connect: connection refused 2026-06-30 17:43:22.988688 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-06-30 17:43:22.988699 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988710 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-2 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988720 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-2 Container started 2026-06-30 17:43:22.988730 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-2 Container created 2026-06-30 17:43:22.988741 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-1 Container created 2026-06-30 17:43:22.988756 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-1 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988766 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-1 Container started 2026-06-30 17:43:22.988776 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-1 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988791 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-1 Container created 2026-06-30 17:43:22.988801 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-1 Container started 2026-06-30 17:43:22.988812 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-1 Readiness probe failed: Get "http://10.244.0.43:5566/health": dial tcp 10.244.0.43:5566: connect: connection refused 2026-06-30 17:43:22.988822 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-2 Container created 2026-06-30 17:43:22.988839 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-2 Container created 2026-06-30 17:43:22.988849 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-2 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988860 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-2 Container started 2026-06-30 17:43:22.988897 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-2 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.988916 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-2 Container started 2026-06-30 17:43:22.988926 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-2 Readiness probe failed: Get "http://10.244.0.44:5566/health": dial tcp 10.244.0.44:5566: connect: connection refused 2026-06-30 17:43:22.988936 | ubuntu-noble-large | openstack 12m Warning Unhealthy pod/openstack-db-0 Readiness probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:22.988946 | ubuntu-noble-large | openstack 12m Warning Unhealthy pod/openstack-db-2 Startup probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:22.988956 | ubuntu-noble-large | openstack 12m Normal Created externalsecret/controlplane-keystone-db-credentials secret created 2026-06-30 17:43:22.988971 | ubuntu-noble-large | openstack 12m Normal Created externalsecret/controlplane-keystone-admin-credentials secret created 2026-06-30 17:43:22.988981 | ubuntu-noble-large | openstack 12m Normal GaleraClusterHealthy mariadb/openstack-db Galera cluster is healthy 2026-06-30 17:43:22.988991 | ubuntu-noble-large | openstack 12m Normal FernetKeysGenerated keystone/controlplane-keystone Initial Fernet encryption keys have been generated 2026-06-30 17:43:22.989002 | ubuntu-noble-large | openstack 12m Normal CredentialKeysGenerated keystone/controlplane-keystone Initial credential encryption keys have been generated 2026-06-30 17:43:22.989012 | ubuntu-noble-large | openstack 12m Normal Synced pushsecret/controlplane-keystone-credential-keys-backup PushSecret synced successfully 2026-06-30 17:43:22.989022 | ubuntu-noble-large | openstack 12m Normal Synced pushsecret/controlplane-keystone-fernet-keys-backup PushSecret synced successfully 2026-06-30 17:43:22.989032 | ubuntu-noble-large | openstack 12m Normal Scheduled pod/controlplane-keystone-db-sync-q9p8d Successfully assigned openstack/controlplane-keystone-db-sync-q9p8d to forge-control-plane 2026-06-30 17:43:22.989046 | ubuntu-noble-large | openstack 12m Normal Pulling pod/controlplane-keystone-db-sync-q9p8d Pulling image "ghcr.io/c5c3/keystone:2025.2" 2026-06-30 17:43:22.989056 | ubuntu-noble-large | openstack 12m Normal SuccessfulCreate job/controlplane-keystone-db-sync Created pod: controlplane-keystone-db-sync-q9p8d 2026-06-30 17:43:22.989079 | ubuntu-noble-large | openstack 12m Normal Created pod/controlplane-keystone-db-sync-q9p8d Container created 2026-06-30 17:43:22.989091 | ubuntu-noble-large | openstack 12m Normal Pulled pod/controlplane-keystone-db-sync-q9p8d Successfully pulled image "ghcr.io/c5c3/keystone:2025.2" in 10.231s (10.231s including waiting). Image size: 111504652 bytes. 2026-06-30 17:43:22.989117 | ubuntu-noble-large | openstack 12m Normal Started pod/controlplane-keystone-db-sync-q9p8d Container started 2026-06-30 17:43:22.989129 | ubuntu-noble-large | openstack 11m Normal SuccessfulCreate job/controlplane-keystone-schema-check Created pod: controlplane-keystone-schema-check-7gg4q 2026-06-30 17:43:22.989144 | ubuntu-noble-large | openstack 11m Normal Scheduled pod/controlplane-keystone-schema-check-7gg4q Successfully assigned openstack/controlplane-keystone-schema-check-7gg4q to forge-control-plane 2026-06-30 17:43:22.989154 | ubuntu-noble-large | openstack 11m Normal Completed job/controlplane-keystone-db-sync Job completed 2026-06-30 17:43:22.989164 | ubuntu-noble-large | openstack 11m Normal Pulled pod/controlplane-keystone-schema-check-7gg4q Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.989174 | ubuntu-noble-large | openstack 11m Normal Started pod/controlplane-keystone-schema-check-7gg4q Container started 2026-06-30 17:43:22.989184 | ubuntu-noble-large | openstack 11m Normal Created pod/controlplane-keystone-schema-check-7gg4q Container created 2026-06-30 17:43:22.989195 | ubuntu-noble-large | openstack 11m Normal ScalingReplicaSet deployment/controlplane-keystone Scaled up replica set controlplane-keystone-6d68dcd67c from 0 to 1 2026-06-30 17:43:22.989205 | ubuntu-noble-large | openstack 11m Normal Completed job/controlplane-keystone-schema-check Job completed 2026-06-30 17:43:22.989220 | ubuntu-noble-large | openstack 11m Normal Scheduled pod/controlplane-keystone-6d68dcd67c-7p6jq Successfully assigned openstack/controlplane-keystone-6d68dcd67c-7p6jq to forge-control-plane 2026-06-30 17:43:22.989230 | ubuntu-noble-large | openstack 11m Normal SuccessfulCreate replicaset/controlplane-keystone-6d68dcd67c Created pod: controlplane-keystone-6d68dcd67c-7p6jq 2026-06-30 17:43:22.989240 | ubuntu-noble-large | openstack 11m Warning Unhealthy pod/controlplane-keystone-6d68dcd67c-7p6jq Startup probe failed: Get "http://10.244.0.47:5000/v3": read tcp 10.244.0.1:50280->10.244.0.47:5000: read: connection reset by peer 2026-06-30 17:43:22.989251 | ubuntu-noble-large | openstack 10m Warning Unhealthy pod/controlplane-keystone-6d68dcd67c-7p6jq Startup probe failed: Get "http://10.244.0.47:5000/v3": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-06-30 17:43:22.989261 | ubuntu-noble-large | openstack 2m39s Normal DatabaseSynced keystone/controlplane-keystone Database schema is up to date 2026-06-30 17:43:22.989276 | ubuntu-noble-large | default 48s Normal Valid clustersecretstore/openbao-cluster-store store validated 2026-06-30 17:43:22.989291 | ubuntu-noble-large | openstack 12s Normal Started pod/controlplane-keystone-6d68dcd67c-7p6jq Container started 2026-06-30 17:43:22.989301 | ubuntu-noble-large | openstack 12s Normal Created pod/controlplane-keystone-6d68dcd67c-7p6jq Container created 2026-06-30 17:43:22.989327 | ubuntu-noble-large | openstack 12s Normal Pulled pod/controlplane-keystone-6d68dcd67c-7p6jq Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:22.989338 | ubuntu-noble-large | openstack 7s Warning BackOff pod/controlplane-keystone-6d68dcd67c-7p6jq Back-off restarting failed container keystone in pod controlplane-keystone-6d68dcd67c-7p6jq_openstack(3fb06dd9-2691-4a8c-a217-45e328bf304c) 2026-06-30 17:43:22.989348 | ubuntu-noble-large | openstack 7s Warning Unhealthy pod/controlplane-keystone-6d68dcd67c-7p6jq Startup probe failed: Get "http://10.244.0.47:5000/v3": dial tcp 10.244.0.47:5000: connect: connection refused 2026-06-30 17:43:22.995142 | ubuntu-noble-large | === Pod descriptions and logs in namespace openstack === 2026-06-30 17:43:23.161592 | ubuntu-noble-large | --- describe pod/controlplane-keystone-6d68dcd67c-7p6jq --- 2026-06-30 17:43:23.298511 | ubuntu-noble-large | Name: controlplane-keystone-6d68dcd67c-7p6jq 2026-06-30 17:43:23.298584 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:23.298598 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:23.298607 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:23.298616 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:23.298626 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:31:44 +0000 2026-06-30 17:43:23.298634 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=controlplane-keystone 2026-06-30 17:43:23.298645 | ubuntu-noble-large | app.kubernetes.io/managed-by=keystone-operator 2026-06-30 17:43:23.298655 | ubuntu-noble-large | app.kubernetes.io/name=keystone 2026-06-30 17:43:23.298663 | ubuntu-noble-large | pod-template-hash=6d68dcd67c 2026-06-30 17:43:23.298672 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:23.298680 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:23.298689 | ubuntu-noble-large | IP: 10.244.0.47 2026-06-30 17:43:23.298698 | ubuntu-noble-large | IPs: 2026-06-30 17:43:23.298708 | ubuntu-noble-large | IP: 10.244.0.47 2026-06-30 17:43:23.298714 | ubuntu-noble-large | Controlled By: ReplicaSet/controlplane-keystone-6d68dcd67c 2026-06-30 17:43:23.298719 | ubuntu-noble-large | Containers: 2026-06-30 17:43:23.298724 | ubuntu-noble-large | keystone: 2026-06-30 17:43:23.298730 | ubuntu-noble-large | Container ID: containerd://3a96513bb543972a37eaf784644c3541d77dcaf1432561d6cbd3bee922576228 2026-06-30 17:43:23.298735 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-06-30 17:43:23.298741 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:f708d60beed11caabe9c3c3d54f5645615005491aefa6f9c491648253bd65b91 2026-06-30 17:43:23.298747 | ubuntu-noble-large | Port: 5000/TCP (keystone) 2026-06-30 17:43:23.298752 | ubuntu-noble-large | Host Port: 0/TCP (keystone) 2026-06-30 17:43:23.298757 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-06-30 17:43:23.298762 | ubuntu-noble-large | Command: 2026-06-30 17:43:23.298767 | ubuntu-noble-large | uwsgi 2026-06-30 17:43:23.298772 | ubuntu-noble-large | --http 2026-06-30 17:43:23.298777 | ubuntu-noble-large | :5000 2026-06-30 17:43:23.298782 | ubuntu-noble-large | --http-keepalive 2026-06-30 17:43:23.298787 | ubuntu-noble-large | --log-master 2026-06-30 17:43:23.298792 | ubuntu-noble-large | --log-format 2026-06-30 17:43:23.298797 | ubuntu-noble-large | %(method) %(uri) => generated %(rsize) bytes in %(msecs) msecs (%(proto) %(status)) 2026-06-30 17:43:23.298802 | ubuntu-noble-large | --wsgi-file 2026-06-30 17:43:23.298807 | ubuntu-noble-large | /var/lib/openstack/bin/keystone-wsgi-public 2026-06-30 17:43:23.298812 | ubuntu-noble-large | --master 2026-06-30 17:43:23.298816 | ubuntu-noble-large | --lazy-apps 2026-06-30 17:43:23.298822 | ubuntu-noble-large | --need-app 2026-06-30 17:43:23.298827 | ubuntu-noble-large | --processes 2026-06-30 17:43:23.298832 | ubuntu-noble-large | 2 2026-06-30 17:43:23.298837 | ubuntu-noble-large | --threads 2026-06-30 17:43:23.298842 | ubuntu-noble-large | 1 2026-06-30 17:43:23.298847 | ubuntu-noble-large | --pyargv=--config-dir=/etc/keystone/keystone.conf.d/ 2026-06-30 17:43:23.298852 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:23.298856 | ubuntu-noble-large | Reason: OOMKilled 2026-06-30 17:43:23.298861 | ubuntu-noble-large | Exit Code: 137 2026-06-30 17:43:23.298866 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:43:10 +0000 2026-06-30 17:43:23.298913 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:43:14 +0000 2026-06-30 17:43:23.298923 | ubuntu-noble-large | Last State: Terminated 2026-06-30 17:43:23.298929 | ubuntu-noble-large | Reason: OOMKilled 2026-06-30 17:43:23.298933 | ubuntu-noble-large | Exit Code: 137 2026-06-30 17:43:23.298939 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:37:55 +0000 2026-06-30 17:43:23.298944 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:37:59 +0000 2026-06-30 17:43:23.298948 | ubuntu-noble-large | Ready: False 2026-06-30 17:43:23.298954 | ubuntu-noble-large | Restart Count: 7 2026-06-30 17:43:23.298958 | ubuntu-noble-large | Limits: 2026-06-30 17:43:23.298963 | ubuntu-noble-large | cpu: 500m 2026-06-30 17:43:23.298968 | ubuntu-noble-large | memory: 512Mi 2026-06-30 17:43:23.298973 | ubuntu-noble-large | Requests: 2026-06-30 17:43:23.298978 | ubuntu-noble-large | cpu: 100m 2026-06-30 17:43:23.298983 | ubuntu-noble-large | memory: 256Mi 2026-06-30 17:43:23.298988 | ubuntu-noble-large | Liveness: tcp-socket :5000 delay=15s timeout=1s period=20s #success=1 #failure=3 2026-06-30 17:43:23.298996 | ubuntu-noble-large | Readiness: exec [/bin/sh -c python3 -c "import os,socket; from urllib.parse import urlparse; raw=os.environ.get('OS_DATABASE__CONNECTION',''); u=urlparse('//'+raw.split('://',1)[-1]); socket.create_connection((u.hostname, u.port or 3306), 20).close()"] delay=10s timeout=25s period=30s #success=1 #failure=3 2026-06-30 17:43:23.299003 | ubuntu-noble-large | Startup: http-get http://:5000/v3 delay=0s timeout=1s period=10s #success=1 #failure=30 2026-06-30 17:43:23.299008 | ubuntu-noble-large | Environment: 2026-06-30 17:43:23.299013 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-06-30 17:43:23.299018 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:23.299023 | ubuntu-noble-large | /etc/keystone/credential-keys/ from credential-keys (ro) 2026-06-30 17:43:23.299029 | ubuntu-noble-large | /etc/keystone/fernet-keys/ from fernet-keys (ro) 2026-06-30 17:43:23.299033 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-06-30 17:43:23.299048 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s85c8 (ro) 2026-06-30 17:43:23.299054 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:23.299059 | ubuntu-noble-large | Type Status 2026-06-30 17:43:23.299064 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:23.299069 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:23.299074 | ubuntu-noble-large | Ready False 2026-06-30 17:43:23.299079 | ubuntu-noble-large | ContainersReady False 2026-06-30 17:43:23.299083 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:23.299088 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:23.299093 | ubuntu-noble-large | config: 2026-06-30 17:43:23.299141 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-06-30 17:43:23.299147 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-06-30 17:43:23.299152 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.299157 | ubuntu-noble-large | fernet-keys: 2026-06-30 17:43:23.299162 | ubuntu-noble-large | Type: Secret (a volume populated by a Secret) 2026-06-30 17:43:23.299168 | ubuntu-noble-large | SecretName: controlplane-keystone-fernet-keys 2026-06-30 17:43:23.299173 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.299178 | ubuntu-noble-large | credential-keys: 2026-06-30 17:43:23.299183 | ubuntu-noble-large | Type: Secret (a volume populated by a Secret) 2026-06-30 17:43:23.299189 | ubuntu-noble-large | SecretName: controlplane-keystone-credential-keys 2026-06-30 17:43:23.299194 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.299199 | ubuntu-noble-large | kube-api-access-s85c8: 2026-06-30 17:43:23.299204 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:23.299210 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:23.299215 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:23.299220 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.299225 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:23.299230 | ubuntu-noble-large | QoS Class: Burstable 2026-06-30 17:43:23.299235 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:23.299240 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:23.299258 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:23.299271 | ubuntu-noble-large | Topology Spread Constraints: kubernetes.io/hostname:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/instance=controlplane-keystone,app.kubernetes.io/name=keystone 2026-06-30 17:43:23.299279 | ubuntu-noble-large | topology.kubernetes.io/zone:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/instance=controlplane-keystone,app.kubernetes.io/name=keystone 2026-06-30 17:43:23.299286 | ubuntu-noble-large | Events: 2026-06-30 17:43:23.299291 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:23.299296 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:23.299301 | ubuntu-noble-large | Normal Scheduled 11m default-scheduler Successfully assigned openstack/controlplane-keystone-6d68dcd67c-7p6jq to forge-control-plane 2026-06-30 17:43:23.299307 | ubuntu-noble-large | Warning Unhealthy 11m kubelet spec.containers{keystone}: Startup probe failed: Get "http://10.244.0.47:5000/v3": read tcp 10.244.0.1:50280->10.244.0.47:5000: read: connection reset by peer 2026-06-30 17:43:23.299314 | ubuntu-noble-large | Warning Unhealthy 10m kubelet spec.containers{keystone}: Startup probe failed: Get "http://10.244.0.47:5000/v3": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-06-30 17:43:23.299319 | ubuntu-noble-large | Normal Pulled 13s (x8 over 11m) kubelet spec.containers{keystone}: Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:23.299324 | ubuntu-noble-large | Normal Created 13s (x8 over 11m) kubelet spec.containers{keystone}: Container created 2026-06-30 17:43:23.299330 | ubuntu-noble-large | Normal Started 13s (x8 over 11m) kubelet spec.containers{keystone}: Container started 2026-06-30 17:43:23.299335 | ubuntu-noble-large | Warning BackOff 8s (x23 over 11m) kubelet spec.containers{keystone}: Back-off restarting failed container keystone in pod controlplane-keystone-6d68dcd67c-7p6jq_openstack(3fb06dd9-2691-4a8c-a217-45e328bf304c) 2026-06-30 17:43:23.299342 | ubuntu-noble-large | Warning Unhealthy 8s kubelet spec.containers{keystone}: Startup probe failed: Get "http://10.244.0.47:5000/v3": dial tcp 10.244.0.47:5000: connect: connection refused 2026-06-30 17:43:23.303114 | ubuntu-noble-large | --- logs pod/controlplane-keystone-6d68dcd67c-7p6jq (current) --- 2026-06-30 17:43:23.446044 | ubuntu-noble-large | *** Starting uWSGI 2.0.31 (64bit) on [Tue Jun 30 17:43:10 2026] *** 2026-06-30 17:43:23.446151 | ubuntu-noble-large | compiled with version: 13.3.0 on 26 June 2026 06:54:41 2026-06-30 17:43:23.446167 | ubuntu-noble-large | os: Linux-6.8.0-124-generic #124-Ubuntu SMP PREEMPT_DYNAMIC Tue May 26 13:00:45 UTC 2026 2026-06-30 17:43:23.446179 | ubuntu-noble-large | nodename: controlplane-keystone-6d68dcd67c-7p6jq 2026-06-30 17:43:23.446190 | ubuntu-noble-large | machine: x86_64 2026-06-30 17:43:23.446201 | ubuntu-noble-large | clock source: unix 2026-06-30 17:43:23.446211 | ubuntu-noble-large | detected number of CPU cores: 8 2026-06-30 17:43:23.446231 | ubuntu-noble-large | current working directory: / 2026-06-30 17:43:23.446242 | ubuntu-noble-large | detected binary path: /var/lib/openstack/bin/uwsgi 2026-06-30 17:43:23.446252 | ubuntu-noble-large | !!! no internal routing support, rebuild with pcre support !!! 2026-06-30 17:43:23.446262 | ubuntu-noble-large | your memory page size is 4096 bytes 2026-06-30 17:43:23.446271 | ubuntu-noble-large | detected max file descriptor number: 1073741816 2026-06-30 17:43:23.446281 | ubuntu-noble-large | lock engine: pthread robust mutexes 2026-06-30 17:43:23.446290 | ubuntu-noble-large | thunder lock: disabled (you can enable it with --thunder-lock) 2026-06-30 17:43:23.446300 | ubuntu-noble-large | uWSGI http bound on :5000 fd 7 2026-06-30 17:43:23.446310 | ubuntu-noble-large | uwsgi socket 0 bound to TCP address 127.0.0.1:33889 (port auto-assigned) fd 6 2026-06-30 17:43:23.446320 | ubuntu-noble-large | Python version: 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0] 2026-06-30 17:43:23.446348 | ubuntu-noble-large | Python main interpreter initialized at 0x7ed7bf116668 2026-06-30 17:43:23.446358 | ubuntu-noble-large | python threads support enabled 2026-06-30 17:43:23.446368 | ubuntu-noble-large | your server socket listen backlog is limited to 100 connections 2026-06-30 17:43:23.446377 | ubuntu-noble-large | your mercy for graceful operations on workers is 60 seconds 2026-06-30 17:43:23.446387 | ubuntu-noble-large | mapped 218760 bytes (213 KB) for 2 cores 2026-06-30 17:43:23.446420 | ubuntu-noble-large | *** Operational MODE: preforking *** 2026-06-30 17:43:23.446431 | ubuntu-noble-large | *** uWSGI is running in multiple interpreter mode *** 2026-06-30 17:43:23.446442 | ubuntu-noble-large | spawned uWSGI master process (pid: 1) 2026-06-30 17:43:23.446452 | ubuntu-noble-large | spawned uWSGI worker 1 (pid: 14, cores: 1) 2026-06-30 17:43:23.446464 | ubuntu-noble-large | spawned uWSGI worker 2 (pid: 15, cores: 1) 2026-06-30 17:43:23.446474 | ubuntu-noble-large | spawned uWSGI http 1 (pid: 16) 2026-06-30 17:43:23.451916 | ubuntu-noble-large | --- logs pod/controlplane-keystone-6d68dcd67c-7p6jq (previous) --- 2026-06-30 17:43:23.591485 | ubuntu-noble-large | unable to retrieve container logs for containerd://d672fe4d991fafc92f11177be7084c3250a90542cb4169b167403b75ade8434d--- describe pod/controlplane-keystone-db-sync-q9p8d --- 2026-06-30 17:43:23.744470 | ubuntu-noble-large | Name: controlplane-keystone-db-sync-q9p8d 2026-06-30 17:43:23.744550 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:23.744561 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:23.744569 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:23.744577 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:23.744585 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:31:09 +0000 2026-06-30 17:43:23.744592 | ubuntu-noble-large | Labels: batch.kubernetes.io/controller-uid=6de9f325-4bd8-4b08-b478-34285dd8ccf7 2026-06-30 17:43:23.744600 | ubuntu-noble-large | batch.kubernetes.io/job-name=controlplane-keystone-db-sync 2026-06-30 17:43:23.744609 | ubuntu-noble-large | controller-uid=6de9f325-4bd8-4b08-b478-34285dd8ccf7 2026-06-30 17:43:23.744616 | ubuntu-noble-large | job-name=controlplane-keystone-db-sync 2026-06-30 17:43:23.744623 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:23.744630 | ubuntu-noble-large | Status: Succeeded 2026-06-30 17:43:23.744637 | ubuntu-noble-large | IP: 10.244.0.45 2026-06-30 17:43:23.744644 | ubuntu-noble-large | IPs: 2026-06-30 17:43:23.744651 | ubuntu-noble-large | IP: 10.244.0.45 2026-06-30 17:43:23.744658 | ubuntu-noble-large | Controlled By: Job/controlplane-keystone-db-sync 2026-06-30 17:43:23.744665 | ubuntu-noble-large | Containers: 2026-06-30 17:43:23.744672 | ubuntu-noble-large | db-sync: 2026-06-30 17:43:23.744680 | ubuntu-noble-large | Container ID: containerd://711868c4db85f0650ca7a5cfea25fe2059bba6eed144409ba99aa9831153b469 2026-06-30 17:43:23.744687 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-06-30 17:43:23.744694 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:f708d60beed11caabe9c3c3d54f5645615005491aefa6f9c491648253bd65b91 2026-06-30 17:43:23.744701 | ubuntu-noble-large | Port: 2026-06-30 17:43:23.744708 | ubuntu-noble-large | Host Port: 2026-06-30 17:43:23.744715 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-06-30 17:43:23.744722 | ubuntu-noble-large | Command: 2026-06-30 17:43:23.744729 | ubuntu-noble-large | keystone-manage 2026-06-30 17:43:23.744736 | ubuntu-noble-large | --config-dir=/etc/keystone/keystone.conf.d/ 2026-06-30 17:43:23.744743 | ubuntu-noble-large | db_sync 2026-06-30 17:43:23.744750 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:23.744757 | ubuntu-noble-large | Reason: Completed 2026-06-30 17:43:23.744764 | ubuntu-noble-large | Exit Code: 0 2026-06-30 17:43:23.744771 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:31:20 +0000 2026-06-30 17:43:23.744778 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:31:30 +0000 2026-06-30 17:43:23.744784 | ubuntu-noble-large | Ready: False 2026-06-30 17:43:23.744791 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:23.744798 | ubuntu-noble-large | Environment: 2026-06-30 17:43:23.744805 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-06-30 17:43:23.744812 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:23.744819 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-06-30 17:43:23.744826 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-fg6lw (ro) 2026-06-30 17:43:23.744833 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:23.744840 | ubuntu-noble-large | Type Status 2026-06-30 17:43:23.744847 | ubuntu-noble-large | PodReadyToStartContainers False 2026-06-30 17:43:23.744854 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:23.744860 | ubuntu-noble-large | Ready False 2026-06-30 17:43:23.744867 | ubuntu-noble-large | ContainersReady False 2026-06-30 17:43:23.744874 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:23.744918 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:23.744955 | ubuntu-noble-large | config: 2026-06-30 17:43:23.744962 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-06-30 17:43:23.744969 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-06-30 17:43:23.744976 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.744982 | ubuntu-noble-large | kube-api-access-fg6lw: 2026-06-30 17:43:23.744989 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:23.744996 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:23.745002 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:23.745009 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:23.745015 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:23.745022 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:23.745028 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:23.745035 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:23.745042 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:23.745048 | ubuntu-noble-large | Events: 2026-06-30 17:43:23.745055 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:23.745061 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:23.745068 | ubuntu-noble-large | Normal Scheduled 12m default-scheduler Successfully assigned openstack/controlplane-keystone-db-sync-q9p8d to forge-control-plane 2026-06-30 17:43:23.745076 | ubuntu-noble-large | Normal Pulling 12m kubelet spec.containers{db-sync}: Pulling image "ghcr.io/c5c3/keystone:2025.2" 2026-06-30 17:43:23.745084 | ubuntu-noble-large | Normal Pulled 12m kubelet spec.containers{db-sync}: Successfully pulled image "ghcr.io/c5c3/keystone:2025.2" in 10.231s (10.231s including waiting). Image size: 111504652 bytes. 2026-06-30 17:43:23.745116 | ubuntu-noble-large | Normal Created 12m kubelet spec.containers{db-sync}: Container created 2026-06-30 17:43:23.745124 | ubuntu-noble-large | Normal Started 12m kubelet spec.containers{db-sync}: Container started 2026-06-30 17:43:23.750129 | ubuntu-noble-large | --- logs pod/controlplane-keystone-db-sync-q9p8d (current) --- 2026-06-30 17:43:23.866861 | ubuntu-noble-large | Config file not found, using default configs. 2026-06-30 17:43:23.866979 | ubuntu-noble-large | 2026-06-30 17:31:26.782 1 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-06-30 17:43:23.866995 | ubuntu-noble-large | 2026-06-30 17:31:26.783 1 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-06-30 17:43:23.867005 | ubuntu-noble-large | 2026-06-30 17:31:26.860 1 INFO alembic.runtime.migration [-] Running upgrade -> 27e647c0fad4, Initial version. 2026-06-30 17:43:23.867015 | ubuntu-noble-large | 2026-06-30 17:31:29.995 1 INFO alembic.runtime.migration [-] Running upgrade 27e647c0fad4 -> 29e87d24a316, Initial no-op Yoga expand migration. 2026-06-30 17:43:23.867025 | ubuntu-noble-large | 2026-06-30 17:31:30.000 1 INFO alembic.runtime.migration [-] Running upgrade 29e87d24a316 -> b4f8b3f584e0, Fix incorrect constraints. 2026-06-30 17:43:23.867035 | ubuntu-noble-large | 2026-06-30 17:31:30.058 1 INFO alembic.runtime.migration [-] Running upgrade b4f8b3f584e0 -> 11c3b243b4cb, Remove service_provider.relay_state_prefix server default. 2026-06-30 17:43:23.867045 | ubuntu-noble-large | 2026-06-30 17:31:30.096 1 INFO alembic.runtime.migration [-] Running upgrade 11c3b243b4cb -> 47147121, Add Identity Federation attribute mapping schema version. 2026-06-30 17:43:23.867055 | ubuntu-noble-large | 2026-06-30 17:31:30.145 1 INFO alembic.runtime.migration [-] Running upgrade 27e647c0fad4 -> e25ffa003242, Initial no-op Yoga contract migration. 2026-06-30 17:43:23.867064 | ubuntu-noble-large | 2026-06-30 17:31:30.148 1 INFO alembic.runtime.migration [-] Running upgrade e25ffa003242 -> 99de3849d860, Fix incorrect constraints. 2026-06-30 17:43:23.867073 | ubuntu-noble-large | 2026-06-30 17:31:30.285 1 INFO alembic.runtime.migration [-] Running upgrade 99de3849d860 -> c88cdce8f248, Remove duplicate constraints. 2026-06-30 17:43:23.870971 | ubuntu-noble-large | --- logs pod/controlplane-keystone-db-sync-q9p8d (previous) --- 2026-06-30 17:43:23.992248 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "db-sync" in pod "controlplane-keystone-db-sync-q9p8d" not found 2026-06-30 17:43:23.996164 | ubuntu-noble-large | --- describe pod/controlplane-keystone-schema-check-7gg4q --- 2026-06-30 17:43:24.117622 | ubuntu-noble-large | Name: controlplane-keystone-schema-check-7gg4q 2026-06-30 17:43:24.117686 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:24.117694 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:24.117699 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:24.117703 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:24.117709 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:31:34 +0000 2026-06-30 17:43:24.117713 | ubuntu-noble-large | Labels: batch.kubernetes.io/controller-uid=054fd2da-8f75-4910-b891-5f891f92ea11 2026-06-30 17:43:24.117719 | ubuntu-noble-large | batch.kubernetes.io/job-name=controlplane-keystone-schema-check 2026-06-30 17:43:24.117724 | ubuntu-noble-large | controller-uid=054fd2da-8f75-4910-b891-5f891f92ea11 2026-06-30 17:43:24.117728 | ubuntu-noble-large | job-name=controlplane-keystone-schema-check 2026-06-30 17:43:24.117732 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:24.117736 | ubuntu-noble-large | Status: Succeeded 2026-06-30 17:43:24.117740 | ubuntu-noble-large | IP: 10.244.0.46 2026-06-30 17:43:24.117744 | ubuntu-noble-large | IPs: 2026-06-30 17:43:24.117749 | ubuntu-noble-large | IP: 10.244.0.46 2026-06-30 17:43:24.117753 | ubuntu-noble-large | Controlled By: Job/controlplane-keystone-schema-check 2026-06-30 17:43:24.117757 | ubuntu-noble-large | Containers: 2026-06-30 17:43:24.117761 | ubuntu-noble-large | schema-check: 2026-06-30 17:43:24.117765 | ubuntu-noble-large | Container ID: containerd://8798818740bf7c8f61c5366c7e2a2605e2d73b05af33e6666a96c8261f707549 2026-06-30 17:43:24.117769 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-06-30 17:43:24.117773 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:f708d60beed11caabe9c3c3d54f5645615005491aefa6f9c491648253bd65b91 2026-06-30 17:43:24.117778 | ubuntu-noble-large | Port: 2026-06-30 17:43:24.117782 | ubuntu-noble-large | Host Port: 2026-06-30 17:43:24.117786 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-06-30 17:43:24.117790 | ubuntu-noble-large | Command: 2026-06-30 17:43:24.117794 | ubuntu-noble-large | /bin/sh 2026-06-30 17:43:24.117797 | ubuntu-noble-large | -eu 2026-06-30 17:43:24.117801 | ubuntu-noble-large | -c 2026-06-30 17:43:24.117805 | ubuntu-noble-large | keystone-manage --config-dir=/etc/keystone/keystone.conf.d/ db_sync --check 2026-06-30 17:43:24.117809 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:24.117813 | ubuntu-noble-large | Reason: Completed 2026-06-30 17:43:24.117817 | ubuntu-noble-large | Exit Code: 0 2026-06-30 17:43:24.117821 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:31:35 +0000 2026-06-30 17:43:24.117825 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:31:42 +0000 2026-06-30 17:43:24.117829 | ubuntu-noble-large | Ready: False 2026-06-30 17:43:24.117833 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.117837 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.117841 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-06-30 17:43:24.117845 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.117849 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-06-30 17:43:24.117853 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tsxdg (ro) 2026-06-30 17:43:24.117857 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:24.117861 | ubuntu-noble-large | Type Status 2026-06-30 17:43:24.117865 | ubuntu-noble-large | PodReadyToStartContainers False 2026-06-30 17:43:24.117869 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:24.117873 | ubuntu-noble-large | Ready False 2026-06-30 17:43:24.117902 | ubuntu-noble-large | ContainersReady False 2026-06-30 17:43:24.117906 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:24.117964 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:24.117969 | ubuntu-noble-large | config: 2026-06-30 17:43:24.117973 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-06-30 17:43:24.117977 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-06-30 17:43:24.117981 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.117986 | ubuntu-noble-large | kube-api-access-tsxdg: 2026-06-30 17:43:24.117990 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.117994 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:24.117998 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:24.118002 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.118051 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:24.118056 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:24.118060 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:24.118065 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:24.118069 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:24.118073 | ubuntu-noble-large | Events: 2026-06-30 17:43:24.118078 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:24.118082 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:24.118098 | ubuntu-noble-large | Normal Scheduled 11m default-scheduler Successfully assigned openstack/controlplane-keystone-schema-check-7gg4q to forge-control-plane 2026-06-30 17:43:24.118105 | ubuntu-noble-large | Normal Pulled 11m kubelet spec.containers{schema-check}: Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.118110 | ubuntu-noble-large | Normal Created 11m kubelet spec.containers{schema-check}: Container created 2026-06-30 17:43:24.118115 | ubuntu-noble-large | Normal Started 11m kubelet spec.containers{schema-check}: Container started 2026-06-30 17:43:24.121740 | ubuntu-noble-large | --- logs pod/controlplane-keystone-schema-check-7gg4q (current) --- 2026-06-30 17:43:24.256954 | ubuntu-noble-large | Config file not found, using default configs. 2026-06-30 17:43:24.257054 | ubuntu-noble-large | 2026-06-30 17:31:41.899 14 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-06-30 17:43:24.257134 | ubuntu-noble-large | 2026-06-30 17:31:41.899 14 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-06-30 17:43:24.257142 | ubuntu-noble-large | 2026-06-30 17:31:41.946 14 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-06-30 17:43:24.257270 | ubuntu-noble-large | 2026-06-30 17:31:41.946 14 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-06-30 17:43:24.257282 | ubuntu-noble-large | 2026-06-30 17:31:41.993 14 INFO keystone.cmd.cli [-] All db_sync commands are upgraded to the same version and up-to-date. 2026-06-30 17:43:24.257289 | ubuntu-noble-large | 2026-06-30 17:31:41.993 14 INFO keystone.cmd.cli [-] Current repository versions: 2026-06-30 17:43:24.257418 | ubuntu-noble-large | Expand: 47147121 (head: 47147121) 2026-06-30 17:43:24.257429 | ubuntu-noble-large | Contract: c88cdce8f248 (head: c88cdce8f248) 2026-06-30 17:43:24.262531 | ubuntu-noble-large | --- logs pod/controlplane-keystone-schema-check-7gg4q (previous) --- 2026-06-30 17:43:24.379400 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "schema-check" in pod "controlplane-keystone-schema-check-7gg4q" not found 2026-06-30 17:43:24.384605 | ubuntu-noble-large | --- describe pod/openstack-db-0 --- 2026-06-30 17:43:24.498839 | ubuntu-noble-large | Name: openstack-db-0 2026-06-30 17:43:24.498920 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:24.498927 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:24.498931 | ubuntu-noble-large | Service Account: openstack-db 2026-06-30 17:43:24.498935 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:24.498940 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:54 +0000 2026-06-30 17:43:24.498944 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-06-30 17:43:24.498948 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-06-30 17:43:24.498952 | ubuntu-noble-large | apps.kubernetes.io/pod-index=0 2026-06-30 17:43:24.498956 | ubuntu-noble-large | controller-revision-hash=openstack-db-7c9978c654 2026-06-30 17:43:24.498961 | ubuntu-noble-large | k8s.mariadb.com/role=primary 2026-06-30 17:43:24.498965 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-0 2026-06-30 17:43:24.498969 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 7efd69c42bb4815b92f679ca11d9f1b70944aaf60b861f8630587c1ebe39b816 2026-06-30 17:43:24.498974 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 5c61cd61d5bf25189d1bdbedccd5f88af5cc3c8b53f7c654fca3b22f632ee57b 2026-06-30 17:43:24.498978 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-06-30 17:43:24.498981 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-06-30 17:43:24.499001 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-06-30 17:43:24.499005 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-06-30 17:43:24.499009 | ubuntu-noble-large | k8s.mariadb.com/server-cert: cb9abbd4591b7a8ddf8421596b7ba7779e383a3525559bb83c8075214be78d21 2026-06-30 17:43:24.499012 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:24.499016 | ubuntu-noble-large | IP: 10.244.0.42 2026-06-30 17:43:24.499020 | ubuntu-noble-large | IPs: 2026-06-30 17:43:24.499024 | ubuntu-noble-large | IP: 10.244.0.42 2026-06-30 17:43:24.499028 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-06-30 17:43:24.499031 | ubuntu-noble-large | Init Containers: 2026-06-30 17:43:24.499035 | ubuntu-noble-large | init: 2026-06-30 17:43:24.499039 | ubuntu-noble-large | Container ID: containerd://ad9ce19f5253db53d88d04cc8dc794b76f66d743dc51582198e36b1ac2633b40 2026-06-30 17:43:24.499043 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:24.499047 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:24.499051 | ubuntu-noble-large | Port: 2026-06-30 17:43:24.499055 | ubuntu-noble-large | Host Port: 2026-06-30 17:43:24.499058 | ubuntu-noble-large | Args: 2026-06-30 17:43:24.499062 | ubuntu-noble-large | init 2026-06-30 17:43:24.499066 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:24.499069 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:24.499073 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:24.499077 | ubuntu-noble-large | Reason: Completed 2026-06-30 17:43:24.499101 | ubuntu-noble-large | Exit Code: 0 2026-06-30 17:43:24.499105 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:55 +0000 2026-06-30 17:43:24.499109 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:28:55 +0000 2026-06-30 17:43:24.499112 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.499116 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.499119 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.499123 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.499127 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.499131 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.499143 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-06-30 17:43:24.499147 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.499151 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.499154 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.499158 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.499161 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.499165 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.499168 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.499172 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.499175 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.499179 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.499183 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.499186 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.499190 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.499193 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.499197 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.499200 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.499204 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.499208 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.499211 | ubuntu-noble-large | Containers: 2026-06-30 17:43:24.499215 | ubuntu-noble-large | mariadb: 2026-06-30 17:43:24.499218 | ubuntu-noble-large | Container ID: containerd://df836d860fd3e21c7a7949c00a4bd54efff9bd92f0d5c18c8096684d4635c516 2026-06-30 17:43:24.499222 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-06-30 17:43:24.499226 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-06-30 17:43:24.499236 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-06-30 17:43:24.499240 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-06-30 17:43:24.499243 | ubuntu-noble-large | State: Running 2026-06-30 17:43:24.499247 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:56 +0000 2026-06-30 17:43:24.499250 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.499254 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.499258 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.499262 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.499275 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.499279 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.499283 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.499286 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.499290 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.499294 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-06-30 17:43:24.499297 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.499301 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.499304 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.499308 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.499312 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.499315 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.500001 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.500016 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.500020 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.500024 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.500028 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.500032 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.500037 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.500041 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.500045 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.500049 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.500053 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.500056 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.500060 | ubuntu-noble-large | agent: 2026-06-30 17:43:24.500064 | ubuntu-noble-large | Container ID: containerd://5e2d61f8d40554d00175f5246ecfab68f5aa937e64fdf7529e07b8618f7085e9 2026-06-30 17:43:24.500068 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:24.500072 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:24.500076 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-06-30 17:43:24.500095 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-06-30 17:43:24.500099 | ubuntu-noble-large | Args: 2026-06-30 17:43:24.500103 | ubuntu-noble-large | agent 2026-06-30 17:43:24.500107 | ubuntu-noble-large | --addr=:5555 2026-06-30 17:43:24.500111 | ubuntu-noble-large | --probe-addr=:5566 2026-06-30 17:43:24.500114 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:24.500118 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:24.500122 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-06-30 17:43:24.500125 | ubuntu-noble-large | --kubernetes-auth 2026-06-30 17:43:24.500129 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-06-30 17:43:24.500133 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-06-30 17:43:24.500137 | ubuntu-noble-large | State: Running 2026-06-30 17:43:24.500140 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:56 +0000 2026-06-30 17:43:24.500159 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.500163 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.500167 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:24.500178 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:24.500182 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.500186 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.500189 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.500193 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.500197 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-06-30 17:43:24.500201 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.500204 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.500208 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.500212 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.500215 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.500219 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.500222 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.500226 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.500229 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.500233 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.500237 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.500241 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.500245 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.500248 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.500252 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.500256 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.500259 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.500263 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.500267 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:24.500270 | ubuntu-noble-large | Type Status 2026-06-30 17:43:24.500274 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:24.500278 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:24.500281 | ubuntu-noble-large | Ready True 2026-06-30 17:43:24.500285 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:24.500289 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:24.500292 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:24.500296 | ubuntu-noble-large | storage: 2026-06-30 17:43:24.500300 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:24.500304 | ubuntu-noble-large | ClaimName: storage-openstack-db-0 2026-06-30 17:43:24.500308 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:24.500311 | ubuntu-noble-large | galera: 2026-06-30 17:43:24.500315 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:24.500319 | ubuntu-noble-large | ClaimName: galera-openstack-db-0 2026-06-30 17:43:24.500323 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:24.500326 | ubuntu-noble-large | config: 2026-06-30 17:43:24.500330 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.500343 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-06-30 17:43:24.500348 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500351 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-06-30 17:43:24.500355 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500359 | ubuntu-noble-large | pki: 2026-06-30 17:43:24.500363 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.500366 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-06-30 17:43:24.500370 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500374 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-06-30 17:43:24.500377 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500381 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-06-30 17:43:24.500394 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500398 | ubuntu-noble-large | serviceaccount: 2026-06-30 17:43:24.500402 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.500406 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-06-30 17:43:24.500409 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:24.500413 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.500417 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:24.500420 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:24.500424 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:24.500428 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:24.500431 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:24.500435 | ubuntu-noble-large | Events: 2026-06-30 17:43:24.500439 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:24.500442 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:24.500446 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-0 to forge-control-plane 2026-06-30 17:43:24.500452 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.500458 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-06-30 17:43:24.500462 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-06-30 17:43:24.500466 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.500471 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{mariadb}: Container created 2026-06-30 17:43:24.500475 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{mariadb}: Container started 2026-06-30 17:43:24.500481 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.500485 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{agent}: Container created 2026-06-30 17:43:24.500488 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{agent}: Container started 2026-06-30 17:43:24.500493 | ubuntu-noble-large | Warning Unhealthy 14m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.42:5566/health": dial tcp 10.244.0.42:5566: connect: connection refused 2026-06-30 17:43:24.500497 | ubuntu-noble-large | Warning Unhealthy 12m (x3 over 13m) kubelet spec.containers{mariadb}: Readiness probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:24.502344 | ubuntu-noble-large | --- logs pod/openstack-db-0 (current) --- 2026-06-30 17:43:24.610778 | ubuntu-noble-large | {"level":"info","ts":1782840535.5423703,"msg":"Starting init"} 2026-06-30 17:43:24.610855 | ubuntu-noble-large | {"level":"info","ts":1782840535.5859442,"msg":"Configuring Galera"} 2026-06-30 17:43:24.610870 | ubuntu-noble-large | {"level":"info","ts":1782840535.5864263,"msg":"Configuring Galera bootstrap"} 2026-06-30 17:43:24.610917 | ubuntu-noble-large | {"level":"info","ts":1782840535.586533,"msg":"Init done"} 2026-06-30 17:43:24.619679 | ubuntu-noble-large | Version: '11.4.5-MariaDB-ubu2404' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2026-06-30 17:43:24.619724 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: (2c9cf50e-b69e, 'tcp://0.0.0.0:4567') connection established to 420b122f-bde3 tcp://10.244.0.43:4567 2026-06-30 17:43:24.619731 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: declaring 420b122f-bde3 at tcp://10.244.0.43:4567 stable 2026-06-30 17:43:24.619756 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: Node 2c9cf50e-b69e state prim 2026-06-30 17:43:24.619761 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: view(view_id(PRIM,2c9cf50e-b69e,2) memb { 2026-06-30 17:43:24.619766 | ubuntu-noble-large | 2c9cf50e-b69e,0 2026-06-30 17:43:24.619770 | ubuntu-noble-large | 420b122f-bde3,0 2026-06-30 17:43:24.619774 | ubuntu-noble-large | } joined { 2026-06-30 17:43:24.619778 | ubuntu-noble-large | } left { 2026-06-30 17:43:24.619782 | ubuntu-noble-large | } partitioned { 2026-06-30 17:43:24.619786 | ubuntu-noble-large | }) 2026-06-30 17:43:24.619797 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: save pc into disk 2026-06-30 17:43:24.619801 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2026-06-30 17:43:24.619805 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 43193a2b-74a9-11f1-b3b9-a6c90e9bff1d 2026-06-30 17:43:24.619809 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 43193a2b-74a9-11f1-b3b9-a6c90e9bff1d 2026-06-30 17:43:24.619813 | ubuntu-noble-large | 2026-06-30 17:29:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 43193a2b-74a9-11f1-b3b9-a6c90e9bff1d from 0 (openstack-db-0) 2026-06-30 17:43:24.619817 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 43193a2b-74a9-11f1-b3b9-a6c90e9bff1d from 1 (openstack-db-1) 2026-06-30 17:43:24.619820 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Quorum results: 2026-06-30 17:43:24.619824 | ubuntu-noble-large | version = 6, 2026-06-30 17:43:24.619828 | ubuntu-noble-large | component = PRIMARY, 2026-06-30 17:43:24.619831 | ubuntu-noble-large | conf_id = 1, 2026-06-30 17:43:24.619835 | ubuntu-noble-large | members = 1/2 (joined/total), 2026-06-30 17:43:24.619838 | ubuntu-noble-large | act_id = 1, 2026-06-30 17:43:24.619842 | ubuntu-noble-large | last_appl. = 0, 2026-06-30 17:43:24.619846 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-06-30 17:43:24.619849 | ubuntu-noble-large | vote policy= 0, 2026-06-30 17:43:24.619853 | ubuntu-noble-large | group UUID = 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:24.619856 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Flow-control interval: [23, 23] 2026-06-30 17:43:24.619860 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### processing CC 2, local, ordered 2026-06-30 17:43:24.619864 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### My UUID: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846 2026-06-30 17:43:24.619867 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Skipping cert index reset 2026-06-30 17:43:24.619871 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:24.619875 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2026-06-30 17:43:24.619902 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:24.619906 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ================================================ 2026-06-30 17:43:24.619910 | ubuntu-noble-large | View: 2026-06-30 17:43:24.619914 | ubuntu-noble-large | id: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:24.619918 | ubuntu-noble-large | status: primary 2026-06-30 17:43:24.619922 | ubuntu-noble-large | protocol_version: 4 2026-06-30 17:43:24.619926 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-06-30 17:43:24.619931 | ubuntu-noble-large | final: no 2026-06-30 17:43:24.619934 | ubuntu-noble-large | own_index: 0 2026-06-30 17:43:24.619938 | ubuntu-noble-large | members(2): 2026-06-30 17:43:24.619942 | ubuntu-noble-large | 0: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846, openstack-db-0 2026-06-30 17:43:24.619945 | ubuntu-noble-large | 1: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:24.619949 | ubuntu-noble-large | ================================================= 2026-06-30 17:43:24.619952 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.619957 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Lowest cert index boundary for CC from group: 2 2026-06-30 17:43:24.619960 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Min available from gcache for CC from group: 1 2026-06-30 17:43:24.619964 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Member 1.0 (openstack-db-1) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-06-30 17:43:24.619968 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2) 2026-06-30 17:43:24.619971 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Detected STR version: 1, req_len: 126, req: STRv1 2026-06-30 17:43:24.619992 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Cert index preload: 2 -> 2 2026-06-30 17:43:24.619996 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Server status change synced -> donor 2026-06-30 17:43:24.620000 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.620004 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: async IST sender starting to serve tcp://10.244.0.43:4568 sending 2-2, preload starts from 2 2026-06-30 17:43:24.620007 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Donor monitor thread started to monitor 2026-06-30 17:43:24.620012 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.244.0.43:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '2ca3d0df-74a9-11f1-a02a-527197580005:2' --gtid-domain-id 0' 2026-06-30 17:43:24.620017 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: sst_donor_thread signaled with 0 2026-06-30 17:43:24.620021 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: IST sender 2 -> 2 2026-06-30 17:43:24.620024 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on donor (20260630 17:29:37.077) 2026-06-30 17:43:24.620028 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260630 17:29:37.211) 2026-06-30 17:43:24.620033 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260630 17:29:37.654) 2026-06-30 17:43:24.620038 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260630 17:29:37.659) 2026-06-30 17:43:24.620041 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260630 17:29:37.685) 2026-06-30 17:43:24.620045 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260630 17:29:37.688) 2026-06-30 17:43:24.620053 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.5gYFB7QYwo' as mariadb-backup temporary directory (20260630 17:29:37.747) 2026-06-30 17:43:24.620057 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.IlkPKVJbBe' as mariadb-backup working directory (20260630 17:29:37.751) 2026-06-30 17:43:24.620060 | ubuntu-noble-large | WSREP_SST: [INFO] Estimating total transfer size (20260630 17:29:37.756) 2026-06-30 17:43:24.620064 | ubuntu-noble-large | WSREP_SST: [INFO] SST footprint estimate: data: 44613632, undo: 0 (20260630 17:29:37.772) 2026-06-30 17:43:24.620067 | ubuntu-noble-large | WSREP_SST: [INFO] To transfer: 44613632 (20260630 17:29:37.777) 2026-06-30 17:43:24.620071 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming GTID file before SST (20260630 17:29:37.783) 2026-06-30 17:43:24.620075 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'mariadb_backup_galera_info' 'donor_galera_info' | socat -u stdio TCP:10.244.0.43:4444; RC=( ${PIPESTATUS[@]} ) (20260630 17:29:37.787) 2026-06-30 17:43:24.620096 | ubuntu-noble-large | WSREP_SST: [INFO] Sleeping before data transfer for SST (20260630 17:29:37.802) 2026-06-30 17:43:24.620100 | ubuntu-noble-large | 2026-06-30 17:29:37 0 [Note] WSREP: (2c9cf50e-b69e, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-06-30 17:43:24.620104 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming the backup to joiner at 10.244.0.43:4444 (20260630 17:29:47.812) 2026-06-30 17:43:24.620111 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --backup --no-version-check --databases-exclude='lost+found' --tmpdir='/tmp/tmp.5gYFB7QYwo' --innodb-data-home-dir='.' --user='root' --socket='/run/mysqld/mysqld.sock' --galera-info --stream=mbstream --target-dir='/tmp/tmp.IlkPKVJbBe' --datadir='/var/lib/mysql' 2> '/var/lib/mysql/mariabackup.backup.log' | socat -u stdio TCP:10.244.0.43:4444; RC=( ${PIPESTATUS[@]} ) (20260630 17:29:47.818) 2026-06-30 17:43:24.620117 | ubuntu-noble-large | 2026-06-30 17:29:48 15 [Note] WSREP: Server not desynched from group at BLOCK_DDL because mariabackup is used. 2026-06-30 17:43:24.620121 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: SST sent: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:24.620124 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Server status change donor -> joined 2026-06-30 17:43:24.620127 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 1.0 (openstack-db-1) complete. 2026-06-30 17:43:24.620135 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2) 2026-06-30 17:43:24.620138 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-06-30 17:43:24.620142 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-06-30 17:43:24.620145 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-06-30 17:43:24.620148 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2026-06-30 17:43:24.620152 | ubuntu-noble-large | 2026-06-30 17:29:53 2 [Note] WSREP: Server openstack-db-0 synced with group 2026-06-30 17:43:24.620155 | ubuntu-noble-large | 2026-06-30 17:29:53 2 [Note] WSREP: Server status change joined -> synced 2026-06-30 17:43:24.620158 | ubuntu-noble-large | 2026-06-30 17:29:53 2 [Note] WSREP: Synchronized with group, ready for connections 2026-06-30 17:43:24.620162 | ubuntu-noble-large | 2026-06-30 17:29:53 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.620165 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on donor: 0 seconds (20260630 17:29:53.651) 2026-06-30 17:43:24.620177 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on donor (20260630 17:29:53.658) 2026-06-30 17:43:24.620181 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260630 17:29:53.674) 2026-06-30 17:43:24.620184 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Donor monitor thread ended with total time 17 sec 2026-06-30 17:43:24.620188 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: async IST sender served 2026-06-30 17:43:24.620191 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: 1.0 (openstack-db-1): State transfer from 0.0 (openstack-db-0) complete. 2026-06-30 17:43:24.620194 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Member 1.0 (openstack-db-1) synced with group. 2026-06-30 17:43:24.620198 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: (2c9cf50e-b69e, 'tcp://0.0.0.0:4567') connection established to 54b040ef-9af8 tcp://10.244.0.44:4567 2026-06-30 17:43:24.620201 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 420b122f-bde3 at tcp://10.244.0.43:4567 stable 2026-06-30 17:43:24.620205 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 54b040ef-9af8 at tcp://10.244.0.44:4567 stable 2026-06-30 17:43:24.620208 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: Node 2c9cf50e-b69e state prim 2026-06-30 17:43:24.620211 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: view(view_id(PRIM,2c9cf50e-b69e,3) memb { 2026-06-30 17:43:24.620215 | ubuntu-noble-large | 2c9cf50e-b69e,0 2026-06-30 17:43:24.620218 | ubuntu-noble-large | 420b122f-bde3,0 2026-06-30 17:43:24.620221 | ubuntu-noble-large | 54b040ef-9af8,0 2026-06-30 17:43:24.620225 | ubuntu-noble-large | } joined { 2026-06-30 17:43:24.620228 | ubuntu-noble-large | } left { 2026-06-30 17:43:24.620232 | ubuntu-noble-large | } partitioned { 2026-06-30 17:43:24.620235 | ubuntu-noble-large | }) 2026-06-30 17:43:24.620239 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: save pc into disk 2026-06-30 17:43:24.620242 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2026-06-30 17:43:24.620246 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa 2026-06-30 17:43:24.620249 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa 2026-06-30 17:43:24.620252 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 0 (openstack-db-0) 2026-06-30 17:43:24.620261 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 1 (openstack-db-1) 2026-06-30 17:43:24.620264 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 2 (openstack-db-2) 2026-06-30 17:43:24.620268 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Quorum results: 2026-06-30 17:43:24.620271 | ubuntu-noble-large | version = 6, 2026-06-30 17:43:24.620275 | ubuntu-noble-large | component = PRIMARY, 2026-06-30 17:43:24.620278 | ubuntu-noble-large | conf_id = 2, 2026-06-30 17:43:24.620281 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-06-30 17:43:24.620285 | ubuntu-noble-large | act_id = 2, 2026-06-30 17:43:24.620288 | ubuntu-noble-large | last_appl. = 0, 2026-06-30 17:43:24.620295 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-06-30 17:43:24.620298 | ubuntu-noble-large | vote policy= 0, 2026-06-30 17:43:24.620302 | ubuntu-noble-large | group UUID = 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:24.620305 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-06-30 17:43:24.620309 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-06-30 17:43:24.620312 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### My UUID: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846 2026-06-30 17:43:24.620315 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Skipping cert index reset 2026-06-30 17:43:24.620319 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:24.620322 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-06-30 17:43:24.620325 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:24.620329 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ================================================ 2026-06-30 17:43:24.620332 | ubuntu-noble-large | View: 2026-06-30 17:43:24.620336 | ubuntu-noble-large | id: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:24.620339 | ubuntu-noble-large | status: primary 2026-06-30 17:43:24.620342 | ubuntu-noble-large | protocol_version: 4 2026-06-30 17:43:24.620346 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-06-30 17:43:24.620349 | ubuntu-noble-large | final: no 2026-06-30 17:43:24.620353 | ubuntu-noble-large | own_index: 0 2026-06-30 17:43:24.620356 | ubuntu-noble-large | members(3): 2026-06-30 17:43:24.620360 | ubuntu-noble-large | 0: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846, openstack-db-0 2026-06-30 17:43:24.620363 | ubuntu-noble-large | 1: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:24.620366 | ubuntu-noble-large | 2: 54b040ef-74a9-11f1-9af8-d69ea190cc0a, openstack-db-2 2026-06-30 17:43:24.620370 | ubuntu-noble-large | ================================================= 2026-06-30 17:43:24.620373 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.620377 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Lowest cert index boundary for CC from group: 3 2026-06-30 17:43:24.620380 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Min available from gcache for CC from group: 1 2026-06-30 17:43:24.620383 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: (2c9cf50e-b69e, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-06-30 17:43:24.620387 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-06-30 17:43:24.620390 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 3) 2026-06-30 17:43:24.620394 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Detected STR version: 1, req_len: 126, req: STRv1 2026-06-30 17:43:24.620397 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Cert index preload: 3 -> 3 2026-06-30 17:43:24.620400 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Server status change synced -> donor 2026-06-30 17:43:24.620404 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.620407 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: async IST sender starting to serve tcp://10.244.0.44:4568 sending 3-3, preload starts from 3 2026-06-30 17:43:24.620411 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Donor monitor thread started to monitor 2026-06-30 17:43:24.620415 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.244.0.44:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '2ca3d0df-74a9-11f1-a02a-527197580005:3' --gtid-domain-id 0' 2026-06-30 17:43:24.620418 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: sst_donor_thread signaled with 0 2026-06-30 17:43:24.620422 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: IST sender 3 -> 3 2026-06-30 17:43:24.620425 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on donor (20260630 17:30:09.842) 2026-06-30 17:43:24.620429 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260630 17:30:09.966) 2026-06-30 17:43:24.620439 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260630 17:30:10.403) 2026-06-30 17:43:24.620442 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260630 17:30:10.408) 2026-06-30 17:43:24.620446 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260630 17:30:10.430) 2026-06-30 17:43:24.620449 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260630 17:30:10.436) 2026-06-30 17:43:24.620453 | ubuntu-noble-large | WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.backup.log' to '/tmp/sst_log_archive/mariabackup.backup.log.2026.06.30-17.30.10.443276036' (20260630 17:30:10.449) 2026-06-30 17:43:24.620461 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.mby5ZLazN3' as mariadb-backup temporary directory (20260630 17:30:10.526) 2026-06-30 17:43:24.620465 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.w3Voc4JIoE' as mariadb-backup working directory (20260630 17:30:10.533) 2026-06-30 17:43:24.620468 | ubuntu-noble-large | WSREP_SST: [INFO] Estimating total transfer size (20260630 17:30:10.538) 2026-06-30 17:43:24.620472 | ubuntu-noble-large | WSREP_SST: [INFO] SST footprint estimate: data: 44613632, undo: 0 (20260630 17:30:10.555) 2026-06-30 17:43:24.620475 | ubuntu-noble-large | WSREP_SST: [INFO] To transfer: 44613632 (20260630 17:30:10.560) 2026-06-30 17:43:24.620479 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming GTID file before SST (20260630 17:30:10.565) 2026-06-30 17:43:24.620482 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'mariadb_backup_galera_info' 'donor_galera_info' | socat -u stdio TCP:10.244.0.44:4444; RC=( ${PIPESTATUS[@]} ) (20260630 17:30:10.571) 2026-06-30 17:43:24.620486 | ubuntu-noble-large | WSREP_SST: [INFO] Sleeping before data transfer for SST (20260630 17:30:10.587) 2026-06-30 17:43:24.620489 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming the backup to joiner at 10.244.0.44:4444 (20260630 17:30:20.598) 2026-06-30 17:43:24.620493 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --backup --no-version-check --databases-exclude='lost+found' --tmpdir='/tmp/tmp.mby5ZLazN3' --innodb-data-home-dir='.' --user='root' --socket='/run/mysqld/mysqld.sock' --galera-info --stream=mbstream --target-dir='/tmp/tmp.w3Voc4JIoE' --datadir='/var/lib/mysql' 2> '/var/lib/mysql/mariabackup.backup.log' | socat -u stdio TCP:10.244.0.44:4444; RC=( ${PIPESTATUS[@]} ) (20260630 17:30:20.605) 2026-06-30 17:43:24.620496 | ubuntu-noble-large | 2026-06-30 17:30:21 24 [Note] WSREP: Server not desynched from group at BLOCK_DDL because mariabackup is used. 2026-06-30 17:43:24.620500 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: SST sent: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:24.620503 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Server status change donor -> joined 2026-06-30 17:43:24.620507 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-06-30 17:43:24.620510 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 3) 2026-06-30 17:43:24.620513 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-06-30 17:43:24.620517 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-06-30 17:43:24.620520 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-06-30 17:43:24.620523 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 3) 2026-06-30 17:43:24.620529 | ubuntu-noble-large | 2026-06-30 17:30:26 2 [Note] WSREP: Server openstack-db-0 synced with group 2026-06-30 17:43:24.620533 | ubuntu-noble-large | 2026-06-30 17:30:26 2 [Note] WSREP: Server status change joined -> synced 2026-06-30 17:43:24.620536 | ubuntu-noble-large | 2026-06-30 17:30:26 2 [Note] WSREP: Synchronized with group, ready for connections 2026-06-30 17:43:24.620539 | ubuntu-noble-large | 2026-06-30 17:30:26 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:24.620543 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on donor: 0 seconds (20260630 17:30:26.557) 2026-06-30 17:43:24.620546 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on donor (20260630 17:30:26.565) 2026-06-30 17:43:24.620549 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260630 17:30:26.578) 2026-06-30 17:43:24.620559 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Donor monitor thread ended with total time 17 sec 2026-06-30 17:43:24.620563 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: async IST sender served 2026-06-30 17:43:24.620566 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-06-30 17:43:24.620569 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-06-30 17:43:24.620573 | ubuntu-noble-large | 2026-06-30 17:31:30 58 [Warning] Aborted connection 58 to db: 'keystone' user: 'controlplane-keystone' host: '10.244.0.45' (Got an error reading communication packets) 2026-06-30 17:43:24.620577 | ubuntu-noble-large | 2026-06-30 17:31:42 68 [Warning] Aborted connection 68 to db: 'keystone' user: 'controlplane-keystone' host: '10.244.0.46' (Got an error reading communication packets) 2026-06-30 17:43:24.628962 | ubuntu-noble-large | {"level":"info","ts":1782840536.5283904,"msg":"Agent starting"} 2026-06-30 17:43:24.629033 | ubuntu-noble-large | {"level":"info","ts":1782840536.528928,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-06-30 17:43:24.629047 | ubuntu-noble-large | {"level":"info","ts":1782840536.529703,"logger":"api","msg":"Configuring TLS"} 2026-06-30 17:43:24.629057 | ubuntu-noble-large | {"level":"info","ts":1782840536.5327644,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-06-30 17:43:24.629068 | ubuntu-noble-large | {"level":"info","ts":1782840536.5339482,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-06-30 17:43:24.629110 | ubuntu-noble-large | {"level":"error","ts":1782840585.034984,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-06-30 17:43:24.629125 | ubuntu-noble-large | {"level":"error","ts":1782840615.0412426,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-06-30 17:43:24.629165 | ubuntu-noble-large | {"level":"error","ts":1782840625.0361202,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-06-30 17:43:24.629198 | ubuntu-noble-large | 2026/06/30 17:30:37 "DELETE https://openstack-db-0.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.18:34334 - 200 0B in 5.044943ms 2026-06-30 17:43:24.634235 | ubuntu-noble-large | --- logs pod/openstack-db-0 (previous) --- 2026-06-30 17:43:24.768385 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "init" in pod "openstack-db-0" not found 2026-06-30 17:43:24.774114 | ubuntu-noble-large | --- describe pod/openstack-db-1 --- 2026-06-30 17:43:24.904735 | ubuntu-noble-large | Name: openstack-db-1 2026-06-30 17:43:24.904852 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:24.904874 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:24.904943 | ubuntu-noble-large | Service Account: openstack-db 2026-06-30 17:43:24.904961 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:24.904977 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:54 +0000 2026-06-30 17:43:24.904992 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-06-30 17:43:24.905008 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-06-30 17:43:24.905023 | ubuntu-noble-large | apps.kubernetes.io/pod-index=1 2026-06-30 17:43:24.905038 | ubuntu-noble-large | controller-revision-hash=openstack-db-7c9978c654 2026-06-30 17:43:24.905054 | ubuntu-noble-large | k8s.mariadb.com/role=replica 2026-06-30 17:43:24.905069 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-1 2026-06-30 17:43:24.905150 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 7efd69c42bb4815b92f679ca11d9f1b70944aaf60b861f8630587c1ebe39b816 2026-06-30 17:43:24.905168 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 5c61cd61d5bf25189d1bdbedccd5f88af5cc3c8b53f7c654fca3b22f632ee57b 2026-06-30 17:43:24.905184 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-06-30 17:43:24.905199 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-06-30 17:43:24.905214 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-06-30 17:43:24.905229 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-06-30 17:43:24.905244 | ubuntu-noble-large | k8s.mariadb.com/server-cert: cb9abbd4591b7a8ddf8421596b7ba7779e383a3525559bb83c8075214be78d21 2026-06-30 17:43:24.905260 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:24.905275 | ubuntu-noble-large | IP: 10.244.0.43 2026-06-30 17:43:24.905290 | ubuntu-noble-large | IPs: 2026-06-30 17:43:24.905306 | ubuntu-noble-large | IP: 10.244.0.43 2026-06-30 17:43:24.905322 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-06-30 17:43:24.905337 | ubuntu-noble-large | Init Containers: 2026-06-30 17:43:24.905352 | ubuntu-noble-large | init: 2026-06-30 17:43:24.905368 | ubuntu-noble-large | Container ID: containerd://90b489a7724a0713a3f1a0d70b6ce77aae92ea13fcf50fef8606f1c6705f09ef 2026-06-30 17:43:24.905383 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:24.905399 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:24.905450 | ubuntu-noble-large | Port: 2026-06-30 17:43:24.905466 | ubuntu-noble-large | Host Port: 2026-06-30 17:43:24.905482 | ubuntu-noble-large | Args: 2026-06-30 17:43:24.905498 | ubuntu-noble-large | init 2026-06-30 17:43:24.905514 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:24.905530 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:24.905545 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:24.905561 | ubuntu-noble-large | Reason: Completed 2026-06-30 17:43:24.905576 | ubuntu-noble-large | Exit Code: 0 2026-06-30 17:43:24.905593 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:55 +0000 2026-06-30 17:43:24.905608 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:29:25 +0000 2026-06-30 17:43:24.905624 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.905639 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.905654 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.905670 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.905686 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.905701 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.905716 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-06-30 17:43:24.905732 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.905747 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.905762 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.905778 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.905793 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.905808 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.905823 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.905838 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.905853 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.905868 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.905914 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.905938 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.905955 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.905971 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.905987 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.906003 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.906033 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.906050 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.906065 | ubuntu-noble-large | Containers: 2026-06-30 17:43:24.906106 | ubuntu-noble-large | mariadb: 2026-06-30 17:43:24.906123 | ubuntu-noble-large | Container ID: containerd://a8e2b4ba493743831c027cf2309a6890e72118908b0ca56629888d59debd5f81 2026-06-30 17:43:24.906138 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-06-30 17:43:24.906154 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-06-30 17:43:24.906171 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-06-30 17:43:24.906187 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-06-30 17:43:24.906203 | ubuntu-noble-large | State: Running 2026-06-30 17:43:24.906219 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:29:26 +0000 2026-06-30 17:43:24.906234 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.906250 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.906267 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.906282 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.906320 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:24.906337 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.906353 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.906382 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.906398 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.906414 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-06-30 17:43:24.906429 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.906444 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.906459 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.906475 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.906490 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.906505 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.906520 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.906536 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.906552 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.906567 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.906583 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.906599 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.906614 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.906629 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.906644 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.906659 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.906675 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.906690 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.906706 | ubuntu-noble-large | agent: 2026-06-30 17:43:24.906722 | ubuntu-noble-large | Container ID: containerd://1e47d6289c94dfc2b75ddd3862fed1ff9297e6546036a8c899606a5be67a3a46 2026-06-30 17:43:24.906737 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:24.906752 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:24.906767 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-06-30 17:43:24.906782 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-06-30 17:43:24.906797 | ubuntu-noble-large | Args: 2026-06-30 17:43:24.906813 | ubuntu-noble-large | agent 2026-06-30 17:43:24.906829 | ubuntu-noble-large | --addr=:5555 2026-06-30 17:43:24.906845 | ubuntu-noble-large | --probe-addr=:5566 2026-06-30 17:43:24.906861 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:24.906903 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:24.906928 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-06-30 17:43:24.906944 | ubuntu-noble-large | --kubernetes-auth 2026-06-30 17:43:24.906960 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-06-30 17:43:24.906975 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-06-30 17:43:24.906990 | ubuntu-noble-large | State: Running 2026-06-30 17:43:24.907006 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:29:26 +0000 2026-06-30 17:43:24.907021 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:24.907038 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:24.907053 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:24.907069 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:24.907107 | ubuntu-noble-large | Environment: 2026-06-30 17:43:24.907123 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:24.907138 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:24.907153 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:24.907169 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-06-30 17:43:24.907184 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:24.907199 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:24.907214 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:24.907229 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:24.907255 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:24.907271 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:24.907286 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:24.907301 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:24.907316 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:24.907332 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:24.907356 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:24.907372 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:24.907387 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:24.907402 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:24.907417 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:24.907433 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:24.907448 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:24.907464 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:24.907479 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:24.907494 | ubuntu-noble-large | Type Status 2026-06-30 17:43:24.907509 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:24.907525 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:24.907539 | ubuntu-noble-large | Ready True 2026-06-30 17:43:24.907554 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:24.907570 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:24.907585 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:24.907601 | ubuntu-noble-large | storage: 2026-06-30 17:43:24.907616 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:24.907631 | ubuntu-noble-large | ClaimName: storage-openstack-db-1 2026-06-30 17:43:24.907646 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:24.907662 | ubuntu-noble-large | galera: 2026-06-30 17:43:24.907678 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:24.907692 | ubuntu-noble-large | ClaimName: galera-openstack-db-1 2026-06-30 17:43:24.907708 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:24.907725 | ubuntu-noble-large | config: 2026-06-30 17:43:24.907740 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.907769 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-06-30 17:43:24.907785 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.907802 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-06-30 17:43:24.907817 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.907833 | ubuntu-noble-large | pki: 2026-06-30 17:43:24.907849 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.907864 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-06-30 17:43:24.907906 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.907927 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-06-30 17:43:24.907943 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.907959 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-06-30 17:43:24.907974 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.907991 | ubuntu-noble-large | serviceaccount: 2026-06-30 17:43:24.908006 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:24.908022 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-06-30 17:43:24.908038 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:24.908053 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:24.908069 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:24.908107 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:24.908123 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:24.908139 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:24.908154 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:24.908169 | ubuntu-noble-large | Events: 2026-06-30 17:43:24.908185 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:24.908201 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:24.908227 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-1 to forge-control-plane 2026-06-30 17:43:24.908245 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.908261 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-06-30 17:43:24.908299 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-06-30 17:43:24.908316 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.908333 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{mariadb}: Container created 2026-06-30 17:43:24.908348 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{mariadb}: Container started 2026-06-30 17:43:24.908364 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:24.908379 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{agent}: Container created 2026-06-30 17:43:24.908391 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{agent}: Container started 2026-06-30 17:43:24.908404 | ubuntu-noble-large | Warning Unhealthy 13m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.43:5566/health": dial tcp 10.244.0.43:5566: connect: connection refused 2026-06-30 17:43:24.912130 | ubuntu-noble-large | --- logs pod/openstack-db-1 (current) --- 2026-06-30 17:43:25.045579 | ubuntu-noble-large | {"level":"info","ts":1782840535.590602,"msg":"Starting init"} 2026-06-30 17:43:25.045662 | ubuntu-noble-large | {"level":"info","ts":1782840535.6230853,"msg":"Configuring Galera"} 2026-06-30 17:43:25.045674 | ubuntu-noble-large | {"level":"info","ts":1782840535.6234262,"msg":"Waiting for previous Pod to be ready","pod":"openstack-db-0"} 2026-06-30 17:43:25.045687 | ubuntu-noble-large | {"level":"info","ts":1782840565.6307125,"msg":"Init done"} 2026-06-30 17:43:25.055362 | ubuntu-noble-large | 0: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:25.055452 | ubuntu-noble-large | ================================================= 2026-06-30 17:43:25.055469 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Non-primary view 2026-06-30 17:43:25.055501 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Server status change disconnected -> connected 2026-06-30 17:43:25.055514 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.055526 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Deinitializing config service v1 2026-06-30 17:43:25.055538 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 43193a2b-74a9-11f1-b3b9-a6c90e9bff1d from 1 (openstack-db-1) 2026-06-30 17:43:25.055549 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Quorum results: 2026-06-30 17:43:25.055561 | ubuntu-noble-large | version = 6, 2026-06-30 17:43:25.055572 | ubuntu-noble-large | component = PRIMARY, 2026-06-30 17:43:25.055583 | ubuntu-noble-large | conf_id = 1, 2026-06-30 17:43:25.055594 | ubuntu-noble-large | members = 1/2 (joined/total), 2026-06-30 17:43:25.055604 | ubuntu-noble-large | act_id = 1, 2026-06-30 17:43:25.055615 | ubuntu-noble-large | last_appl. = 0, 2026-06-30 17:43:25.055626 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-06-30 17:43:25.055636 | ubuntu-noble-large | vote policy= 0, 2026-06-30 17:43:25.055647 | ubuntu-noble-large | group UUID = 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:25.055657 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Flow-control interval: [23, 23] 2026-06-30 17:43:25.055668 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2026-06-30 17:43:25.055679 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### processing CC 2, local, ordered 2026-06-30 17:43:25.055690 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Process first view: 2ca3d0df-74a9-11f1-a02a-527197580005 my uuid: 420b122f-74a9-11f1-bde3-8210b3068b52 2026-06-30 17:43:25.055727 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT2.2595S), skipping check 2026-06-30 17:43:25.055740 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Server openstack-db-1 connected to cluster at position 2ca3d0df-74a9-11f1-a02a-527197580005:2 with ID 420b122f-74a9-11f1-bde3-8210b3068b52 2026-06-30 17:43:25.055752 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Server status change connected -> connected 2026-06-30 17:43:25.055763 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### My UUID: 420b122f-74a9-11f1-bde3-8210b3068b52 2026-06-30 17:43:25.055774 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes 2026-06-30 17:43:25.055784 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.055795 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 2026-06-30 17:43:25.055807 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: State transfer required: 2026-06-30 17:43:25.055818 | ubuntu-noble-large | Group state: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.055828 | ubuntu-noble-large | Local state: 00000000-0000-0000-0000-000000000000:-1 2026-06-30 17:43:25.055839 | ubuntu-noble-large | 2026-06-30 17:29:35 2 [Note] WSREP: Server status change connected -> joiner 2026-06-30 17:43:25.055849 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Joiner monitor thread started to monitor 2026-06-30 17:43:25.055860 | ubuntu-noble-large | 2026-06-30 17:29:35 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.244.0.43:4444' --datadir '/var/lib/mysql/' --parent 1 --progress 0' 2026-06-30 17:43:25.055871 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on joiner (20260630 17:29:35.475) 2026-06-30 17:43:25.055921 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260630 17:29:35.611) 2026-06-30 17:43:25.055944 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260630 17:29:36.013) 2026-06-30 17:43:25.055955 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260630 17:29:36.019) 2026-06-30 17:43:25.055965 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260630 17:29:36.047) 2026-06-30 17:43:25.055975 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260630 17:29:36.054) 2026-06-30 17:43:25.055984 | ubuntu-noble-large | WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20260630 17:29:36.165) 2026-06-30 17:43:25.055994 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260630 17:29:36.184) 2026-06-30 17:43:25.056004 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2026-06-30 17:43:25.056014 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: IST receiver addr using tcp://10.244.0.43:4568 2026-06-30 17:43:25.056024 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://10.244.0.43:4568 2026-06-30 17:43:25.056034 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Member 1.0 (openstack-db-1) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-06-30 17:43:25.056044 | ubuntu-noble-large | 2026-06-30 17:29:36 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2026-06-30 17:43:25.056054 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2026-06-30 17:43:25.056064 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2026-06-30 17:43:25.056325 | ubuntu-noble-large | 2026-06-30 17:29:36 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.056346 | ubuntu-noble-large | WSREP_SST: [INFO] Proceeding with SST (20260630 17:29:37.816) 2026-06-30 17:43:25.056367 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260630 17:29:37.818) 2026-06-30 17:43:25.056391 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20260630 17:29:37.878) 2026-06-30 17:43:25.056402 | ubuntu-noble-large | WSREP_SST: [INFO] Waiting for SST streaming to complete! (20260630 17:29:37.895) 2026-06-30 17:43:25.056413 | ubuntu-noble-large | 2026-06-30 17:29:37 0 [Note] WSREP: (420b122f-bde3, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-06-30 17:43:25.056423 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 1.0 (openstack-db-1) complete. 2026-06-30 17:43:25.056434 | ubuntu-noble-large | 2026-06-30 17:29:53 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-06-30 17:43:25.056444 | ubuntu-noble-large | WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql/.sst (20260630 17:29:53.673) 2026-06-30 17:43:25.056455 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --prepare --no-version-check --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql/.sst' > '/var/lib/mysql/mariabackup.prepare.log' 2>&1 (20260630 17:29:53.679) 2026-06-30 17:43:25.056466 | ubuntu-noble-large | WSREP_SST: [INFO] Moving the backup to /var/lib/mysql (20260630 17:29:53.898) 2026-06-30 17:43:25.056479 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --move-back --no-version-check --galera-info --force-non-empty-directories --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql' > '/var/lib/mysql/mariabackup.move.log' 2>&1 (20260630 17:29:53.906) 2026-06-30 17:43:25.056492 | ubuntu-noble-large | WSREP_SST: [INFO] Move successful, removing /var/lib/mysql/.sst (20260630 17:29:53.968) 2026-06-30 17:43:25.056502 | ubuntu-noble-large | WSREP_SST: [INFO] Galera co-ords from donor: 2ca3d0df-74a9-11f1-a02a-527197580005:2 0 (20260630 17:29:53.985) 2026-06-30 17:43:25.056513 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on joiner: 0 seconds (20260630 17:29:53.994) 2026-06-30 17:43:25.056523 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on joiner (20260630 17:29:54.002) 2026-06-30 17:43:25.056533 | ubuntu-noble-large | WSREP_SST: [INFO] Removing the sst_in_progress file (20260630 17:29:54.012) 2026-06-30 17:43:25.056544 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260630 17:29:54.026) 2026-06-30 17:43:25.056554 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: SST received 2026-06-30 17:43:25.056565 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: Server status change joiner -> initializing 2026-06-30 17:43:25.056575 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Compressed tables use zlib 1.3 2026-06-30 17:43:25.056585 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Number of transaction pools: 1 2026-06-30 17:43:25.056596 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Using AVX512 instructions 2026-06-30 17:43:25.056606 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2026-06-30 17:43:25.056617 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Using liburing 2026-06-30 17:43:25.056627 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB 2026-06-30 17:43:25.056637 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Completed initialization of buffer pool 2026-06-30 17:43:25.056648 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-06-30 17:43:25.056658 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: End of log at LSN=57994 2026-06-30 17:43:25.056668 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Resizing redo log from 12.016KiB to 96.000MiB; LSN=57994 2026-06-30 17:43:25.056679 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-06-30 17:43:25.056689 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Opened 3 undo tablespaces 2026-06-30 17:43:25.056699 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. 2026-06-30 17:43:25.056716 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2026-06-30 17:43:25.056727 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2026-06-30 17:43:25.056738 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: log sequence number 57994; transaction id 32 2026-06-30 17:43:25.056748 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] Plugin 'FEEDBACK' is disabled. 2026-06-30 17:43:25.056766 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2026-06-30 17:43:25.056777 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 2026-06-30 17:43:25.056788 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] Server socket created on IP: '0.0.0.0'. 2026-06-30 17:43:25.056798 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] Server socket created on IP: '::'. 2026-06-30 17:43:25.056809 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] mariadbd: Event Scheduler: Loaded 0 events 2026-06-30 17:43:25.056819 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2026-06-30 17:43:25.056830 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Server initialized 2026-06-30 17:43:25.056840 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Server status change initializing -> initialized 2026-06-30 17:43:25.057796 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: Recovered position from storage: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.057827 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: Server status change initialized -> joined 2026-06-30 17:43:25.057852 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: Recovered view from SST: 2026-06-30 17:43:25.057868 | ubuntu-noble-large | id: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.057928 | ubuntu-noble-large | status: primary 2026-06-30 17:43:25.057937 | ubuntu-noble-large | protocol_version: 4 2026-06-30 17:43:25.057946 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-06-30 17:43:25.057956 | ubuntu-noble-large | final: no 2026-06-30 17:43:25.057966 | ubuntu-noble-large | own_index: 1 2026-06-30 17:43:25.057975 | ubuntu-noble-large | members(2): 2026-06-30 17:43:25.057984 | ubuntu-noble-large | 0: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846, openstack-db-0 2026-06-30 17:43:25.057993 | ubuntu-noble-large | 1: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:25.058004 | ubuntu-noble-large | 2026-06-30 17:43:25.058014 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.058024 | ubuntu-noble-large | 2026-06-30 17:29:54 6 [Note] WSREP: Recovered cluster id 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:25.058033 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: SST received: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.058042 | ubuntu-noble-large | 2026-06-30 17:29:54 3 [Note] WSREP: SST succeeded for position 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.058051 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Installed new state from SST: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.058060 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Joiner monitor thread ended with total time 19 sec 2026-06-30 17:43:25.058068 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] mariadbd: ready for connections. 2026-06-30 17:43:25.058096 | ubuntu-noble-large | Version: '11.4.5-MariaDB-ubu2404' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2026-06-30 17:43:25.058112 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Cert. index preload up to 2 2026-06-30 17:43:25.058121 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: ####### IST applying starts with 3 2026-06-30 17:43:25.058130 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: ####### IST current seqno initialized to 2 2026-06-30 17:43:25.058139 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2026-06-30 17:43:25.058148 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: IST preload starting at 2 2026-06-30 17:43:25.058156 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:25.058165 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.058174 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: ####### Assign initial position for certification: 2ca3d0df-74a9-11f1-a02a-527197580005:1, protocol version: 6 2026-06-30 17:43:25.058183 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:25.058192 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2026-06-30 17:43:25.058201 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.058210 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 2 2026-06-30 17:43:25.058230 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2026-06-30 17:43:25.058239 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete. 2026-06-30 17:43:25.058247 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: IST received: 2ca3d0df-74a9-11f1-a02a-527197580005:2 2026-06-30 17:43:25.058256 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 2 2026-06-30 17:43:25.058265 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Min available from gcache for CC from sst: 2 2026-06-30 17:43:25.058274 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: 1.0 (openstack-db-1): State transfer from 0.0 (openstack-db-0) complete. 2026-06-30 17:43:25.058283 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2026-06-30 17:43:25.058292 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-06-30 17:43:25.058301 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Member 1.0 (openstack-db-1) synced with group. 2026-06-30 17:43:25.058309 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-06-30 17:43:25.058318 | ubuntu-noble-large | 2026-06-30 17:29:54 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2026-06-30 17:43:25.058327 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Server openstack-db-1 synced with group 2026-06-30 17:43:25.058336 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Server status change joined -> synced 2026-06-30 17:43:25.058345 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: Synchronized with group, ready for connections 2026-06-30 17:43:25.058353 | ubuntu-noble-large | 2026-06-30 17:29:54 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.058362 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: (420b122f-bde3, 'tcp://0.0.0.0:4567') connection established to 54b040ef-9af8 tcp://10.244.0.44:4567 2026-06-30 17:43:25.058371 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 2c9cf50e-b69e at tcp://10.244.0.42:4567 stable 2026-06-30 17:43:25.058380 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 54b040ef-9af8 at tcp://10.244.0.44:4567 stable 2026-06-30 17:43:25.058389 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: Node 2c9cf50e-b69e state prim 2026-06-30 17:43:25.058398 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: view(view_id(PRIM,2c9cf50e-b69e,3) memb { 2026-06-30 17:43:25.058407 | ubuntu-noble-large | 2c9cf50e-b69e,0 2026-06-30 17:43:25.058416 | ubuntu-noble-large | 420b122f-bde3,0 2026-06-30 17:43:25.058425 | ubuntu-noble-large | 54b040ef-9af8,0 2026-06-30 17:43:25.058434 | ubuntu-noble-large | } joined { 2026-06-30 17:43:25.058443 | ubuntu-noble-large | } left { 2026-06-30 17:43:25.058452 | ubuntu-noble-large | } partitioned { 2026-06-30 17:43:25.058461 | ubuntu-noble-large | }) 2026-06-30 17:43:25.059416 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: save pc into disk 2026-06-30 17:43:25.059443 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2026-06-30 17:43:25.059464 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2026-06-30 17:43:25.059475 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa 2026-06-30 17:43:25.059486 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 0 (openstack-db-0) 2026-06-30 17:43:25.059496 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 1 (openstack-db-1) 2026-06-30 17:43:25.059505 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 2 (openstack-db-2) 2026-06-30 17:43:25.059514 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Quorum results: 2026-06-30 17:43:25.059523 | ubuntu-noble-large | version = 6, 2026-06-30 17:43:25.059531 | ubuntu-noble-large | component = PRIMARY, 2026-06-30 17:43:25.059540 | ubuntu-noble-large | conf_id = 2, 2026-06-30 17:43:25.059549 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-06-30 17:43:25.059558 | ubuntu-noble-large | act_id = 2, 2026-06-30 17:43:25.059566 | ubuntu-noble-large | last_appl. = 0, 2026-06-30 17:43:25.059575 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-06-30 17:43:25.059584 | ubuntu-noble-large | vote policy= 0, 2026-06-30 17:43:25.059621 | ubuntu-noble-large | group UUID = 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:25.059631 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-06-30 17:43:25.059640 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-06-30 17:43:25.059648 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### My UUID: 420b122f-74a9-11f1-bde3-8210b3068b52 2026-06-30 17:43:25.059657 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Skipping cert index reset 2026-06-30 17:43:25.059666 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:25.059674 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-06-30 17:43:25.059683 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.059692 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ================================================ 2026-06-30 17:43:25.059701 | ubuntu-noble-large | View: 2026-06-30 17:43:25.059710 | ubuntu-noble-large | id: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.059719 | ubuntu-noble-large | status: primary 2026-06-30 17:43:25.059728 | ubuntu-noble-large | protocol_version: 4 2026-06-30 17:43:25.059745 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-06-30 17:43:25.059754 | ubuntu-noble-large | final: no 2026-06-30 17:43:25.059763 | ubuntu-noble-large | own_index: 1 2026-06-30 17:43:25.059772 | ubuntu-noble-large | members(3): 2026-06-30 17:43:25.059781 | ubuntu-noble-large | 0: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846, openstack-db-0 2026-06-30 17:43:25.059789 | ubuntu-noble-large | 1: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:25.059798 | ubuntu-noble-large | 2: 54b040ef-74a9-11f1-9af8-d69ea190cc0a, openstack-db-2 2026-06-30 17:43:25.059807 | ubuntu-noble-large | ================================================= 2026-06-30 17:43:25.059816 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.059825 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Lowest cert index boundary for CC from group: 3 2026-06-30 17:43:25.059834 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Min available from gcache for CC from group: 2 2026-06-30 17:43:25.059842 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: (420b122f-bde3, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-06-30 17:43:25.059851 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-06-30 17:43:25.059860 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-06-30 17:43:25.059869 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-06-30 17:43:25.059924 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-06-30 17:43:25.059938 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-06-30 17:43:25.068926 | ubuntu-noble-large | {"level":"info","ts":1782840566.8444855,"msg":"Agent starting"} 2026-06-30 17:43:25.068979 | ubuntu-noble-large | {"level":"info","ts":1782840566.8448968,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-06-30 17:43:25.068987 | ubuntu-noble-large | {"level":"info","ts":1782840566.845589,"logger":"api","msg":"Configuring TLS"} 2026-06-30 17:43:25.068994 | ubuntu-noble-large | {"level":"info","ts":1782840566.85236,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-06-30 17:43:25.069001 | ubuntu-noble-large | {"level":"info","ts":1782840566.8524687,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-06-30 17:43:25.069008 | ubuntu-noble-large | 2026/06/30 17:30:37 "DELETE https://openstack-db-1.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.18:43892 - 404 41B in 4.932867ms 2026-06-30 17:43:25.074979 | ubuntu-noble-large | --- logs pod/openstack-db-1 (previous) --- 2026-06-30 17:43:25.193218 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "init" in pod "openstack-db-1" not found 2026-06-30 17:43:25.197980 | ubuntu-noble-large | --- describe pod/openstack-db-2 --- 2026-06-30 17:43:25.306015 | ubuntu-noble-large | Name: openstack-db-2 2026-06-30 17:43:25.306131 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:25.306139 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:25.306143 | ubuntu-noble-large | Service Account: openstack-db 2026-06-30 17:43:25.306148 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:25.306153 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:56 +0000 2026-06-30 17:43:25.306157 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-06-30 17:43:25.306162 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-06-30 17:43:25.306165 | ubuntu-noble-large | apps.kubernetes.io/pod-index=2 2026-06-30 17:43:25.306170 | ubuntu-noble-large | controller-revision-hash=openstack-db-7c9978c654 2026-06-30 17:43:25.306178 | ubuntu-noble-large | k8s.mariadb.com/role=replica 2026-06-30 17:43:25.306196 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-2 2026-06-30 17:43:25.306202 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 7efd69c42bb4815b92f679ca11d9f1b70944aaf60b861f8630587c1ebe39b816 2026-06-30 17:43:25.306206 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 5c61cd61d5bf25189d1bdbedccd5f88af5cc3c8b53f7c654fca3b22f632ee57b 2026-06-30 17:43:25.306210 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-06-30 17:43:25.306214 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-06-30 17:43:25.306218 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-06-30 17:43:25.306222 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-06-30 17:43:25.306226 | ubuntu-noble-large | k8s.mariadb.com/server-cert: cb9abbd4591b7a8ddf8421596b7ba7779e383a3525559bb83c8075214be78d21 2026-06-30 17:43:25.306230 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:25.306234 | ubuntu-noble-large | IP: 10.244.0.44 2026-06-30 17:43:25.306238 | ubuntu-noble-large | IPs: 2026-06-30 17:43:25.306242 | ubuntu-noble-large | IP: 10.244.0.44 2026-06-30 17:43:25.306246 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-06-30 17:43:25.306250 | ubuntu-noble-large | Init Containers: 2026-06-30 17:43:25.306254 | ubuntu-noble-large | init: 2026-06-30 17:43:25.306258 | ubuntu-noble-large | Container ID: containerd://9cbae89b64afcbabd9e13adb79cebba8c88316aa5fefdd3199eaa50c7b0cd1a7 2026-06-30 17:43:25.306262 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:25.306266 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:25.306271 | ubuntu-noble-large | Port: 2026-06-30 17:43:25.306275 | ubuntu-noble-large | Host Port: 2026-06-30 17:43:25.306278 | ubuntu-noble-large | Args: 2026-06-30 17:43:25.306282 | ubuntu-noble-large | init 2026-06-30 17:43:25.306286 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:25.306290 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:25.306294 | ubuntu-noble-large | State: Terminated 2026-06-30 17:43:25.306298 | ubuntu-noble-large | Reason: Completed 2026-06-30 17:43:25.306302 | ubuntu-noble-large | Exit Code: 0 2026-06-30 17:43:25.306306 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:57 +0000 2026-06-30 17:43:25.306310 | ubuntu-noble-large | Finished: Tue, 30 Jun 2026 17:29:55 +0000 2026-06-30 17:43:25.306313 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:25.306317 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:25.306322 | ubuntu-noble-large | Environment: 2026-06-30 17:43:25.306329 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:25.306336 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:25.306342 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:25.306348 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-06-30 17:43:25.306354 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:25.306360 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:25.306367 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:25.306373 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:25.306380 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:25.306386 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:25.306393 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:25.306402 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:25.306406 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:25.306410 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:25.306414 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:25.306418 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:25.306422 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:25.306425 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:25.306429 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:25.306433 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:25.306437 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:25.306440 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:25.306444 | ubuntu-noble-large | Containers: 2026-06-30 17:43:25.306448 | ubuntu-noble-large | mariadb: 2026-06-30 17:43:25.306452 | ubuntu-noble-large | Container ID: containerd://cc600a0f6e7cdc6fc076bb8d0a55eb6c9dbbd2cce05f136bdfc0dd9e654ae9d4 2026-06-30 17:43:25.306455 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-06-30 17:43:25.306459 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-06-30 17:43:25.306464 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-06-30 17:43:25.306468 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-06-30 17:43:25.306472 | ubuntu-noble-large | State: Running 2026-06-30 17:43:25.306475 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:29:56 +0000 2026-06-30 17:43:25.306479 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:25.306483 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:25.306487 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:25.306491 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:25.306505 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-06-30 17:43:25.306509 | ubuntu-noble-large | Environment: 2026-06-30 17:43:25.306513 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:25.306517 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:25.306521 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:25.306525 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-06-30 17:43:25.306528 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:25.306532 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:25.306536 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:25.306540 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:25.306547 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:25.306551 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:25.306554 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:25.306558 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:25.306562 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:25.306566 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:25.306569 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:25.306573 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:25.306577 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:25.306581 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:25.306584 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:25.306588 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:25.306592 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:25.306596 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:25.306600 | ubuntu-noble-large | agent: 2026-06-30 17:43:25.306607 | ubuntu-noble-large | Container ID: containerd://cb8868eddbed79e30a4ec99b2215be124f6361e8fcf3521432b4a716869e231b 2026-06-30 17:43:25.306611 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-06-30 17:43:25.306615 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-06-30 17:43:25.306619 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-06-30 17:43:25.306623 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-06-30 17:43:25.306626 | ubuntu-noble-large | Args: 2026-06-30 17:43:25.306630 | ubuntu-noble-large | agent 2026-06-30 17:43:25.306634 | ubuntu-noble-large | --addr=:5555 2026-06-30 17:43:25.306638 | ubuntu-noble-large | --probe-addr=:5566 2026-06-30 17:43:25.306642 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-06-30 17:43:25.306645 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-06-30 17:43:25.306649 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-06-30 17:43:25.306653 | ubuntu-noble-large | --kubernetes-auth 2026-06-30 17:43:25.306656 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-06-30 17:43:25.306660 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-06-30 17:43:25.306664 | ubuntu-noble-large | State: Running 2026-06-30 17:43:25.306668 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:29:57 +0000 2026-06-30 17:43:25.306672 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:25.306675 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:25.306679 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:25.306683 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:25.306687 | ubuntu-noble-large | Environment: 2026-06-30 17:43:25.306691 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-06-30 17:43:25.306694 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-06-30 17:43:25.306698 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-06-30 17:43:25.306702 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-06-30 17:43:25.306706 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-06-30 17:43:25.306709 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-06-30 17:43:25.306713 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-06-30 17:43:25.306717 | ubuntu-noble-large | TLS_ENABLED: true 2026-06-30 17:43:25.306721 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-06-30 17:43:25.306724 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-06-30 17:43:25.306728 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-06-30 17:43:25.306732 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-06-30 17:43:25.306736 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-06-30 17:43:25.306739 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-06-30 17:43:25.306743 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-06-30 17:43:25.306747 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-06-30 17:43:25.306751 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:25.306755 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-06-30 17:43:25.306758 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-06-30 17:43:25.306762 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-06-30 17:43:25.306766 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-06-30 17:43:25.306770 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-06-30 17:43:25.306773 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:25.306777 | ubuntu-noble-large | Type Status 2026-06-30 17:43:25.306781 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:25.306785 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:25.306788 | ubuntu-noble-large | Ready True 2026-06-30 17:43:25.306792 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:25.306796 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:25.306799 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:25.306803 | ubuntu-noble-large | storage: 2026-06-30 17:43:25.306807 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:25.306815 | ubuntu-noble-large | ClaimName: storage-openstack-db-2 2026-06-30 17:43:25.306819 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:25.306822 | ubuntu-noble-large | galera: 2026-06-30 17:43:25.306826 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-06-30 17:43:25.306830 | ubuntu-noble-large | ClaimName: galera-openstack-db-2 2026-06-30 17:43:25.306834 | ubuntu-noble-large | ReadOnly: false 2026-06-30 17:43:25.306838 | ubuntu-noble-large | config: 2026-06-30 17:43:25.306841 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:25.306849 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-06-30 17:43:25.306853 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306856 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-06-30 17:43:25.306860 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306864 | ubuntu-noble-large | pki: 2026-06-30 17:43:25.306868 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:25.306872 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-06-30 17:43:25.306876 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306898 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-06-30 17:43:25.306905 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306909 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-06-30 17:43:25.306913 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306916 | ubuntu-noble-large | serviceaccount: 2026-06-30 17:43:25.306924 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:25.306928 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-06-30 17:43:25.306932 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:25.306935 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.306939 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:25.306943 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:25.306947 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:25.306950 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:25.306954 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:25.306958 | ubuntu-noble-large | Events: 2026-06-30 17:43:25.306962 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:25.306965 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:25.306969 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-2 to forge-control-plane 2026-06-30 17:43:25.306975 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:25.306981 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-06-30 17:43:25.306984 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-06-30 17:43:25.306989 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-06-30 17:43:25.306994 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{mariadb}: Container created 2026-06-30 17:43:25.306998 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{mariadb}: Container started 2026-06-30 17:43:25.307002 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-06-30 17:43:25.307006 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{agent}: Container created 2026-06-30 17:43:25.307009 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{agent}: Container started 2026-06-30 17:43:25.307017 | ubuntu-noble-large | Warning Unhealthy 13m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.44:5566/health": dial tcp 10.244.0.44:5566: connect: connection refused 2026-06-30 17:43:25.307022 | ubuntu-noble-large | Warning Unhealthy 12m (x2 over 13m) kubelet spec.containers{mariadb}: Startup probe failed: HTTP probe failed with statuscode: 500 2026-06-30 17:43:25.310293 | ubuntu-noble-large | --- logs pod/openstack-db-2 (current) --- 2026-06-30 17:43:25.417241 | ubuntu-noble-large | {"level":"info","ts":1782840537.625376,"msg":"Starting init"} 2026-06-30 17:43:25.417343 | ubuntu-noble-large | {"level":"info","ts":1782840537.6697228,"msg":"Configuring Galera"} 2026-06-30 17:43:25.417362 | ubuntu-noble-large | {"level":"info","ts":1782840537.6704106,"msg":"Waiting for previous Pod to be ready","pod":"openstack-db-1"} 2026-06-30 17:43:25.417374 | ubuntu-noble-large | {"level":"info","ts":1782840595.678834,"msg":"Init done"} 2026-06-30 17:43:25.427183 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2026-06-30 17:43:25.427257 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2026-06-30 17:43:25.427284 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: restore pc from disk failed 2026-06-30 17:43:25.427292 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: GMCast version 0 2026-06-30 17:43:25.427300 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2026-06-30 17:43:25.427318 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2026-06-30 17:43:25.427324 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: EVS version 1 2026-06-30 17:43:25.427333 | ubuntu-noble-large | 2026-06-30 17:30:04 0 [Note] WSREP: gcomm: connecting to group 'mariadb-operator', peer 'openstack-db-0.openstack-db-internal.openstack.svc.cluster.local:,openstack-db-1.openstack-db-internal.openstack.svc.cluster.local:,openstack-db-2.openstack-db-internal.openstack.svc.cluster.local:' 2026-06-30 17:43:25.427341 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: EVS version upgrade 0 -> 1 2026-06-30 17:43:25.427348 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2026-06-30 17:43:25.427354 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: No nodes coming from primary view, primary view is not possible 2026-06-30 17:43:25.427360 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: view(view_id(NON_PRIM,54b040ef-9af8,1) memb { 2026-06-30 17:43:25.427367 | ubuntu-noble-large | 54b040ef-9af8,0 2026-06-30 17:43:25.427374 | ubuntu-noble-large | } joined { 2026-06-30 17:43:25.427381 | ubuntu-noble-large | } left { 2026-06-30 17:43:25.427388 | ubuntu-noble-large | } partitioned { 2026-06-30 17:43:25.427395 | ubuntu-noble-large | }) 2026-06-30 17:43:25.427401 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: Failed to establish connection: wrong version number (SSL routines) 2026-06-30 17:43:25.427423 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') connection established to 2c9cf50e-b69e tcp://10.244.0.42:4567 2026-06-30 17:43:25.427431 | ubuntu-noble-large | 2026-06-30 17:30:05 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') connection established to 420b122f-bde3 tcp://10.244.0.43:4567 2026-06-30 17:43:25.427438 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 2c9cf50e-b69e at tcp://10.244.0.42:4567 stable 2026-06-30 17:43:25.427444 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Note] WSREP: declaring 420b122f-bde3 at tcp://10.244.0.43:4567 stable 2026-06-30 17:43:25.427450 | ubuntu-noble-large | 2026-06-30 17:30:06 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT2.26175S), skipping check 2026-06-30 17:43:25.427456 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://10.244.0.44:4567 2026-06-30 17:43:25.427465 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: Node 2c9cf50e-b69e state prim 2026-06-30 17:43:25.427471 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: view(view_id(PRIM,2c9cf50e-b69e,3) memb { 2026-06-30 17:43:25.427477 | ubuntu-noble-large | 2c9cf50e-b69e,0 2026-06-30 17:43:25.427483 | ubuntu-noble-large | 420b122f-bde3,0 2026-06-30 17:43:25.427489 | ubuntu-noble-large | 54b040ef-9af8,0 2026-06-30 17:43:25.427496 | ubuntu-noble-large | } joined { 2026-06-30 17:43:25.427502 | ubuntu-noble-large | } left { 2026-06-30 17:43:25.427527 | ubuntu-noble-large | } partitioned { 2026-06-30 17:43:25.427535 | ubuntu-noble-large | }) 2026-06-30 17:43:25.427541 | ubuntu-noble-large | 2026-06-30 17:30:07 0 [Note] WSREP: save pc into disk 2026-06-30 17:43:25.427547 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: gcomm: connected 2026-06-30 17:43:25.427553 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2026-06-30 17:43:25.427560 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2026-06-30 17:43:25.427566 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Opened channel 'mariadb-operator' 2026-06-30 17:43:25.427572 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Initializing config service v1 2026-06-30 17:43:25.427578 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2026-06-30 17:43:25.427584 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Flow-control interval: [16, 16] 2026-06-30 17:43:25.427590 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Received NON-PRIMARY. 2026-06-30 17:43:25.427596 | ubuntu-noble-large | 2026-06-30 17:30:08 1 [Note] WSREP: Starting rollbacker thread 1 2026-06-30 17:43:25.427602 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2026-06-30 17:43:25.427608 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2026-06-30 17:43:25.428200 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa 2026-06-30 17:43:25.428224 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 0 (openstack-db-0) 2026-06-30 17:43:25.428232 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Deinitializing config service v1 2026-06-30 17:43:25.428238 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Starting applier thread 2 2026-06-30 17:43:25.428452 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ================================================ 2026-06-30 17:43:25.428465 | ubuntu-noble-large | View: 2026-06-30 17:43:25.428475 | ubuntu-noble-large | id: 00000000-0000-0000-0000-000000000000:-1 2026-06-30 17:43:25.428487 | ubuntu-noble-large | status: non-primary 2026-06-30 17:43:25.428498 | ubuntu-noble-large | protocol_version: -1 2026-06-30 17:43:25.428509 | ubuntu-noble-large | capabilities: 2026-06-30 17:43:25.428519 | ubuntu-noble-large | final: no 2026-06-30 17:43:25.428525 | ubuntu-noble-large | own_index: 0 2026-06-30 17:43:25.428531 | ubuntu-noble-large | members(1): 2026-06-30 17:43:25.428538 | ubuntu-noble-large | 0: 54b040ef-74a9-11f1-9af8-d69ea190cc0a, openstack-db-2 2026-06-30 17:43:25.428544 | ubuntu-noble-large | ================================================= 2026-06-30 17:43:25.428550 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Non-primary view 2026-06-30 17:43:25.428557 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Server status change disconnected -> connected 2026-06-30 17:43:25.428571 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.428578 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 1 (openstack-db-1) 2026-06-30 17:43:25.428584 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 56a75d63-74a9-11f1-84a8-4bbb46d8e3fa from 2 (openstack-db-2) 2026-06-30 17:43:25.428590 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Quorum results: 2026-06-30 17:43:25.428596 | ubuntu-noble-large | version = 6, 2026-06-30 17:43:25.428602 | ubuntu-noble-large | component = PRIMARY, 2026-06-30 17:43:25.428608 | ubuntu-noble-large | conf_id = 2, 2026-06-30 17:43:25.428614 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-06-30 17:43:25.428620 | ubuntu-noble-large | act_id = 2, 2026-06-30 17:43:25.428626 | ubuntu-noble-large | last_appl. = 0, 2026-06-30 17:43:25.428632 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-06-30 17:43:25.428638 | ubuntu-noble-large | vote policy= 0, 2026-06-30 17:43:25.428644 | ubuntu-noble-large | group UUID = 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:25.428650 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-06-30 17:43:25.428656 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 3) 2026-06-30 17:43:25.428662 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-06-30 17:43:25.428668 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Process first view: 2ca3d0df-74a9-11f1-a02a-527197580005 my uuid: 54b040ef-74a9-11f1-9af8-d69ea190cc0a 2026-06-30 17:43:25.428702 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Server openstack-db-2 connected to cluster at position 2ca3d0df-74a9-11f1-a02a-527197580005:3 with ID 54b040ef-74a9-11f1-9af8-d69ea190cc0a 2026-06-30 17:43:25.428710 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Server status change connected -> connected 2026-06-30 17:43:25.428716 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### My UUID: 54b040ef-74a9-11f1-9af8-d69ea190cc0a 2026-06-30 17:43:25.428729 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes 2026-06-30 17:43:25.428736 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.428742 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 2026-06-30 17:43:25.428749 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: State transfer required: 2026-06-30 17:43:25.428755 | ubuntu-noble-large | Group state: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.428761 | ubuntu-noble-large | Local state: 00000000-0000-0000-0000-000000000000:-1 2026-06-30 17:43:25.428767 | ubuntu-noble-large | 2026-06-30 17:30:08 2 [Note] WSREP: Server status change connected -> joiner 2026-06-30 17:43:25.428774 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.244.0.44:4444' --datadir '/var/lib/mysql/' --parent 1 --progress 0' 2026-06-30 17:43:25.428780 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: Joiner monitor thread started to monitor 2026-06-30 17:43:25.428786 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on joiner (20260630 17:30:08.283) 2026-06-30 17:43:25.428792 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260630 17:30:08.420) 2026-06-30 17:43:25.428798 | ubuntu-noble-large | 2026-06-30 17:30:08 0 [Note] WSREP: (54b040ef-9af8, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-06-30 17:43:25.428805 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260630 17:30:08.793) 2026-06-30 17:43:25.428812 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260630 17:30:08.798) 2026-06-30 17:43:25.428818 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260630 17:30:08.826) 2026-06-30 17:43:25.428824 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260630 17:30:08.832) 2026-06-30 17:43:25.428830 | ubuntu-noble-large | WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20260630 17:30:08.936) 2026-06-30 17:43:25.428836 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260630 17:30:08.955) 2026-06-30 17:43:25.428842 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 3, STRv: 3 2026-06-30 17:43:25.428848 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: IST receiver addr using tcp://10.244.0.44:4568 2026-06-30 17:43:25.428854 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Prepared IST receiver for 0-3, listening at: tcp://10.244.0.44:4568 2026-06-30 17:43:25.428860 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-06-30 17:43:25.428866 | ubuntu-noble-large | 2026-06-30 17:30:09 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 3) 2026-06-30 17:43:25.428872 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2026-06-30 17:43:25.428907 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2026-06-30 17:43:25.428913 | ubuntu-noble-large | 2026-06-30 17:30:09 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.428919 | ubuntu-noble-large | WSREP_SST: [INFO] Proceeding with SST (20260630 17:30:10.605) 2026-06-30 17:43:25.428932 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260630 17:30:10.605) 2026-06-30 17:43:25.428970 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20260630 17:30:10.664) 2026-06-30 17:43:25.428976 | ubuntu-noble-large | WSREP_SST: [INFO] Waiting for SST streaming to complete! (20260630 17:30:10.688) 2026-06-30 17:43:25.428982 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-06-30 17:43:25.428989 | ubuntu-noble-large | 2026-06-30 17:30:26 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-06-30 17:43:25.428995 | ubuntu-noble-large | WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql/.sst (20260630 17:30:26.674) 2026-06-30 17:43:25.429001 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --prepare --no-version-check --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql/.sst' > '/var/lib/mysql/mariabackup.prepare.log' 2>&1 (20260630 17:30:26.681) 2026-06-30 17:43:25.429007 | ubuntu-noble-large | WSREP_SST: [INFO] Moving the backup to /var/lib/mysql (20260630 17:30:26.884) 2026-06-30 17:43:25.429015 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --move-back --no-version-check --galera-info --force-non-empty-directories --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql' > '/var/lib/mysql/mariabackup.move.log' 2>&1 (20260630 17:30:26.888) 2026-06-30 17:43:25.429023 | ubuntu-noble-large | WSREP_SST: [INFO] Move successful, removing /var/lib/mysql/.sst (20260630 17:30:26.926) 2026-06-30 17:43:25.429029 | ubuntu-noble-large | WSREP_SST: [INFO] Galera co-ords from donor: 2ca3d0df-74a9-11f1-a02a-527197580005:3 0 (20260630 17:30:26.946) 2026-06-30 17:43:25.429035 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on joiner: 0 seconds (20260630 17:30:26.951) 2026-06-30 17:43:25.429041 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on joiner (20260630 17:30:26.959) 2026-06-30 17:43:25.429047 | ubuntu-noble-large | WSREP_SST: [INFO] Removing the sst_in_progress file (20260630 17:30:26.969) 2026-06-30 17:43:25.429053 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260630 17:30:26.983) 2026-06-30 17:43:25.429060 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: SST received 2026-06-30 17:43:25.429066 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: Server status change joiner -> initializing 2026-06-30 17:43:25.429124 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Compressed tables use zlib 1.3 2026-06-30 17:43:25.429130 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Number of transaction pools: 1 2026-06-30 17:43:25.429136 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Using AVX512 instructions 2026-06-30 17:43:25.429143 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2026-06-30 17:43:25.429149 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Using liburing 2026-06-30 17:43:25.429155 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB 2026-06-30 17:43:25.429161 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Completed initialization of buffer pool 2026-06-30 17:43:25.429167 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-06-30 17:43:25.429173 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: End of log at LSN=60369 2026-06-30 17:43:25.429179 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Resizing redo log from 12.016KiB to 96.000MiB; LSN=60369 2026-06-30 17:43:25.429185 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-06-30 17:43:25.429191 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Opened 3 undo tablespaces 2026-06-30 17:43:25.429197 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. 2026-06-30 17:43:25.429204 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2026-06-30 17:43:25.429210 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2026-06-30 17:43:25.429216 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: log sequence number 60369; transaction id 34 2026-06-30 17:43:25.429222 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] Plugin 'FEEDBACK' is disabled. 2026-06-30 17:43:25.429228 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2026-06-30 17:43:25.429620 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 2026-06-30 17:43:25.429630 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] Server socket created on IP: '0.0.0.0'. 2026-06-30 17:43:25.429636 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] Server socket created on IP: '::'. 2026-06-30 17:43:25.429642 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] mariadbd: Event Scheduler: Loaded 0 events 2026-06-30 17:43:25.429648 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2026-06-30 17:43:25.429653 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Server initialized 2026-06-30 17:43:25.429659 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Server status change initializing -> initialized 2026-06-30 17:43:25.429664 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: Recovered position from storage: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.429670 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: Server status change initialized -> joined 2026-06-30 17:43:25.429675 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: Recovered view from SST: 2026-06-30 17:43:25.429681 | ubuntu-noble-large | id: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.429687 | ubuntu-noble-large | status: primary 2026-06-30 17:43:25.429700 | ubuntu-noble-large | protocol_version: 4 2026-06-30 17:43:25.430612 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-06-30 17:43:25.430634 | ubuntu-noble-large | final: no 2026-06-30 17:43:25.430641 | ubuntu-noble-large | own_index: 2 2026-06-30 17:43:25.430647 | ubuntu-noble-large | members(3): 2026-06-30 17:43:25.430654 | ubuntu-noble-large | 0: 2c9cf50e-74a9-11f1-b69e-f7d1fbdb7846, openstack-db-0 2026-06-30 17:43:25.430660 | ubuntu-noble-large | 1: 420b122f-74a9-11f1-bde3-8210b3068b52, openstack-db-1 2026-06-30 17:43:25.430667 | ubuntu-noble-large | 2: 54b040ef-74a9-11f1-9af8-d69ea190cc0a, openstack-db-2 2026-06-30 17:43:25.430674 | ubuntu-noble-large | 2026-06-30 17:43:25.430681 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.430688 | ubuntu-noble-large | 2026-06-30 17:30:27 6 [Note] WSREP: Recovered cluster id 2ca3d0df-74a9-11f1-a02a-527197580005 2026-06-30 17:43:25.430699 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: SST received: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.430705 | ubuntu-noble-large | 2026-06-30 17:30:27 3 [Note] WSREP: SST succeeded for position 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.430711 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Joiner monitor thread ended with total time 19 sec 2026-06-30 17:43:25.430718 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Installed new state from SST: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.430724 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] mariadbd: ready for connections. 2026-06-30 17:43:25.430730 | ubuntu-noble-large | Version: '11.4.5-MariaDB-ubu2404' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2026-06-30 17:43:25.430736 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Cert. index preload up to 3 2026-06-30 17:43:25.430743 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: ####### IST applying starts with 4 2026-06-30 17:43:25.430749 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: ####### IST current seqno initialized to 3 2026-06-30 17:43:25.430755 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2026-06-30 17:43:25.430761 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: IST preload starting at 3 2026-06-30 17:43:25.430767 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:25.430773 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.430778 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: ####### Assign initial position for certification: 2ca3d0df-74a9-11f1-a02a-527197580005:2, protocol version: 6 2026-06-30 17:43:25.430784 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-06-30 17:43:25.430790 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-06-30 17:43:25.430795 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Service thread queue flushed. 2026-06-30 17:43:25.430801 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 3 2026-06-30 17:43:25.430818 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Min available from gcache for CC from preload: 3 2026-06-30 17:43:25.430824 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete. 2026-06-30 17:43:25.430829 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: IST received: 2ca3d0df-74a9-11f1-a02a-527197580005:3 2026-06-30 17:43:25.430835 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 3 2026-06-30 17:43:25.430840 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Min available from gcache for CC from sst: 3 2026-06-30 17:43:25.430846 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-06-30 17:43:25.430852 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 3) 2026-06-30 17:43:25.430857 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-06-30 17:43:25.430869 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-06-30 17:43:25.430895 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-06-30 17:43:25.430904 | ubuntu-noble-large | 2026-06-30 17:30:27 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 3) 2026-06-30 17:43:25.430909 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Server openstack-db-2 synced with group 2026-06-30 17:43:25.430915 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Server status change joined -> synced 2026-06-30 17:43:25.430920 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: Synchronized with group, ready for connections 2026-06-30 17:43:25.430926 | ubuntu-noble-large | 2026-06-30 17:30:27 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-06-30 17:43:25.438431 | ubuntu-noble-large | {"level":"info","ts":1782840597.143061,"msg":"Agent starting"} 2026-06-30 17:43:25.438505 | ubuntu-noble-large | {"level":"info","ts":1782840597.1445014,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-06-30 17:43:25.438519 | ubuntu-noble-large | {"level":"info","ts":1782840597.1462045,"logger":"api","msg":"Configuring TLS"} 2026-06-30 17:43:25.438530 | ubuntu-noble-large | {"level":"info","ts":1782840597.1501045,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-06-30 17:43:25.438540 | ubuntu-noble-large | {"level":"info","ts":1782840597.1501043,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-06-30 17:43:25.438553 | ubuntu-noble-large | {"level":"error","ts":1782840617.0681496,"logger":"probe.liveness","msg":"error getting SQL client","error":"dial tcp [::1]:3306: connect: connection refused","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Liveness\n\t/app/pkg/galera/agent/handler/probe.go:67\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-06-30 17:43:25.438568 | ubuntu-noble-large | {"level":"error","ts":1782840627.035392,"logger":"probe.liveness","msg":"error getting SQL client","error":"dial tcp [::1]:3306: connect: connection refused","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Liveness\n\t/app/pkg/galera/agent/handler/probe.go:67\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-06-30 17:43:25.438603 | ubuntu-noble-large | 2026/06/30 17:30:37 "DELETE https://openstack-db-2.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.18:42238 - 404 41B in 10.184805ms 2026-06-30 17:43:25.441509 | ubuntu-noble-large | --- logs pod/openstack-db-2 (previous) --- 2026-06-30 17:43:25.589323 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "init" in pod "openstack-db-2" not found 2026-06-30 17:43:25.595986 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-l95d8 --- 2026-06-30 17:43:25.739962 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-l95d8 2026-06-30 17:43:25.740045 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:25.740057 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:25.740141 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:25.740165 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:25.740195 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:21 +0000 2026-06-30 17:43:25.740208 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-06-30 17:43:25.740219 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-06-30 17:43:25.740231 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-06-30 17:43:25.740238 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-06-30 17:43:25.740245 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-06-30 17:43:25.740251 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:25.740257 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:25.740263 | ubuntu-noble-large | IP: 10.244.0.32 2026-06-30 17:43:25.740270 | ubuntu-noble-large | IPs: 2026-06-30 17:43:25.740276 | ubuntu-noble-large | IP: 10.244.0.32 2026-06-30 17:43:25.740283 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-06-30 17:43:25.740289 | ubuntu-noble-large | Containers: 2026-06-30 17:43:25.740307 | ubuntu-noble-large | memcached: 2026-06-30 17:43:25.740315 | ubuntu-noble-large | Container ID: containerd://68cd124dddb27ed988d0d0a55e34e8a8f09dd6c77379b831c1fa286e4f772dd4 2026-06-30 17:43:25.740323 | ubuntu-noble-large | Image: memcached:1.6 2026-06-30 17:43:25.740330 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-06-30 17:43:25.740336 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-06-30 17:43:25.740343 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-06-30 17:43:25.740349 | ubuntu-noble-large | Args: 2026-06-30 17:43:25.740355 | ubuntu-noble-large | -m 2026-06-30 17:43:25.740362 | ubuntu-noble-large | 64 2026-06-30 17:43:25.740368 | ubuntu-noble-large | -c 2026-06-30 17:43:25.740374 | ubuntu-noble-large | 1024 2026-06-30 17:43:25.740381 | ubuntu-noble-large | -t 2026-06-30 17:43:25.740387 | ubuntu-noble-large | 4 2026-06-30 17:43:25.740394 | ubuntu-noble-large | -I 2026-06-30 17:43:25.740400 | ubuntu-noble-large | 1m 2026-06-30 17:43:25.740407 | ubuntu-noble-large | State: Running 2026-06-30 17:43:25.740413 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:28 +0000 2026-06-30 17:43:25.740420 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:25.740426 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:25.740433 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:25.740439 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-06-30 17:43:25.740446 | ubuntu-noble-large | Environment: 2026-06-30 17:43:25.740452 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:25.740459 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gk6jf (ro) 2026-06-30 17:43:25.740482 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:25.740488 | ubuntu-noble-large | Type Status 2026-06-30 17:43:25.740495 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:25.740501 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:25.740508 | ubuntu-noble-large | Ready True 2026-06-30 17:43:25.740514 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:25.740520 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:25.740527 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:25.740533 | ubuntu-noble-large | kube-api-access-gk6jf: 2026-06-30 17:43:25.740539 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:25.740546 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:25.740552 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:25.740559 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:25.740565 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:25.740571 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:25.740577 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:25.740584 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:25.740590 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:25.740597 | ubuntu-noble-large | Events: 2026-06-30 17:43:25.740603 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:25.740610 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:25.740616 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-l95d8 to forge-control-plane 2026-06-30 17:43:25.740624 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-06-30 17:43:25.740632 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 724ms (5.689s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:25.740639 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{memcached}: Container created 2026-06-30 17:43:25.740646 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{memcached}: Container started 2026-06-30 17:43:25.745962 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-l95d8 (current) --- 2026-06-30 17:43:25.911046 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-l95d8 (previous) --- 2026-06-30 17:43:26.046695 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-l95d8" not found 2026-06-30 17:43:26.049284 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-n9kjr --- 2026-06-30 17:43:26.174249 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-n9kjr 2026-06-30 17:43:26.174333 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:26.174346 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:26.174355 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:26.174364 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:26.174374 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:21 +0000 2026-06-30 17:43:26.174383 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-06-30 17:43:26.174391 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-06-30 17:43:26.174400 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-06-30 17:43:26.174408 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-06-30 17:43:26.174416 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-06-30 17:43:26.174425 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:26.174434 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:26.174442 | ubuntu-noble-large | IP: 10.244.0.34 2026-06-30 17:43:26.174451 | ubuntu-noble-large | IPs: 2026-06-30 17:43:26.174460 | ubuntu-noble-large | IP: 10.244.0.34 2026-06-30 17:43:26.174468 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-06-30 17:43:26.174477 | ubuntu-noble-large | Containers: 2026-06-30 17:43:26.174485 | ubuntu-noble-large | memcached: 2026-06-30 17:43:26.174494 | ubuntu-noble-large | Container ID: containerd://49270a905b1f91b69c605520b0c6d7906cad2db47b527134ee6692322cbba45f 2026-06-30 17:43:26.174503 | ubuntu-noble-large | Image: memcached:1.6 2026-06-30 17:43:26.174534 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-06-30 17:43:26.174553 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-06-30 17:43:26.174562 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-06-30 17:43:26.174571 | ubuntu-noble-large | Args: 2026-06-30 17:43:26.174579 | ubuntu-noble-large | -m 2026-06-30 17:43:26.174587 | ubuntu-noble-large | 64 2026-06-30 17:43:26.174595 | ubuntu-noble-large | -c 2026-06-30 17:43:26.174604 | ubuntu-noble-large | 1024 2026-06-30 17:43:26.174612 | ubuntu-noble-large | -t 2026-06-30 17:43:26.174620 | ubuntu-noble-large | 4 2026-06-30 17:43:26.174628 | ubuntu-noble-large | -I 2026-06-30 17:43:26.174636 | ubuntu-noble-large | 1m 2026-06-30 17:43:26.174644 | ubuntu-noble-large | State: Running 2026-06-30 17:43:26.174653 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:26 +0000 2026-06-30 17:43:26.174661 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:26.174670 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:26.174678 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:26.174687 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-06-30 17:43:26.174695 | ubuntu-noble-large | Environment: 2026-06-30 17:43:26.174703 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:26.174711 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-nwxcz (ro) 2026-06-30 17:43:26.174720 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:26.174728 | ubuntu-noble-large | Type Status 2026-06-30 17:43:26.174736 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:26.174744 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:26.174752 | ubuntu-noble-large | Ready True 2026-06-30 17:43:26.174760 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:26.174769 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:26.174777 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:26.174785 | ubuntu-noble-large | kube-api-access-nwxcz: 2026-06-30 17:43:26.174793 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:26.174802 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:26.174810 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:26.174819 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:26.174827 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:26.174835 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:26.174843 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:26.174851 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:26.174860 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:26.174868 | ubuntu-noble-large | Events: 2026-06-30 17:43:26.174918 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:26.174932 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:26.174940 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-n9kjr to forge-control-plane 2026-06-30 17:43:26.174950 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-06-30 17:43:26.174960 | ubuntu-noble-large | Normal Pulled 15m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 4.275s (4.275s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:26.174969 | ubuntu-noble-large | Normal Created 15m kubelet spec.containers{memcached}: Container created 2026-06-30 17:43:26.174978 | ubuntu-noble-large | Normal Started 15m kubelet spec.containers{memcached}: Container started 2026-06-30 17:43:26.179665 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-n9kjr (current) --- 2026-06-30 17:43:26.334084 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-n9kjr (previous) --- 2026-06-30 17:43:26.460981 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-n9kjr" not found 2026-06-30 17:43:26.465603 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-pljfj --- 2026-06-30 17:43:26.587965 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-pljfj 2026-06-30 17:43:26.588085 | ubuntu-noble-large | Namespace: openstack 2026-06-30 17:43:26.588097 | ubuntu-noble-large | Priority: 0 2026-06-30 17:43:26.588104 | ubuntu-noble-large | Service Account: default 2026-06-30 17:43:26.588111 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-06-30 17:43:26.588118 | ubuntu-noble-large | Start Time: Tue, 30 Jun 2026 17:28:21 +0000 2026-06-30 17:43:26.588125 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-06-30 17:43:26.588132 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-06-30 17:43:26.588138 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-06-30 17:43:26.588145 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-06-30 17:43:26.588151 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-06-30 17:43:26.588157 | ubuntu-noble-large | Annotations: 2026-06-30 17:43:26.588163 | ubuntu-noble-large | Status: Running 2026-06-30 17:43:26.588170 | ubuntu-noble-large | IP: 10.244.0.33 2026-06-30 17:43:26.588176 | ubuntu-noble-large | IPs: 2026-06-30 17:43:26.588183 | ubuntu-noble-large | IP: 10.244.0.33 2026-06-30 17:43:26.588189 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-06-30 17:43:26.588196 | ubuntu-noble-large | Containers: 2026-06-30 17:43:26.588202 | ubuntu-noble-large | memcached: 2026-06-30 17:43:26.588209 | ubuntu-noble-large | Container ID: containerd://35339e3e70e764b2c8b28c80a92c07adb21171bc2ef685c41e9265952a775ae2 2026-06-30 17:43:26.588216 | ubuntu-noble-large | Image: memcached:1.6 2026-06-30 17:43:26.588223 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-06-30 17:43:26.588229 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-06-30 17:43:26.588236 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-06-30 17:43:26.588242 | ubuntu-noble-large | Args: 2026-06-30 17:43:26.588248 | ubuntu-noble-large | -m 2026-06-30 17:43:26.588254 | ubuntu-noble-large | 64 2026-06-30 17:43:26.588261 | ubuntu-noble-large | -c 2026-06-30 17:43:26.588267 | ubuntu-noble-large | 1024 2026-06-30 17:43:26.588273 | ubuntu-noble-large | -t 2026-06-30 17:43:26.588279 | ubuntu-noble-large | 4 2026-06-30 17:43:26.588285 | ubuntu-noble-large | -I 2026-06-30 17:43:26.588291 | ubuntu-noble-large | 1m 2026-06-30 17:43:26.588297 | ubuntu-noble-large | State: Running 2026-06-30 17:43:26.588304 | ubuntu-noble-large | Started: Tue, 30 Jun 2026 17:28:27 +0000 2026-06-30 17:43:26.588310 | ubuntu-noble-large | Ready: True 2026-06-30 17:43:26.588316 | ubuntu-noble-large | Restart Count: 0 2026-06-30 17:43:26.588323 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-06-30 17:43:26.588329 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-06-30 17:43:26.588335 | ubuntu-noble-large | Environment: 2026-06-30 17:43:26.588341 | ubuntu-noble-large | Mounts: 2026-06-30 17:43:26.588348 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-h99z5 (ro) 2026-06-30 17:43:26.588354 | ubuntu-noble-large | Conditions: 2026-06-30 17:43:26.588360 | ubuntu-noble-large | Type Status 2026-06-30 17:43:26.588367 | ubuntu-noble-large | PodReadyToStartContainers True 2026-06-30 17:43:26.588373 | ubuntu-noble-large | Initialized True 2026-06-30 17:43:26.588379 | ubuntu-noble-large | Ready True 2026-06-30 17:43:26.588396 | ubuntu-noble-large | ContainersReady True 2026-06-30 17:43:26.588403 | ubuntu-noble-large | PodScheduled True 2026-06-30 17:43:26.588409 | ubuntu-noble-large | Volumes: 2026-06-30 17:43:26.588415 | ubuntu-noble-large | kube-api-access-h99z5: 2026-06-30 17:43:26.588422 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-06-30 17:43:26.588428 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-06-30 17:43:26.588434 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-06-30 17:43:26.588440 | ubuntu-noble-large | Optional: false 2026-06-30 17:43:26.588446 | ubuntu-noble-large | DownwardAPI: true 2026-06-30 17:43:26.588452 | ubuntu-noble-large | QoS Class: BestEffort 2026-06-30 17:43:26.588458 | ubuntu-noble-large | Node-Selectors: 2026-06-30 17:43:26.588464 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-06-30 17:43:26.588471 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-06-30 17:43:26.588477 | ubuntu-noble-large | Events: 2026-06-30 17:43:26.588483 | ubuntu-noble-large | Type Reason Age From Message 2026-06-30 17:43:26.588494 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-06-30 17:43:26.588501 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-pljfj to forge-control-plane 2026-06-30 17:43:26.588509 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-06-30 17:43:26.588516 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 733ms (4.994s including waiting). Image size: 32221876 bytes. 2026-06-30 17:43:26.588524 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{memcached}: Container created 2026-06-30 17:43:26.588530 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{memcached}: Container started 2026-06-30 17:43:26.592625 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-pljfj (current) --- 2026-06-30 17:43:26.723853 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-pljfj (previous) --- 2026-06-30 17:43:26.849665 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-pljfj" not found 2026-06-30 17:43:26.855516 | ubuntu-noble-large | Deleting kind cluster forge 2026-06-30 17:43:26.896096 | ubuntu-noble-large | Deleting cluster "forge" ... 2026-06-30 17:43:29.754634 | ubuntu-noble-large | Deleted nodes: ["forge-control-plane"] 2026-06-30 17:43:29.760136 | ubuntu-noble-large | make: *** [Makefile:9: integration] Error 1 2026-06-30 17:43:29.883240 | ubuntu-noble-large | ERROR 2026-06-30 17:43:29.883563 | ubuntu-noble-large | { 2026-06-30 17:43:29.883628 | ubuntu-noble-large | "delta": "0:21:01.404736", 2026-06-30 17:43:29.883669 | ubuntu-noble-large | "end": "2026-06-30 17:43:29.761318", 2026-06-30 17:43:29.883703 | ubuntu-noble-large | "msg": "non-zero return code", 2026-06-30 17:43:29.883734 | ubuntu-noble-large | "rc": 2, 2026-06-30 17:43:29.883764 | ubuntu-noble-large | "start": "2026-06-30 17:22:28.356582" 2026-06-30 17:43:29.883802 | ubuntu-noble-large | } failure 2026-06-30 17:43:29.965379 | 2026-06-30 17:43:29.965675 | PLAY RECAP 2026-06-30 17:43:29.965790 | ubuntu-noble-large | ok: 1 changed: 1 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-06-30 17:43:29.965823 | 2026-06-30 17:43:30.152074 | RUN END RESULT_NORMAL: [untrusted : github.com/osism/openstack-project-manager/playbooks/test-integration.yml@main] 2026-06-30 17:43:30.153479 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-06-30 17:43:30.980627 | 2026-06-30 17:43:30.980823 | PLAY [Base post-fetch] 2026-06-30 17:43:30.995653 | 2026-06-30 17:43:30.995796 | TASK [diagnose-network : Ensure log directory exists] 2026-06-30 17:43:31.684422 | ubuntu-noble-large | ok 2026-06-30 17:43:31.696989 | 2026-06-30 17:43:31.697191 | TASK [diagnose-network : Snapshot dual-stack network state (post)] 2026-06-30 17:43:43.679215 | ubuntu-noble-large | ok: Runtime: 0:00:06.064998 2026-06-30 17:43:43.690165 | 2026-06-30 17:43:43.690335 | TASK [diagnose-network : Snapshot Docker/BuildKit IPv6 config (teardown)] 2026-06-30 17:43:49.934008 | ubuntu-noble-large | ok: Runtime: 0:00:00.411183 2026-06-30 17:43:49.943308 | 2026-06-30 17:43:49.943480 | TASK [diagnose-network : Probe container network namespace (teardown)] 2026-06-30 17:43:56.104619 | ubuntu-noble-large | ok: Runtime: 0:00:01.014049 2026-06-30 17:43:56.117687 | 2026-06-30 17:43:56.117818 | TASK [fetch-output : Set log path for multiple nodes] 2026-06-30 17:43:56.182640 | ubuntu-noble-large | skipping: Conditional result was False 2026-06-30 17:43:56.191545 | 2026-06-30 17:43:56.191695 | TASK [fetch-output : Set log path for single node] 2026-06-30 17:43:56.237346 | ubuntu-noble-large | ok 2026-06-30 17:43:56.245157 | 2026-06-30 17:43:56.245302 | LOOP [fetch-output : Ensure local output dirs] 2026-06-30 17:43:56.543639 | ubuntu-noble-large -> localhost | ok: "/var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/logs" 2026-06-30 17:43:56.809043 | ubuntu-noble-large -> localhost | changed: "/var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/artifacts" 2026-06-30 17:43:57.094725 | ubuntu-noble-large -> localhost | changed: "/var/lib/zuul/builds/b4976b3b18474449abb37099dc40d426/work/docs" 2026-06-30 17:43:57.113369 | 2026-06-30 17:43:57.113513 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-06-30 17:43:57.963339 | ubuntu-noble-large | changed: 2026-06-30 17:43:57.963746 | ubuntu-noble-large | .d..t...... ./ 2026-06-30 17:43:57.963816 | ubuntu-noble-large | >f+++++++++ net-debug.post.txt 2026-06-30 17:43:57.963880 | ubuntu-noble-large | >f+++++++++ net-debug.pre.txt 2026-06-30 17:43:57.963921 | ubuntu-noble-large | >f+++++++++ sudo-debug.txt 2026-06-30 17:43:57.963976 | ubuntu-noble-large | >f+++++++++ sudo-strace.log 2026-06-30 17:43:57.964015 | ubuntu-noble-large | >f+++++++++ sudo-strace.log.time 2026-06-30 17:43:57.964093 | ubuntu-noble-large | changed: All items complete 2026-06-30 17:43:57.964132 | 2026-06-30 17:43:58.544675 | ubuntu-noble-large | changed: .d..t...... ./ 2026-06-30 17:43:59.151214 | ubuntu-noble-large | changed: .d..t...... ./ 2026-06-30 17:43:59.180725 | 2026-06-30 17:43:59.180923 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-06-30 17:43:59.522603 | ubuntu-noble-large -> localhost | ok: Item: artifacts Runtime: 0:00:00.010739 2026-06-30 17:43:59.843283 | ubuntu-noble-large -> localhost | ok: Item: docs Runtime: 0:00:00.011127 2026-06-30 17:43:59.856233 | 2026-06-30 17:43:59.856374 | PLAY RECAP 2026-06-30 17:43:59.856432 | ubuntu-noble-large | ok: 8 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-06-30 17:43:59.856458 | 2026-06-30 17:43:59.996016 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-06-30 17:43:59.998122 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-06-30 17:44:00.792376 | 2026-06-30 17:44:00.792561 | PLAY [Base post] 2026-06-30 17:44:00.806646 | 2026-06-30 17:44:00.806783 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-06-30 17:44:01.705352 | ubuntu-noble-large | changed 2026-06-30 17:44:01.717804 | 2026-06-30 17:44:01.718011 | PLAY RECAP 2026-06-30 17:44:01.718118 | ubuntu-noble-large | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-06-30 17:44:01.718223 | 2026-06-30 17:44:01.879751 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-06-30 17:44:01.880698 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-06-30 17:44:02.724797 | 2026-06-30 17:44:02.725009 | PLAY [Base post-logs] 2026-06-30 17:44:02.736472 | 2026-06-30 17:44:02.736628 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-06-30 17:44:03.213236 | localhost | changed 2026-06-30 17:44:03.232803 | 2026-06-30 17:44:03.233093 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-06-30 17:44:03.272994 | localhost | ok 2026-06-30 17:44:03.280183 | 2026-06-30 17:44:03.280379 | TASK [Set zuul-log-path fact] 2026-06-30 17:44:03.302726 | localhost | ok 2026-06-30 17:44:03.316534 | 2026-06-30 17:44:03.316680 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-06-30 17:44:03.356895 | localhost | ok 2026-06-30 17:44:03.365519 | 2026-06-30 17:44:03.365672 | TASK [upload-logs : Create log directories] 2026-06-30 17:44:03.911817 | localhost | changed 2026-06-30 17:44:03.917825 | 2026-06-30 17:44:03.918053 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-06-30 17:44:04.453666 | localhost -> localhost | ok: Runtime: 0:00:00.007329 2026-06-30 17:44:04.463751 | 2026-06-30 17:44:04.463984 | TASK [upload-logs : Upload logs to log server] 2026-06-30 17:44:05.077913 | localhost | Output suppressed because no_log was given 2026-06-30 17:44:05.081053 | 2026-06-30 17:44:05.081205 | LOOP [upload-logs : Compress console log and json output] 2026-06-30 17:44:05.146235 | localhost | skipping: Conditional result was False 2026-06-30 17:44:05.151298 | localhost | skipping: Conditional result was False 2026-06-30 17:44:05.163455 | 2026-06-30 17:44:05.163675 | LOOP [upload-logs : Upload compressed console log and json output] 2026-06-30 17:44:05.214151 | localhost | skipping: Conditional result was False 2026-06-30 17:44:05.214717 | 2026-06-30 17:44:05.218242 | localhost | skipping: Conditional result was False 2026-06-30 17:44:05.226325 | 2026-06-30 17:44:05.226549 | LOOP [upload-logs : Upload console log and json output]