2026-07-03 06:35:58.670009 | Job console starting 2026-07-03 06:35:58.685329 | Updating git repos 2026-07-03 06:35:58.719989 | Cloning repos into workspace 2026-07-03 06:35:58.769517 | Restoring repo states 2026-07-03 06:35:58.776424 | Merging changes 2026-07-03 06:35:59.295534 | Checking out repos 2026-07-03 06:35:59.317966 | Preparing playbooks 2026-07-03 06:36:00.216476 | Running Ansible setup 2026-07-03 06:36:05.111395 | PRE-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/pre.yaml@main] 2026-07-03 06:36:05.970475 | 2026-07-03 06:36:05.970687 | PLAY [Base pre] 2026-07-03 06:36:05.993830 | 2026-07-03 06:36:05.993993 | TASK [Setup log path fact] 2026-07-03 06:36:06.015186 | ubuntu-noble-large | ok 2026-07-03 06:36:06.034999 | 2026-07-03 06:36:06.035181 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-03 06:36:06.095803 | ubuntu-noble-large | ok 2026-07-03 06:36:06.109636 | 2026-07-03 06:36:06.109797 | TASK [emit-job-header : Print job information] 2026-07-03 06:36:06.155674 | # Job Information 2026-07-03 06:36:06.155899 | Ansible Version: 2.16.14 2026-07-03 06:36:06.155935 | Job: openstack-project-manager-integration 2026-07-03 06:36:06.155969 | Pipeline: check 2026-07-03 06:36:06.155992 | Executor: 521e9411259a 2026-07-03 06:36:06.156013 | Triggered by: https://github.com/osism/openstack-project-manager/pull/294 2026-07-03 06:36:06.156035 | Event ID: 5a86f2a0-76a9-11f1-8581-e6a3a6246250 2026-07-03 06:36:06.163143 | 2026-07-03 06:36:06.163274 | LOOP [emit-job-header : Print node information] 2026-07-03 06:36:06.280717 | ubuntu-noble-large | ok: 2026-07-03 06:36:06.281016 | ubuntu-noble-large | # Node Information 2026-07-03 06:36:06.281072 | ubuntu-noble-large | Inventory Hostname: ubuntu-noble-large 2026-07-03 06:36:06.281106 | ubuntu-noble-large | Hostname: ubuntu 2026-07-03 06:36:06.281138 | ubuntu-noble-large | Username: zuul 2026-07-03 06:36:06.281167 | ubuntu-noble-large | Distro: Ubuntu 24.04 2026-07-03 06:36:06.281199 | ubuntu-noble-large | Provider: regiocloud-a 2026-07-03 06:36:06.281228 | ubuntu-noble-large | Region: 2026-07-03 06:36:06.281259 | ubuntu-noble-large | Label: ubuntu-noble-large 2026-07-03 06:36:06.281324 | ubuntu-noble-large | Product Name: OpenStack Nova 2026-07-03 06:36:06.281354 | ubuntu-noble-large | Interface IP: 2a13:1a81:8000:3124:f816:3eff:fe9c:2fda 2026-07-03 06:36:06.293258 | 2026-07-03 06:36:06.293470 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-07-03 06:36:06.921601 | ubuntu-noble-large -> localhost | changed 2026-07-03 06:36:06.938133 | 2026-07-03 06:36:06.938333 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-07-03 06:36:08.134563 | ubuntu-noble-large -> localhost | changed 2026-07-03 06:36:08.162608 | 2026-07-03 06:36:08.162773 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-07-03 06:36:08.472364 | ubuntu-noble-large -> localhost | ok 2026-07-03 06:36:08.487518 | 2026-07-03 06:36:08.487710 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-07-03 06:36:08.536542 | ubuntu-noble-large | ok 2026-07-03 06:36:08.556068 | ubuntu-noble-large | included: /var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-07-03 06:36:08.563062 | 2026-07-03 06:36:08.563184 | TASK [add-build-sshkey : Create Temp SSH key] 2026-07-03 06:36:10.205649 | ubuntu-noble-large -> localhost | Generating public/private rsa key pair. 2026-07-03 06:36:10.206203 | ubuntu-noble-large -> localhost | Your identification has been saved in /var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/c9c5cd8522ea434c8c5b4597d5632050_id_rsa 2026-07-03 06:36:10.206351 | ubuntu-noble-large -> localhost | Your public key has been saved in /var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/c9c5cd8522ea434c8c5b4597d5632050_id_rsa.pub 2026-07-03 06:36:10.206429 | ubuntu-noble-large -> localhost | The key fingerprint is: 2026-07-03 06:36:10.206495 | ubuntu-noble-large -> localhost | SHA256:z52BtR5OmET7fXEy6sS0GKuoN4lsomLEtv5wNKzBauQ zuul-build-sshkey 2026-07-03 06:36:10.206583 | ubuntu-noble-large -> localhost | The key's randomart image is: 2026-07-03 06:36:10.206645 | ubuntu-noble-large -> localhost | +---[RSA 3072]----+ 2026-07-03 06:36:10.206704 | ubuntu-noble-large -> localhost | | . | 2026-07-03 06:36:10.206765 | ubuntu-noble-large -> localhost | | . . | 2026-07-03 06:36:10.206825 | ubuntu-noble-large -> localhost | | + o o..| 2026-07-03 06:36:10.206958 | ubuntu-noble-large -> localhost | |. . . % = oo| 2026-07-03 06:36:10.207019 | ubuntu-noble-large -> localhost | |.+ + S * @ . .| 2026-07-03 06:36:10.207093 | ubuntu-noble-large -> localhost | |+++ . . + B + . | 2026-07-03 06:36:10.207154 | ubuntu-noble-large -> localhost | |+E.o .... o * | 2026-07-03 06:36:10.207216 | ubuntu-noble-large -> localhost | |oo+ +.+ | 2026-07-03 06:36:10.207297 | ubuntu-noble-large -> localhost | |=o.+.. . | 2026-07-03 06:36:10.207360 | ubuntu-noble-large -> localhost | +----[SHA256]-----+ 2026-07-03 06:36:10.207504 | ubuntu-noble-large -> localhost | ok: Runtime: 0:00:01.103295 2026-07-03 06:36:10.220783 | 2026-07-03 06:36:10.220947 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-07-03 06:36:10.267146 | ubuntu-noble-large | ok 2026-07-03 06:36:10.282148 | ubuntu-noble-large | included: /var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/trusted/project_1/github.com/osism/openinfra-zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-07-03 06:36:10.291012 | 2026-07-03 06:36:10.291122 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-07-03 06:36:10.326096 | ubuntu-noble-large | skipping: Conditional result was False 2026-07-03 06:36:10.335584 | 2026-07-03 06:36:10.335712 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-07-03 06:36:11.087940 | ubuntu-noble-large | changed 2026-07-03 06:36:11.096761 | 2026-07-03 06:36:11.096895 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-07-03 06:36:11.413636 | ubuntu-noble-large | ok 2026-07-03 06:36:11.421749 | 2026-07-03 06:36:11.421875 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-07-03 06:36:12.211698 | ubuntu-noble-large | changed 2026-07-03 06:36:12.219753 | 2026-07-03 06:36:12.220196 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-07-03 06:36:13.001348 | ubuntu-noble-large | changed 2026-07-03 06:36:13.011603 | 2026-07-03 06:36:13.011750 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-07-03 06:36:13.037821 | ubuntu-noble-large | skipping: Conditional result was False 2026-07-03 06:36:13.053189 | 2026-07-03 06:36:13.053368 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-07-03 06:36:13.549666 | ubuntu-noble-large -> localhost | changed 2026-07-03 06:36:13.573175 | 2026-07-03 06:36:13.573445 | TASK [add-build-sshkey : Add back temp key] 2026-07-03 06:36:13.937133 | ubuntu-noble-large -> localhost | Identity added: /var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/c9c5cd8522ea434c8c5b4597d5632050_id_rsa (zuul-build-sshkey) 2026-07-03 06:36:13.938727 | ubuntu-noble-large -> localhost | ok: Runtime: 0:00:00.018995 2026-07-03 06:36:13.949570 | 2026-07-03 06:36:13.949716 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-07-03 06:36:14.452680 | ubuntu-noble-large | ok 2026-07-03 06:36:14.459390 | 2026-07-03 06:36:14.459517 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-07-03 06:36:14.495074 | ubuntu-noble-large | skipping: Conditional result was False 2026-07-03 06:36:14.516475 | 2026-07-03 06:36:14.516618 | TASK [start-zuul-console : Start zuul_console daemon.] 2026-07-03 06:36:15.012893 | ubuntu-noble-large | ok 2026-07-03 06:36:15.024539 | 2026-07-03 06:36:15.024670 | TASK [validate-host : Define zuul_info_dir fact] 2026-07-03 06:36:15.069734 | ubuntu-noble-large | ok 2026-07-03 06:36:15.077540 | 2026-07-03 06:36:15.077666 | TASK [validate-host : Ensure Zuul Ansible directory exists] 2026-07-03 06:36:15.388051 | ubuntu-noble-large -> localhost | ok 2026-07-03 06:36:15.403821 | 2026-07-03 06:36:15.403992 | TASK [validate-host : Collect information about the host] 2026-07-03 06:36:17.785894 | ubuntu-noble-large | ok 2026-07-03 06:36:17.858484 | 2026-07-03 06:36:17.858657 | TASK [validate-host : Sanitize hostname] 2026-07-03 06:36:17.938982 | ubuntu-noble-large | ok 2026-07-03 06:36:17.947922 | 2026-07-03 06:36:17.948060 | TASK [validate-host : Write out all ansible variables/facts known for each host] 2026-07-03 06:36:18.542144 | ubuntu-noble-large -> localhost | changed 2026-07-03 06:36:18.548877 | 2026-07-03 06:36:18.549006 | TASK [validate-host : Collect information about zuul worker] 2026-07-03 06:36:19.049014 | ubuntu-noble-large | ok 2026-07-03 06:36:19.054852 | 2026-07-03 06:36:19.054990 | TASK [validate-host : Write out all zuul information for each host] 2026-07-03 06:36:19.645065 | ubuntu-noble-large -> localhost | changed 2026-07-03 06:36:19.662431 | 2026-07-03 06:36:19.662561 | TASK [prepare-workspace-log : Start zuul_console daemon.] 2026-07-03 06:36:19.993767 | ubuntu-noble-large | ok 2026-07-03 06:36:20.006896 | 2026-07-03 06:36:20.007117 | TASK [prepare-workspace-log : Synchronize src repos to workspace directory.] 2026-07-03 06:36:20.933484 | ubuntu-noble-large | changed: 2026-07-03 06:36:20.934122 | ubuntu-noble-large | cd+++++++++ src/ 2026-07-03 06:36:20.934169 | ubuntu-noble-large | cd+++++++++ src/github.com/ 2026-07-03 06:36:20.934194 | ubuntu-noble-large | cd+++++++++ src/github.com/osism/ 2026-07-03 06:36:20.934218 | ubuntu-noble-large | cd+++++++++ src/github.com/osism/openstack-project-manager/ 2026-07-03 06:36:20.934239 | ubuntu-noble-large | 2026-07-03 06:42:07.794291 | ubuntu-noble-large | deletion_time n/a 2026-07-03 06:42:07.794302 | ubuntu-noble-large | destroyed false 2026-07-03 06:42:07.794313 | ubuntu-noble-large | version 1 2026-07-03 06:42:07.816714 | ubuntu-noble-large | [2026-07-03T06:42:07Z] Secret 'kv-v2/infrastructure/mariadb' written. 2026-07-03 06:42:07.821054 | ubuntu-noble-large | [2026-07-03T06:42:07Z] --- Seeding ControlPlane 'openstack/controlplane' (keystone='controlplane-keystone') --- 2026-07-03 06:42:08.262640 | ubuntu-noble-large | [2026-07-03T06:42:08Z] Writing secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin'... 2026-07-03 06:42:08.956222 | ubuntu-noble-large | ======================= Secret Path ======================= 2026-07-03 06:42:08.956697 | ubuntu-noble-large | kv-v2/data/bootstrap/openstack/controlplane-keystone/admin 2026-07-03 06:42:08.956730 | ubuntu-noble-large | 2026-07-03 06:42:08.956743 | ubuntu-noble-large | ======= Metadata ======= 2026-07-03 06:42:08.956754 | ubuntu-noble-large | Key Value 2026-07-03 06:42:08.956763 | ubuntu-noble-large | --- ----- 2026-07-03 06:42:08.956773 | ubuntu-noble-large | created_time 2026-07-03T06:42:08.905157759Z 2026-07-03 06:42:08.956784 | ubuntu-noble-large | custom_metadata 2026-07-03 06:42:08.956794 | ubuntu-noble-large | deletion_time n/a 2026-07-03 06:42:08.956803 | ubuntu-noble-large | destroyed false 2026-07-03 06:42:08.957715 | ubuntu-noble-large | version 1 2026-07-03 06:42:08.975668 | ubuntu-noble-large | [2026-07-03T06:42:08Z] Secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' written. 2026-07-03 06:42:08.979249 | ubuntu-noble-large | [2026-07-03T06:42:08Z] Marking 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' as managed-by=external-secrets (ESO PushSecret adoption)... 2026-07-03 06:42:09.383401 | ubuntu-noble-large | Success! Data written to: kv-v2/metadata/bootstrap/openstack/controlplane-keystone/admin 2026-07-03 06:42:09.400467 | ubuntu-noble-large | [2026-07-03T06:42:09Z] Secret 'kv-v2/bootstrap/openstack/controlplane-keystone/admin' marked ESO-managed. 2026-07-03 06:42:09.834041 | ubuntu-noble-large | [2026-07-03T06:42:09Z] Writing secret 'kv-v2/openstack/keystone/openstack/controlplane/db'... 2026-07-03 06:42:10.462838 | ubuntu-noble-large | ===================== Secret Path ===================== 2026-07-03 06:42:10.462924 | ubuntu-noble-large | kv-v2/data/openstack/keystone/openstack/controlplane/db 2026-07-03 06:42:10.462938 | ubuntu-noble-large | 2026-07-03 06:42:10.462951 | ubuntu-noble-large | ======= Metadata ======= 2026-07-03 06:42:10.462962 | ubuntu-noble-large | Key Value 2026-07-03 06:42:10.462971 | ubuntu-noble-large | --- ----- 2026-07-03 06:42:10.462981 | ubuntu-noble-large | created_time 2026-07-03T06:42:10.445441901Z 2026-07-03 06:42:10.462992 | ubuntu-noble-large | custom_metadata 2026-07-03 06:42:10.463002 | ubuntu-noble-large | deletion_time n/a 2026-07-03 06:42:10.463011 | ubuntu-noble-large | destroyed false 2026-07-03 06:42:10.463021 | ubuntu-noble-large | version 1 2026-07-03 06:42:10.486721 | ubuntu-noble-large | [2026-07-03T06:42:10Z] Secret 'kv-v2/openstack/keystone/openstack/controlplane/db' written. 2026-07-03 06:42:10.489507 | ubuntu-noble-large | [2026-07-03T06:42:10Z] Marking 'kv-v2/openstack/keystone/openstack/controlplane/db' as managed-by=external-secrets (ESO PushSecret adoption)... 2026-07-03 06:42:10.948369 | ubuntu-noble-large | Success! Data written to: kv-v2/metadata/openstack/keystone/openstack/controlplane/db 2026-07-03 06:42:10.966962 | ubuntu-noble-large | [2026-07-03T06:42:10Z] Secret 'kv-v2/openstack/keystone/openstack/controlplane/db' marked ESO-managed. 2026-07-03 06:42:10.970929 | ubuntu-noble-large | [2026-07-03T06:42:10Z] === Done === 2026-07-03 06:42:10.975543 | ubuntu-noble-large | [2026-07-03T06:42:10Z] write-bootstrap-secrets.sh completed. 2026-07-03 06:42:10.978962 | ubuntu-noble-large | [2026-07-03T06:42:10Z] All bootstrap scripts completed. 2026-07-03 06:42:10.986681 | ubuntu-noble-large | [2026-07-03T06:42:10Z] Waiting up to 300s for pods with selector 'app.kubernetes.io/name=openbao' in namespace 'openbao-system' to be Ready... 2026-07-03 06:42:11.274878 | ubuntu-noble-large | [2026-07-03T06:42:11Z] All 1 pod(s) with selector 'app.kubernetes.io/name=openbao' in 'openbao-system' are Ready. 2026-07-03 06:42:11.283109 | ubuntu-noble-large | [2026-07-03T06:42:11Z] Forcing ESO ClusterSecretStore re-validation and ExternalSecret re-sync... 2026-07-03 06:42:11.421290 | ubuntu-noble-large | clustersecretstore.external-secrets.io/openbao-cluster-store annotated 2026-07-03 06:42:11.628079 | ubuntu-noble-large | clustersecretstore.external-secrets.io/openbao-cluster-store condition met 2026-07-03 06:42:11.761134 | ubuntu-noble-large | externalsecret.external-secrets.io/keystone-admin annotated 2026-07-03 06:42:11.908255 | ubuntu-noble-large | externalsecret.external-secrets.io/keystone-db annotated 2026-07-03 06:42:12.055294 | ubuntu-noble-large | externalsecret.external-secrets.io/mariadb-root-password annotated 2026-07-03 06:42:12.062658 | ubuntu-noble-large | [2026-07-03T06:42:12Z] === Step 8/8: Wait for ExternalSecrets === 2026-07-03 06:42:12.069844 | ubuntu-noble-large | [2026-07-03T06:42:12Z] Waiting up to 120s for ExternalSecrets to sync in namespace 'openstack': keystone-admin keystone-db mariadb-root-password 2026-07-03 06:42:12.446286 | ubuntu-noble-large | [2026-07-03T06:42:12Z] All ExternalSecrets are synced. 2026-07-03 06:42:12.451569 | ubuntu-noble-large | [2026-07-03T06:42:12Z] === WITH_CONTROLPLANE: bringing up the c5c3 ControlPlane stack === 2026-07-03 06:42:12.662876 | ubuntu-noble-large | helmrelease.helm.toolkit.fluxcd.io/keystone-operator condition met 2026-07-03 06:42:12.889377 | ubuntu-noble-large | kustomization.kustomize.toolkit.fluxcd.io/k-orc condition met 2026-07-03 06:42:13.105468 | ubuntu-noble-large | helmrelease.helm.toolkit.fluxcd.io/c5c3-operator condition met 2026-07-03 06:42:37.743788 | ubuntu-noble-large | [2026-07-03T06:42:37Z] Preloaded ghcr.io/c5c3/keystone:2025.2 into kind. 2026-07-03 06:42:37.749059 | ubuntu-noble-large | [2026-07-03T06:42:37Z] Operator stack is up. The ControlPlane CR is NOT applied automatically — 2026-07-03 06:42:37.753222 | ubuntu-noble-large | [2026-07-03T06:42:37Z] create and apply it yourself (see docs/quick-start-controlplane.md), e.g.: 2026-07-03 06:42:37.756608 | ubuntu-noble-large | [2026-07-03T06:42:37Z] kubectl apply -f deploy/kind/controlplane/controlplane.yaml 2026-07-03 06:42:37.759687 | ubuntu-noble-large | [2026-07-03T06:42:37Z] Name the CR 'controlplane' (CONTROLPLANE_NAME must match the applied 2026-07-03 06:42:37.762647 | ubuntu-noble-large | [2026-07-03T06:42:37Z] CR name — the per-CR Model B admin-password bootstrap path and the projected 2026-07-03 06:42:37.765107 | ubuntu-noble-large | [2026-07-03T06:42:37Z] controlplane-keystone Service both derive from it; set CONTROLPLANE_NAME 2026-07-03 06:42:37.767646 | ubuntu-noble-large | [2026-07-03T06:42:37Z] to change it); 2026-07-03 06:42:37.770087 | ubuntu-noble-large | [2026-07-03T06:42:37Z] on a KIND_HOST_PORT override set spec.services.keystone.publicEndpoint to 2026-07-03 06:42:37.774234 | ubuntu-noble-large | [2026-07-03T06:42:37Z] the matching : URL. Or re-run with WITH_CONTROLPLANE_CR=true to apply 2026-07-03 06:42:37.776823 | ubuntu-noble-large | [2026-07-03T06:42:37Z] the bundled CR for you. 2026-07-03 06:42:37.779100 | ubuntu-noble-large | [2026-07-03T06:42:37Z] 2026-07-03 06:42:37.782552 | ubuntu-noble-large | [2026-07-03T06:42:37Z] ========================================== 2026-07-03 06:42:37.785912 | ubuntu-noble-large | [2026-07-03T06:42:37Z] Infrastructure deployment complete! 2026-07-03 06:42:37.790273 | ubuntu-noble-large | [2026-07-03T06:42:37Z] ========================================== 2026-07-03 06:42:37.794009 | ubuntu-noble-large | [2026-07-03T06:42:37Z] Cluster: forge 2026-07-03 06:42:37.797644 | ubuntu-noble-large | [2026-07-03T06:42:37Z] To tear down: make teardown-infra 2026-07-03 06:42:37.798731 | ubuntu-noble-large | make[1]: Leaving directory '/tmp/opm-forge' 2026-07-03 06:42:38.165013 | ubuntu-noble-large | controlplane.c5c3.io/controlplane created 2026-07-03 06:42:38.435738 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:42:53.668449 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:43:08.880943 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:43:24.140302 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:43:39.389917 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:43:54.670901 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:44:09.937741 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:44:25.191501 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:44:40.440560 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: InfrastructureReady=False (WaitingForDatabase): MariaDB "openstack-db" is not ready 2026-07-03 06:44:55.691947 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:45:10.949461 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:45:26.210357 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:45:41.451147 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:45:56.711084 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:46:11.963548 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:46:27.253858 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:46:42.540159 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:46:57.785669 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:47:13.054967 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:47:28.313018 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:47:43.549297 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:47:58.801311 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:48:14.049937 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:48:29.304021 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:48:44.533279 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:48:59.795234 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:49:15.068130 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:49:30.314641 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:49:45.572617 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:50:00.818903 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:50:16.102933 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:50:31.342773 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:50:46.581721 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:51:01.811280 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:51:17.120802 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:51:32.364093 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:51:47.593586 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:52:02.831105 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:52:18.099300 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:52:33.333476 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:52:48.583636 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:53:03.855324 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:53:19.132074 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:53:34.366147 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:53:49.621848 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:54:04.892674 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:54:20.139432 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:54:35.401398 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:54:50.650904 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:55:05.907926 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:55:21.174406 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:55:36.410256 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:55:51.658965 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:56:06.913667 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:56:22.165415 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:56:37.427317 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:56:52.656247 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:07.903010 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:23.175700 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:38.424112 | ubuntu-noble-large | ControlPlane/controlplane not Ready yet: KeystoneReady=False (WaitingForKeystone): Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:38.427460 | ubuntu-noble-large | ERROR: ControlPlane/controlplane not Ready after 900s. 2026-07-03 06:57:38.545891 | ubuntu-noble-large | apiVersion: c5c3.io/v1alpha1 2026-07-03 06:57:38.545972 | ubuntu-noble-large | kind: ControlPlane 2026-07-03 06:57:38.545986 | ubuntu-noble-large | metadata: 2026-07-03 06:57:38.545997 | ubuntu-noble-large | annotations: 2026-07-03 06:57:38.546007 | ubuntu-noble-large | kubectl.kubernetes.io/last-applied-configuration: | 2026-07-03 06:57:38.546069 | ubuntu-noble-large | {"apiVersion":"c5c3.io/v1alpha1","kind":"ControlPlane","metadata":{"annotations":{},"name":"controlplane","namespace":"openstack"},"spec":{"openStackRelease":"2025.2","services":{"keystone":{"gateway":{"hostname":"keystone.127-0-0-1.nip.io","parentRef":{"name":"openstack-gw"},"path":"/"},"publicEndpoint":"https://keystone.127-0-0-1.nip.io:8443/v3","replicas":1}}}} 2026-07-03 06:57:38.546084 | ubuntu-noble-large | creationTimestamp: "2026-07-03T06:42:38Z" 2026-07-03 06:57:38.546093 | ubuntu-noble-large | finalizers: 2026-07-03 06:57:38.546101 | ubuntu-noble-large | - c5c3.io/orc-teardown 2026-07-03 06:57:38.546110 | ubuntu-noble-large | generation: 1 2026-07-03 06:57:38.546118 | ubuntu-noble-large | name: controlplane 2026-07-03 06:57:38.546126 | ubuntu-noble-large | namespace: openstack 2026-07-03 06:57:38.546134 | ubuntu-noble-large | resourceVersion: "4499" 2026-07-03 06:57:38.546142 | ubuntu-noble-large | uid: 00163cad-e901-4632-9112-5df1e1c7a80d 2026-07-03 06:57:38.546150 | ubuntu-noble-large | spec: 2026-07-03 06:57:38.546158 | ubuntu-noble-large | infrastructure: 2026-07-03 06:57:38.546166 | ubuntu-noble-large | cache: 2026-07-03 06:57:38.546174 | ubuntu-noble-large | backend: dogpile.cache.pymemcache 2026-07-03 06:57:38.546182 | ubuntu-noble-large | clusterRef: 2026-07-03 06:57:38.546190 | ubuntu-noble-large | name: openstack-memcached 2026-07-03 06:57:38.546198 | ubuntu-noble-large | replicas: 3 2026-07-03 06:57:38.546206 | ubuntu-noble-large | database: 2026-07-03 06:57:38.546214 | ubuntu-noble-large | clusterRef: 2026-07-03 06:57:38.546222 | ubuntu-noble-large | name: openstack-db 2026-07-03 06:57:38.546233 | ubuntu-noble-large | database: keystone 2026-07-03 06:57:38.546242 | ubuntu-noble-large | replicas: 3 2026-07-03 06:57:38.546250 | ubuntu-noble-large | secretRef: 2026-07-03 06:57:38.546257 | ubuntu-noble-large | name: keystone-db 2026-07-03 06:57:38.546265 | ubuntu-noble-large | korc: 2026-07-03 06:57:38.546273 | ubuntu-noble-large | adminCredential: 2026-07-03 06:57:38.546281 | ubuntu-noble-large | applicationCredential: 2026-07-03 06:57:38.546288 | ubuntu-noble-large | restricted: true 2026-07-03 06:57:38.546296 | ubuntu-noble-large | rotation: 2026-07-03 06:57:38.546304 | ubuntu-noble-large | mode: PasswordDriven 2026-07-03 06:57:38.546311 | ubuntu-noble-large | cloudCredentialsRef: 2026-07-03 06:57:38.546319 | ubuntu-noble-large | cloudName: admin 2026-07-03 06:57:38.546326 | ubuntu-noble-large | secretName: k-orc-clouds-yaml 2026-07-03 06:57:38.546342 | ubuntu-noble-large | passwordSecretRef: 2026-07-03 06:57:38.546350 | ubuntu-noble-large | key: password 2026-07-03 06:57:38.546358 | ubuntu-noble-large | name: keystone-admin 2026-07-03 06:57:38.546365 | ubuntu-noble-large | openStackRelease: "2025.2" 2026-07-03 06:57:38.546373 | ubuntu-noble-large | region: RegionOne 2026-07-03 06:57:38.546381 | ubuntu-noble-large | services: 2026-07-03 06:57:38.546389 | ubuntu-noble-large | keystone: 2026-07-03 06:57:38.546397 | ubuntu-noble-large | gateway: 2026-07-03 06:57:38.546404 | ubuntu-noble-large | hostname: keystone.127-0-0-1.nip.io 2026-07-03 06:57:38.546412 | ubuntu-noble-large | parentRef: 2026-07-03 06:57:38.546419 | ubuntu-noble-large | name: openstack-gw 2026-07-03 06:57:38.546427 | ubuntu-noble-large | path: / 2026-07-03 06:57:38.546434 | ubuntu-noble-large | publicEndpoint: https://keystone.127-0-0-1.nip.io:8443/v3 2026-07-03 06:57:38.546466 | ubuntu-noble-large | replicas: 1 2026-07-03 06:57:38.546474 | ubuntu-noble-large | status: 2026-07-03 06:57:38.546482 | ubuntu-noble-large | conditions: 2026-07-03 06:57:38.546490 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:41Z" 2026-07-03 06:57:38.546498 | ubuntu-noble-large | message: All managed backing services are ensured and ready 2026-07-03 06:57:38.546505 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546513 | ubuntu-noble-large | reason: InfrastructureReady 2026-07-03 06:57:38.546558 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:38.546570 | ubuntu-noble-large | type: InfrastructureReady 2026-07-03 06:57:38.546578 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:42:38Z" 2026-07-03 06:57:38.546585 | ubuntu-noble-large | message: One or more sub-conditions are not ready 2026-07-03 06:57:38.546593 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546600 | ubuntu-noble-large | reason: NotAllReady 2026-07-03 06:57:38.546608 | ubuntu-noble-large | status: "False" 2026-07-03 06:57:38.546616 | ubuntu-noble-large | type: Ready 2026-07-03 06:57:38.546623 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:38.546631 | ubuntu-noble-large | message: DB credential ExternalSecret is Ready 2026-07-03 06:57:38.546639 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546647 | ubuntu-noble-large | reason: DBCredentialsReady 2026-07-03 06:57:38.546654 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:38.546662 | ubuntu-noble-large | type: DBCredentialsReady 2026-07-03 06:57:38.546670 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:38.546685 | ubuntu-noble-large | message: admin password ExternalSecret is Ready 2026-07-03 06:57:38.546694 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546701 | ubuntu-noble-large | reason: AdminPasswordReady 2026-07-03 06:57:38.546709 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:38.546717 | ubuntu-noble-large | type: AdminPasswordReady 2026-07-03 06:57:38.546725 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:38.546733 | ubuntu-noble-large | message: Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:38.546740 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546748 | ubuntu-noble-large | reason: WaitingForKeystone 2026-07-03 06:57:38.546756 | ubuntu-noble-large | status: "False" 2026-07-03 06:57:38.546763 | ubuntu-noble-large | type: KeystoneReady 2026-07-03 06:57:38.546771 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:38.546779 | ubuntu-noble-large | services: 2026-07-03 06:57:38.546786 | ubuntu-noble-large | - name: keystone 2026-07-03 06:57:38.546794 | ubuntu-noble-large | ready: false 2026-07-03 06:57:38.546802 | ubuntu-noble-large | release: "2025.2" 2026-07-03 06:57:38.546810 | ubuntu-noble-large | updatePhase: Idle 2026-07-03 06:57:38.552386 | ubuntu-noble-large | === Diagnostics for kind cluster forge === 2026-07-03 06:57:38.682026 | ubuntu-noble-large | NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME 2026-07-03 06:57:38.682104 | ubuntu-noble-large | forge-control-plane Ready control-plane 18m v1.36.1 172.18.0.2 Debian GNU/Linux 13 (trixie) 6.8.0-134-generic (amd64) containerd://2.3.1 2026-07-03 06:57:38.863073 | ubuntu-noble-large | NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES 2026-07-03 06:57:38.863144 | ubuntu-noble-large | c5c3-system c5c3-operator-575bfd968-8cc5s 1/1 Running 0 16m 10.244.0.30 forge-control-plane 2026-07-03 06:57:38.863155 | ubuntu-noble-large | c5c3-system c5c3-operator-575bfd968-n42td 1/1 Running 0 16m 10.244.0.31 forge-control-plane 2026-07-03 06:57:38.863162 | ubuntu-noble-large | cert-manager cert-manager-c767877bd-l4mz4 1/1 Running 0 17m 10.244.0.14 forge-control-plane 2026-07-03 06:57:38.863168 | ubuntu-noble-large | cert-manager cert-manager-cainjector-78fdbbf665-h7fgq 1/1 Running 0 17m 10.244.0.13 forge-control-plane 2026-07-03 06:57:38.863174 | ubuntu-noble-large | cert-manager cert-manager-webhook-66986b64b9-dcnw7 1/1 Running 0 17m 10.244.0.12 forge-control-plane 2026-07-03 06:57:38.863184 | ubuntu-noble-large | envoy-gateway-system envoy-gateway-df8fc66ff-9zgzc 1/1 Running 0 17m 10.244.0.23 forge-control-plane 2026-07-03 06:57:38.863190 | ubuntu-noble-large | envoy-gateway-system envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 2/2 Running 0 16m 10.244.0.28 forge-control-plane 2026-07-03 06:57:38.863199 | ubuntu-noble-large | external-secrets external-secrets-5958b59f7d-h78sx 1/1 Running 0 17m 10.244.0.20 forge-control-plane 2026-07-03 06:57:38.863216 | ubuntu-noble-large | external-secrets external-secrets-cert-controller-97b69894c-lrgkp 1/1 Running 0 17m 10.244.0.21 forge-control-plane 2026-07-03 06:57:38.863249 | ubuntu-noble-large | external-secrets external-secrets-webhook-6955d84bd5-mkwpc 1/1 Running 0 17m 10.244.0.22 forge-control-plane 2026-07-03 06:57:38.863296 | ubuntu-noble-large | flux-system flux-operator-6d97c88bb-79d6s 1/1 Running 0 18m 10.244.0.5 forge-control-plane 2026-07-03 06:57:38.863322 | ubuntu-noble-large | flux-system flux-web-f67d8b54-6fxvg 1/1 Running 0 17m 10.244.0.10 forge-control-plane 2026-07-03 06:57:38.863331 | ubuntu-noble-large | flux-system helm-controller-5b8ccd78f5-xdmbg 1/1 Running 0 18m 10.244.0.6 forge-control-plane 2026-07-03 06:57:38.863418 | ubuntu-noble-large | flux-system kustomize-controller-6d4c587654-wtdqt 1/1 Running 0 18m 10.244.0.7 forge-control-plane 2026-07-03 06:57:38.863431 | ubuntu-noble-large | flux-system notification-controller-9655667cb-jgjf7 1/1 Running 0 18m 10.244.0.8 forge-control-plane 2026-07-03 06:57:38.863437 | ubuntu-noble-large | flux-system source-controller-7664869465-kl5cw 1/1 Running 0 18m 10.244.0.9 forge-control-plane 2026-07-03 06:57:38.863460 | ubuntu-noble-large | headlamp-system headlamp-796ff44f7b-gcx5n 1/1 Running 0 17m 10.244.0.11 forge-control-plane 2026-07-03 06:57:38.863515 | ubuntu-noble-large | keystone-system keystone-operator-66cf7cbc64-mtvhv 1/1 Running 0 16m 10.244.0.26 forge-control-plane 2026-07-03 06:57:38.863568 | ubuntu-noble-large | keystone-system keystone-operator-66cf7cbc64-w9xzs 1/1 Running 0 16m 10.244.0.27 forge-control-plane 2026-07-03 06:57:38.863608 | ubuntu-noble-large | kube-system coredns-589f44dc88-fc9wn 1/1 Running 0 18m 10.244.0.3 forge-control-plane 2026-07-03 06:57:38.863713 | ubuntu-noble-large | kube-system coredns-589f44dc88-sg5tn 1/1 Running 0 18m 10.244.0.4 forge-control-plane 2026-07-03 06:57:38.863724 | ubuntu-noble-large | kube-system etcd-forge-control-plane 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863744 | ubuntu-noble-large | kube-system kindnet-cxrgf 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863782 | ubuntu-noble-large | kube-system kube-apiserver-forge-control-plane 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863815 | ubuntu-noble-large | kube-system kube-controller-manager-forge-control-plane 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863859 | ubuntu-noble-large | kube-system kube-proxy-8xtkr 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863893 | ubuntu-noble-large | kube-system kube-scheduler-forge-control-plane 1/1 Running 0 18m 172.18.0.2 forge-control-plane 2026-07-03 06:57:38.863927 | ubuntu-noble-large | local-path-storage local-path-provisioner-855c7b7774-wmqvx 1/1 Running 0 18m 10.244.0.2 forge-control-plane 2026-07-03 06:57:38.863963 | ubuntu-noble-large | mariadb-system mariadb-operator-756fd78967-6wk5n 1/1 Running 0 17m 10.244.0.19 forge-control-plane 2026-07-03 06:57:38.864000 | ubuntu-noble-large | mariadb-system mariadb-operator-cert-controller-58b95fd98-jzgsb 1/1 Running 0 17m 10.244.0.18 forge-control-plane 2026-07-03 06:57:38.864025 | ubuntu-noble-large | mariadb-system mariadb-operator-webhook-67d6d5db7b-nmnnn 1/1 Running 0 17m 10.244.0.25 forge-control-plane 2026-07-03 06:57:38.864062 | ubuntu-noble-large | memcached-system memcached-operator-869dfff548-gt8xw 1/1 Running 0 17m 10.244.0.24 forge-control-plane 2026-07-03 06:57:38.864104 | ubuntu-noble-large | openbao-system openbao-0 1/1 Running 0 17m 10.244.0.29 forge-control-plane 2026-07-03 06:57:38.864133 | ubuntu-noble-large | openstack controlplane-keystone-6d68dcd67c-6l6p9 0/1 CrashLoopBackOff 7 (15s ago) 11m 10.244.0.47 forge-control-plane 2026-07-03 06:57:38.864173 | ubuntu-noble-large | openstack controlplane-keystone-db-sync-xt5jh 0/1 Completed 0 12m 10.244.0.45 forge-control-plane 2026-07-03 06:57:38.864208 | ubuntu-noble-large | openstack controlplane-keystone-schema-check-wg5rb 0/1 Completed 0 12m 10.244.0.46 forge-control-plane 2026-07-03 06:57:38.864249 | ubuntu-noble-large | openstack openstack-db-0 2/2 Running 0 14m 10.244.0.41 forge-control-plane 2026-07-03 06:57:38.864291 | ubuntu-noble-large | openstack openstack-db-1 2/2 Running 0 14m 10.244.0.43 forge-control-plane 2026-07-03 06:57:38.864319 | ubuntu-noble-large | openstack openstack-db-2 2/2 Running 0 14m 10.244.0.44 forge-control-plane 2026-07-03 06:57:38.864346 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-9ms7j 1/1 Running 0 15m 10.244.0.34 forge-control-plane 2026-07-03 06:57:38.864375 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-lq5jq 1/1 Running 0 15m 10.244.0.32 forge-control-plane 2026-07-03 06:57:38.864421 | ubuntu-noble-large | openstack openstack-memcached-f654cd846-nv658 1/1 Running 0 15m 10.244.0.33 forge-control-plane 2026-07-03 06:57:38.864476 | ubuntu-noble-large | orc-system orc-controller-manager-7bd5ff7754-4k6dc 1/1 Running 0 17m 10.244.0.15 forge-control-plane 2026-07-03 06:57:39.008610 | ubuntu-noble-large | apiVersion: v1 2026-07-03 06:57:39.008701 | ubuntu-noble-large | items: 2026-07-03 06:57:39.008715 | ubuntu-noble-large | - apiVersion: c5c3.io/v1alpha1 2026-07-03 06:57:39.008727 | ubuntu-noble-large | kind: ControlPlane 2026-07-03 06:57:39.008737 | ubuntu-noble-large | metadata: 2026-07-03 06:57:39.008748 | ubuntu-noble-large | annotations: 2026-07-03 06:57:39.008758 | ubuntu-noble-large | kubectl.kubernetes.io/last-applied-configuration: | 2026-07-03 06:57:39.008771 | ubuntu-noble-large | {"apiVersion":"c5c3.io/v1alpha1","kind":"ControlPlane","metadata":{"annotations":{},"name":"controlplane","namespace":"openstack"},"spec":{"openStackRelease":"2025.2","services":{"keystone":{"gateway":{"hostname":"keystone.127-0-0-1.nip.io","parentRef":{"name":"openstack-gw"},"path":"/"},"publicEndpoint":"https://keystone.127-0-0-1.nip.io:8443/v3","replicas":1}}}} 2026-07-03 06:57:39.008783 | ubuntu-noble-large | creationTimestamp: "2026-07-03T06:42:38Z" 2026-07-03 06:57:39.008794 | ubuntu-noble-large | finalizers: 2026-07-03 06:57:39.008804 | ubuntu-noble-large | - c5c3.io/orc-teardown 2026-07-03 06:57:39.008814 | ubuntu-noble-large | generation: 1 2026-07-03 06:57:39.008823 | ubuntu-noble-large | name: controlplane 2026-07-03 06:57:39.008833 | ubuntu-noble-large | namespace: openstack 2026-07-03 06:57:39.008843 | ubuntu-noble-large | resourceVersion: "4499" 2026-07-03 06:57:39.008853 | ubuntu-noble-large | uid: 00163cad-e901-4632-9112-5df1e1c7a80d 2026-07-03 06:57:39.008862 | ubuntu-noble-large | spec: 2026-07-03 06:57:39.008872 | ubuntu-noble-large | infrastructure: 2026-07-03 06:57:39.008909 | ubuntu-noble-large | cache: 2026-07-03 06:57:39.008919 | ubuntu-noble-large | backend: dogpile.cache.pymemcache 2026-07-03 06:57:39.008929 | ubuntu-noble-large | clusterRef: 2026-07-03 06:57:39.008939 | ubuntu-noble-large | name: openstack-memcached 2026-07-03 06:57:39.008949 | ubuntu-noble-large | replicas: 3 2026-07-03 06:57:39.008958 | ubuntu-noble-large | database: 2026-07-03 06:57:39.008968 | ubuntu-noble-large | clusterRef: 2026-07-03 06:57:39.008978 | ubuntu-noble-large | name: openstack-db 2026-07-03 06:57:39.008987 | ubuntu-noble-large | database: keystone 2026-07-03 06:57:39.008997 | ubuntu-noble-large | replicas: 3 2026-07-03 06:57:39.009007 | ubuntu-noble-large | secretRef: 2026-07-03 06:57:39.009016 | ubuntu-noble-large | name: keystone-db 2026-07-03 06:57:39.009026 | ubuntu-noble-large | korc: 2026-07-03 06:57:39.009036 | ubuntu-noble-large | adminCredential: 2026-07-03 06:57:39.009046 | ubuntu-noble-large | applicationCredential: 2026-07-03 06:57:39.009055 | ubuntu-noble-large | restricted: true 2026-07-03 06:57:39.009065 | ubuntu-noble-large | rotation: 2026-07-03 06:57:39.009075 | ubuntu-noble-large | mode: PasswordDriven 2026-07-03 06:57:39.009085 | ubuntu-noble-large | cloudCredentialsRef: 2026-07-03 06:57:39.009095 | ubuntu-noble-large | cloudName: admin 2026-07-03 06:57:39.009104 | ubuntu-noble-large | secretName: k-orc-clouds-yaml 2026-07-03 06:57:39.009114 | ubuntu-noble-large | passwordSecretRef: 2026-07-03 06:57:39.009124 | ubuntu-noble-large | key: password 2026-07-03 06:57:39.009134 | ubuntu-noble-large | name: keystone-admin 2026-07-03 06:57:39.009143 | ubuntu-noble-large | openStackRelease: "2025.2" 2026-07-03 06:57:39.009153 | ubuntu-noble-large | region: RegionOne 2026-07-03 06:57:39.009163 | ubuntu-noble-large | services: 2026-07-03 06:57:39.009172 | ubuntu-noble-large | keystone: 2026-07-03 06:57:39.009182 | ubuntu-noble-large | gateway: 2026-07-03 06:57:39.009192 | ubuntu-noble-large | hostname: keystone.127-0-0-1.nip.io 2026-07-03 06:57:39.009201 | ubuntu-noble-large | parentRef: 2026-07-03 06:57:39.009211 | ubuntu-noble-large | name: openstack-gw 2026-07-03 06:57:39.009221 | ubuntu-noble-large | path: / 2026-07-03 06:57:39.009231 | ubuntu-noble-large | publicEndpoint: https://keystone.127-0-0-1.nip.io:8443/v3 2026-07-03 06:57:39.009241 | ubuntu-noble-large | replicas: 1 2026-07-03 06:57:39.009250 | ubuntu-noble-large | status: 2026-07-03 06:57:39.009260 | ubuntu-noble-large | conditions: 2026-07-03 06:57:39.009270 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:41Z" 2026-07-03 06:57:39.011344 | ubuntu-noble-large | message: All managed backing services are ensured and ready 2026-07-03 06:57:39.011412 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011425 | ubuntu-noble-large | reason: InfrastructureReady 2026-07-03 06:57:39.011434 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:39.011485 | ubuntu-noble-large | type: InfrastructureReady 2026-07-03 06:57:39.011496 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:42:38Z" 2026-07-03 06:57:39.011506 | ubuntu-noble-large | message: One or more sub-conditions are not ready 2026-07-03 06:57:39.011516 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011557 | ubuntu-noble-large | reason: NotAllReady 2026-07-03 06:57:39.011567 | ubuntu-noble-large | status: "False" 2026-07-03 06:57:39.011576 | ubuntu-noble-large | type: Ready 2026-07-03 06:57:39.011586 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:39.011596 | ubuntu-noble-large | message: DB credential ExternalSecret is Ready 2026-07-03 06:57:39.011605 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011615 | ubuntu-noble-large | reason: DBCredentialsReady 2026-07-03 06:57:39.011625 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:39.011634 | ubuntu-noble-large | type: DBCredentialsReady 2026-07-03 06:57:39.011644 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:39.011653 | ubuntu-noble-large | message: admin password ExternalSecret is Ready 2026-07-03 06:57:39.011663 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011672 | ubuntu-noble-large | reason: AdminPasswordReady 2026-07-03 06:57:39.011682 | ubuntu-noble-large | status: "True" 2026-07-03 06:57:39.011691 | ubuntu-noble-large | type: AdminPasswordReady 2026-07-03 06:57:39.011701 | ubuntu-noble-large | - lastTransitionTime: "2026-07-03T06:44:42Z" 2026-07-03 06:57:39.011711 | ubuntu-noble-large | message: Keystone "controlplane-keystone" is not ready 2026-07-03 06:57:39.011720 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011730 | ubuntu-noble-large | reason: WaitingForKeystone 2026-07-03 06:57:39.011739 | ubuntu-noble-large | status: "False" 2026-07-03 06:57:39.011749 | ubuntu-noble-large | type: KeystoneReady 2026-07-03 06:57:39.011758 | ubuntu-noble-large | observedGeneration: 1 2026-07-03 06:57:39.011768 | ubuntu-noble-large | services: 2026-07-03 06:57:39.011804 | ubuntu-noble-large | - name: keystone 2026-07-03 06:57:39.011814 | ubuntu-noble-large | ready: false 2026-07-03 06:57:39.011824 | ubuntu-noble-large | release: "2025.2" 2026-07-03 06:57:39.011834 | ubuntu-noble-large | updatePhase: Idle 2026-07-03 06:57:39.011843 | ubuntu-noble-large | kind: List 2026-07-03 06:57:39.011853 | ubuntu-noble-large | metadata: 2026-07-03 06:57:39.011863 | ubuntu-noble-large | resourceVersion: "" 2026-07-03 06:57:39.301039 | ubuntu-noble-large | NAMESPACE LAST SEEN TYPE REASON OBJECT MESSAGE 2026-07-03 06:57:39.301132 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-07-03 06:57:39.301167 | ubuntu-noble-large | openstack 15m Normal Created memcached/openstack-memcached Created Deployment openstack-memcached 2026-07-03 06:57:39.301182 | ubuntu-noble-large | openstack 15m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-07-03 06:57:39.301197 | ubuntu-noble-large | default 18m Normal Starting node/forge-control-plane 2026-07-03 06:57:39.301213 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-07-03 06:57:39.301226 | ubuntu-noble-large | openstack 14m Normal Updated memcached/openstack-memcached Updated Deployment openstack-memcached 2026-07-03 06:57:39.301241 | ubuntu-noble-large | default 19m Normal NodeHasSufficientPID node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientPID 2026-07-03 06:57:39.301252 | ubuntu-noble-large | default 19m Normal NodeAllocatableEnforced node/forge-control-plane Updated Node Allocatable limit across pods 2026-07-03 06:57:39.301260 | ubuntu-noble-large | default 19m Normal NodeHasNoDiskPressure node/forge-control-plane Node forge-control-plane status is now: NodeHasNoDiskPressure 2026-07-03 06:57:39.301277 | ubuntu-noble-large | default 19m Normal NodeHasSufficientMemory node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientMemory 2026-07-03 06:57:39.301286 | ubuntu-noble-large | default 19m Normal Starting node/forge-control-plane Starting kubelet. 2026-07-03 06:57:39.301329 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/kube-apiserver-forge-control-plane Container image "registry.k8s.io/kube-apiserver:v1.36.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301359 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/etcd-forge-control-plane Container image "registry.k8s.io/etcd:3.6.8-0" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301368 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/kube-scheduler-forge-control-plane Container image "registry.k8s.io/kube-scheduler:v1.36.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301378 | ubuntu-noble-large | kube-system 19m Normal Pulled pod/kube-controller-manager-forge-control-plane Container image "registry.k8s.io/kube-controller-manager:v1.36.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301395 | ubuntu-noble-large | kube-system 18m Normal Started pod/kube-scheduler-forge-control-plane Container started 2026-07-03 06:57:39.301487 | ubuntu-noble-large | kube-system 18m Normal Started pod/etcd-forge-control-plane Container started 2026-07-03 06:57:39.301497 | ubuntu-noble-large | kube-system 18m Normal Created pod/kube-apiserver-forge-control-plane Container created 2026-07-03 06:57:39.301505 | ubuntu-noble-large | kube-system 18m Normal Started pod/kube-apiserver-forge-control-plane Container started 2026-07-03 06:57:39.301513 | ubuntu-noble-large | kube-system 18m Normal Created pod/kube-controller-manager-forge-control-plane Container created 2026-07-03 06:57:39.301600 | ubuntu-noble-large | kube-system 18m Normal Started pod/kube-controller-manager-forge-control-plane Container started 2026-07-03 06:57:39.301609 | ubuntu-noble-large | kube-system 18m Normal Created pod/kube-scheduler-forge-control-plane Container created 2026-07-03 06:57:39.301617 | ubuntu-noble-large | kube-system 18m Normal Created pod/etcd-forge-control-plane Container created 2026-07-03 06:57:39.301625 | ubuntu-noble-large | default 18m Normal NodeHasSufficientMemory node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientMemory 2026-07-03 06:57:39.301633 | ubuntu-noble-large | default 18m Normal NodeHasNoDiskPressure node/forge-control-plane Node forge-control-plane status is now: NodeHasNoDiskPressure 2026-07-03 06:57:39.301640 | ubuntu-noble-large | default 18m Normal NodeAllocatableEnforced node/forge-control-plane Updated Node Allocatable limit across pods 2026-07-03 06:57:39.301648 | ubuntu-noble-large | default 18m Normal Starting node/forge-control-plane Starting kubelet. 2026-07-03 06:57:39.301656 | ubuntu-noble-large | default 18m Normal NodeHasSufficientPID node/forge-control-plane Node forge-control-plane status is now: NodeHasSufficientPID 2026-07-03 06:57:39.301664 | ubuntu-noble-large | kube-system 18m Normal LeaderElection lease/kube-controller-manager forge-control-plane_844fa3d9-ba55-4ff4-9890-3698463fe4fc became leader 2026-07-03 06:57:39.301676 | ubuntu-noble-large | kube-system 18m Normal LeaderElection lease/kube-scheduler forge-control-plane_bcff475b-210f-4ea3-9281-fb8fc89777a9 became leader 2026-07-03 06:57:39.301684 | ubuntu-noble-large | default 18m Normal RegisteredNode node/forge-control-plane Node forge-control-plane event: Registered Node forge-control-plane in Controller 2026-07-03 06:57:39.301692 | ubuntu-noble-large | kube-system 18m Normal ScalingReplicaSet deployment/coredns Scaled up replica set coredns-589f44dc88 from 0 to 2 2026-07-03 06:57:39.301700 | ubuntu-noble-large | local-path-storage 18m Normal ScalingReplicaSet deployment/local-path-provisioner Scaled up replica set local-path-provisioner-855c7b7774 from 0 to 1 2026-07-03 06:57:39.301714 | ubuntu-noble-large | local-path-storage 18m Warning FailedScheduling pod/local-path-provisioner-855c7b7774-wmqvx 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-07-03 06:57:39.301729 | ubuntu-noble-large | kube-system 18m Normal SuccessfulCreate daemonset/kube-proxy Created pod: kube-proxy-8xtkr 2026-07-03 06:57:39.301773 | ubuntu-noble-large | kube-system 18m Normal SuccessfulCreate replicaset/coredns-589f44dc88 Created pod: coredns-589f44dc88-fc9wn 2026-07-03 06:57:39.301791 | ubuntu-noble-large | kube-system 18m Normal SuccessfulCreate replicaset/coredns-589f44dc88 Created pod: coredns-589f44dc88-sg5tn 2026-07-03 06:57:39.301804 | ubuntu-noble-large | kube-system 18m Normal SuccessfulCreate daemonset/kindnet Created pod: kindnet-cxrgf 2026-07-03 06:57:39.301816 | ubuntu-noble-large | kube-system 18m Normal Scheduled pod/kindnet-cxrgf Successfully assigned kube-system/kindnet-cxrgf to forge-control-plane 2026-07-03 06:57:39.301828 | ubuntu-noble-large | kube-system 18m Warning FailedScheduling pod/coredns-589f44dc88-sg5tn 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-07-03 06:57:39.301840 | ubuntu-noble-large | local-path-storage 18m Normal SuccessfulCreate replicaset/local-path-provisioner-855c7b7774 Created pod: local-path-provisioner-855c7b7774-wmqvx 2026-07-03 06:57:39.301852 | ubuntu-noble-large | kube-system 18m Warning FailedScheduling pod/coredns-589f44dc88-fc9wn 0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling. 2026-07-03 06:57:39.301865 | ubuntu-noble-large | kube-system 18m Normal Pulled pod/kube-proxy-8xtkr Container image "registry.k8s.io/kube-proxy:v1.36.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301878 | ubuntu-noble-large | kube-system 18m Normal Scheduled pod/kube-proxy-8xtkr Successfully assigned kube-system/kube-proxy-8xtkr to forge-control-plane 2026-07-03 06:57:39.301902 | ubuntu-noble-large | kube-system 18m Normal Pulled pod/kindnet-cxrgf Container image "docker.io/kindest/kindnetd:v20260528-9350166c" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.301917 | ubuntu-noble-large | kube-system 18m Normal Created pod/kube-proxy-8xtkr Container created 2026-07-03 06:57:39.301930 | ubuntu-noble-large | kube-system 18m Normal Started pod/kube-proxy-8xtkr Container started 2026-07-03 06:57:39.301943 | ubuntu-noble-large | kube-system 18m Normal Created pod/kindnet-cxrgf Container created 2026-07-03 06:57:39.301955 | ubuntu-noble-large | kube-system 18m Normal Started pod/kindnet-cxrgf Container started 2026-07-03 06:57:39.301963 | ubuntu-noble-large | kube-system 18m Normal Scheduled pod/coredns-589f44dc88-fc9wn Successfully assigned kube-system/coredns-589f44dc88-fc9wn to forge-control-plane 2026-07-03 06:57:39.301970 | ubuntu-noble-large | default 18m Normal NodeReady node/forge-control-plane Node forge-control-plane status is now: NodeReady 2026-07-03 06:57:39.301978 | ubuntu-noble-large | kube-system 18m Normal Scheduled pod/coredns-589f44dc88-sg5tn Successfully assigned kube-system/coredns-589f44dc88-sg5tn to forge-control-plane 2026-07-03 06:57:39.301994 | ubuntu-noble-large | local-path-storage 18m Normal Scheduled pod/local-path-provisioner-855c7b7774-wmqvx Successfully assigned local-path-storage/local-path-provisioner-855c7b7774-wmqvx to forge-control-plane 2026-07-03 06:57:39.302002 | ubuntu-noble-large | kube-system 18m Normal Pulled pod/coredns-589f44dc88-sg5tn Container image "registry.k8s.io/coredns/coredns:v1.14.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.302017 | ubuntu-noble-large | local-path-storage 18m Normal Pulled pod/local-path-provisioner-855c7b7774-wmqvx Container image "docker.io/kindest/local-path-provisioner:v20260521-9fb22683" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.302026 | ubuntu-noble-large | kube-system 18m Normal Pulled pod/coredns-589f44dc88-fc9wn Container image "registry.k8s.io/coredns/coredns:v1.14.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.302034 | ubuntu-noble-large | flux-system 18m Normal ScalingReplicaSet deployment/flux-operator Scaled up replica set flux-operator-6d97c88bb from 0 to 1 2026-07-03 06:57:39.302042 | ubuntu-noble-large | local-path-storage 18m Normal Created pod/local-path-provisioner-855c7b7774-wmqvx Container created 2026-07-03 06:57:39.302050 | ubuntu-noble-large | local-path-storage 18m Normal Started pod/local-path-provisioner-855c7b7774-wmqvx Container started 2026-07-03 06:57:39.302058 | ubuntu-noble-large | kube-system 18m Normal Created pod/coredns-589f44dc88-fc9wn Container created 2026-07-03 06:57:39.302071 | ubuntu-noble-large | kube-system 18m Warning Unhealthy pod/coredns-589f44dc88-sg5tn Readiness probe failed: Get "http://10.244.0.4:8181/ready": dial tcp 10.244.0.4:8181: connect: connection refused 2026-07-03 06:57:39.302079 | ubuntu-noble-large | kube-system 18m Normal Started pod/coredns-589f44dc88-fc9wn Container started 2026-07-03 06:57:39.302087 | ubuntu-noble-large | kube-system 18m Normal Started pod/coredns-589f44dc88-sg5tn Container started 2026-07-03 06:57:39.302095 | ubuntu-noble-large | kube-system 18m Normal Created pod/coredns-589f44dc88-sg5tn Container created 2026-07-03 06:57:39.302102 | ubuntu-noble-large | flux-system 18m Normal SuccessfulCreate replicaset/flux-operator-6d97c88bb Created pod: flux-operator-6d97c88bb-79d6s 2026-07-03 06:57:39.302110 | ubuntu-noble-large | flux-system 18m Normal Pulling pod/flux-operator-6d97c88bb-79d6s Pulling image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" 2026-07-03 06:57:39.302119 | ubuntu-noble-large | flux-system 18m Normal Scheduled pod/flux-operator-6d97c88bb-79d6s Successfully assigned flux-system/flux-operator-6d97c88bb-79d6s to forge-control-plane 2026-07-03 06:57:39.302134 | ubuntu-noble-large | kube-system 18m Warning Unhealthy pod/coredns-589f44dc88-fc9wn Readiness probe failed: Get "http://10.244.0.3:8181/ready": dial tcp 10.244.0.3:8181: connect: connection refused 2026-07-03 06:57:39.302157 | ubuntu-noble-large | flux-system 18m Normal Started pod/flux-operator-6d97c88bb-79d6s Container started 2026-07-03 06:57:39.302171 | ubuntu-noble-large | flux-system 18m Normal Created pod/flux-operator-6d97c88bb-79d6s Container created 2026-07-03 06:57:39.302194 | ubuntu-noble-large | flux-system 18m Normal Pulled pod/flux-operator-6d97c88bb-79d6s Successfully pulled image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" in 3.585s (3.585s including waiting). Image size: 28865342 bytes. 2026-07-03 06:57:39.302207 | ubuntu-noble-large | flux-system 18m Normal LeaderElection lease/flux-operator flux-operator-6d97c88bb-79d6s_f7307633-ca99-4caa-93f4-e06e7152c49f became leader 2026-07-03 06:57:39.302221 | ubuntu-noble-large | flux-system 18m Normal Progressing fluxinstance/flux Installing revision v2.8.8@sha256:f9561cf88335caa347a61eed1c7fdcdcaf21e0b143cead9002c3ca5c644e0ad9 2026-07-03 06:57:39.302234 | ubuntu-noble-large | flux-system 18m Normal Scheduled pod/kustomize-controller-6d4c587654-wtdqt Successfully assigned flux-system/kustomize-controller-6d4c587654-wtdqt to forge-control-plane 2026-07-03 06:57:39.302255 | ubuntu-noble-large | flux-system 18m Normal SuccessfulCreate replicaset/notification-controller-9655667cb Created pod: notification-controller-9655667cb-jgjf7 2026-07-03 06:57:39.302269 | ubuntu-noble-large | flux-system 18m Normal Scheduled pod/helm-controller-5b8ccd78f5-xdmbg Successfully assigned flux-system/helm-controller-5b8ccd78f5-xdmbg to forge-control-plane 2026-07-03 06:57:39.302281 | ubuntu-noble-large | flux-system 18m Normal Scheduled pod/notification-controller-9655667cb-jgjf7 Successfully assigned flux-system/notification-controller-9655667cb-jgjf7 to forge-control-plane 2026-07-03 06:57:39.302294 | ubuntu-noble-large | flux-system 18m Normal ScalingReplicaSet deployment/source-controller Scaled up replica set source-controller-7664869465 from 0 to 1 2026-07-03 06:57:39.302308 | ubuntu-noble-large | flux-system 18m Normal ScalingReplicaSet deployment/kustomize-controller Scaled up replica set kustomize-controller-6d4c587654 from 0 to 1 2026-07-03 06:57:39.302322 | ubuntu-noble-large | flux-system 18m Normal SuccessfulCreate replicaset/source-controller-7664869465 Created pod: source-controller-7664869465-kl5cw 2026-07-03 06:57:39.302335 | ubuntu-noble-large | flux-system 18m Normal SuccessfulCreate replicaset/kustomize-controller-6d4c587654 Created pod: kustomize-controller-6d4c587654-wtdqt 2026-07-03 06:57:39.302358 | ubuntu-noble-large | flux-system 18m Normal ScalingReplicaSet deployment/helm-controller Scaled up replica set helm-controller-5b8ccd78f5 from 0 to 1 2026-07-03 06:57:39.302373 | ubuntu-noble-large | flux-system 18m Normal ScalingReplicaSet deployment/notification-controller Scaled up replica set notification-controller-9655667cb from 0 to 1 2026-07-03 06:57:39.302385 | ubuntu-noble-large | flux-system 18m Normal SuccessfulCreate replicaset/helm-controller-5b8ccd78f5 Created pod: helm-controller-5b8ccd78f5-xdmbg 2026-07-03 06:57:39.302399 | ubuntu-noble-large | flux-system 18m Normal Scheduled pod/source-controller-7664869465-kl5cw Successfully assigned flux-system/source-controller-7664869465-kl5cw to forge-control-plane 2026-07-03 06:57:39.302407 | ubuntu-noble-large | flux-system 18m Normal Pulling pod/source-controller-7664869465-kl5cw Pulling image "ghcr.io/fluxcd/source-controller:v1.8.5@sha256:65172e2405cf95b92c4b00cefd28d5e8ffd1f81d6d097f85c6e83a9c557c9def" 2026-07-03 06:57:39.302416 | ubuntu-noble-large | flux-system 18m Normal Pulling pod/notification-controller-9655667cb-jgjf7 Pulling image "ghcr.io/fluxcd/notification-controller:v1.8.4@sha256:75842ecfcca4397a788051d6b00ec34f96ea74788c92d9c360fc4d196ea04551" 2026-07-03 06:57:39.302432 | ubuntu-noble-large | flux-system 18m Normal Pulling pod/kustomize-controller-6d4c587654-wtdqt Pulling image "ghcr.io/fluxcd/kustomize-controller:v1.8.5@sha256:70e2a25edeee82690e68662409fb1b60f7d3084c93435e8ab5337a6e0244ffed" 2026-07-03 06:57:39.302464 | ubuntu-noble-large | flux-system 18m Normal Pulling pod/helm-controller-5b8ccd78f5-xdmbg Pulling image "ghcr.io/fluxcd/helm-controller:v1.5.5@sha256:b4b8f7715cc7cb61382eeb82bea108d1bdd965b00e7192c5dc9ab7436a33658b" 2026-07-03 06:57:39.302475 | ubuntu-noble-large | flux-system 18m Warning Unhealthy pod/helm-controller-5b8ccd78f5-xdmbg Readiness probe failed: Get "http://10.244.0.6:9440/readyz": dial tcp 10.244.0.6:9440: connect: connection refused 2026-07-03 06:57:39.302483 | ubuntu-noble-large | flux-system 18m Normal Started pod/helm-controller-5b8ccd78f5-xdmbg Container started 2026-07-03 06:57:39.302491 | ubuntu-noble-large | flux-system 18m Normal Created pod/helm-controller-5b8ccd78f5-xdmbg Container created 2026-07-03 06:57:39.302506 | ubuntu-noble-large | flux-system 18m Normal Pulled pod/helm-controller-5b8ccd78f5-xdmbg Successfully pulled image "ghcr.io/fluxcd/helm-controller:v1.5.5@sha256:b4b8f7715cc7cb61382eeb82bea108d1bdd965b00e7192c5dc9ab7436a33658b" in 3.665s (3.665s including waiting). Image size: 51275265 bytes. 2026-07-03 06:57:39.302515 | ubuntu-noble-large | flux-system 18m Normal LeaderElection lease/helm-controller-leader-election helm-controller-5b8ccd78f5-xdmbg_6e8ccbae-bfbe-42fd-80a0-e683d073db60 became leader 2026-07-03 06:57:39.302555 | ubuntu-noble-large | flux-system 18m Normal Started pod/kustomize-controller-6d4c587654-wtdqt Container started 2026-07-03 06:57:39.302563 | ubuntu-noble-large | flux-system 18m Normal Pulled pod/kustomize-controller-6d4c587654-wtdqt Successfully pulled image "ghcr.io/fluxcd/kustomize-controller:v1.8.5@sha256:70e2a25edeee82690e68662409fb1b60f7d3084c93435e8ab5337a6e0244ffed" in 4.269s (7.841s including waiting). Image size: 68335774 bytes. 2026-07-03 06:57:39.302571 | ubuntu-noble-large | flux-system 18m Normal Created pod/kustomize-controller-6d4c587654-wtdqt Container created 2026-07-03 06:57:39.302585 | ubuntu-noble-large | flux-system 18m Warning Unhealthy pod/kustomize-controller-6d4c587654-wtdqt Readiness probe failed: Get "http://10.244.0.7:9440/readyz": dial tcp 10.244.0.7:9440: connect: connection refused 2026-07-03 06:57:39.302593 | ubuntu-noble-large | flux-system 18m Normal LeaderElection lease/kustomize-controller-leader-election kustomize-controller-6d4c587654-wtdqt_d5ab1732-8dfb-448e-8de9-8ac2886d180a became leader 2026-07-03 06:57:39.302601 | ubuntu-noble-large | flux-system 18m Normal Created pod/notification-controller-9655667cb-jgjf7 Container created 2026-07-03 06:57:39.302609 | ubuntu-noble-large | flux-system 18m Normal Started pod/notification-controller-9655667cb-jgjf7 Container started 2026-07-03 06:57:39.302618 | ubuntu-noble-large | flux-system 18m Normal Pulled pod/notification-controller-9655667cb-jgjf7 Successfully pulled image "ghcr.io/fluxcd/notification-controller:v1.8.4@sha256:75842ecfcca4397a788051d6b00ec34f96ea74788c92d9c360fc4d196ea04551" in 4.036s (11.834s including waiting). Image size: 49859918 bytes. 2026-07-03 06:57:39.302632 | ubuntu-noble-large | flux-system 18m Normal LeaderElection lease/notification-controller-leader-election notification-controller-9655667cb-jgjf7_631e90f2-bbf4-495f-862a-8f3a7ac476dd became leader 2026-07-03 06:57:39.302640 | ubuntu-noble-large | flux-system 18m Warning Unhealthy pod/notification-controller-9655667cb-jgjf7 Readiness probe failed: Get "http://10.244.0.8:9440/readyz": dial tcp 10.244.0.8:9440: connect: connection refused 2026-07-03 06:57:39.302648 | ubuntu-noble-large | flux-system 18m Normal Created pod/source-controller-7664869465-kl5cw Container created 2026-07-03 06:57:39.302656 | ubuntu-noble-large | flux-system 18m Normal Pulled pod/source-controller-7664869465-kl5cw Successfully pulled image "ghcr.io/fluxcd/source-controller:v1.8.5@sha256:65172e2405cf95b92c4b00cefd28d5e8ffd1f81d6d097f85c6e83a9c557c9def" in 4.51s (16.34s including waiting). Image size: 63986975 bytes. 2026-07-03 06:57:39.302664 | ubuntu-noble-large | flux-system 18m Normal LeaderElection lease/source-controller-leader-election source-controller-7664869465-kl5cw_c52e5bcd-3d2c-4b59-9cda-0b3b10f4ead1 became leader 2026-07-03 06:57:39.302672 | ubuntu-noble-large | flux-system 18m Warning Unhealthy pod/source-controller-7664869465-kl5cw Readiness probe failed: Get "http://10.244.0.9:9090/": dial tcp 10.244.0.9:9090: connect: connection refused 2026-07-03 06:57:39.302680 | ubuntu-noble-large | flux-system 18m Normal Started pod/source-controller-7664869465-kl5cw Container started 2026-07-03 06:57:39.302688 | ubuntu-noble-large | flux-system 18m Normal ReconciliationSucceeded fluxinstance/flux Reconciliation finished in 22s 2026-07-03 06:57:39.302702 | ubuntu-noble-large | flux-system 18m Normal ReconciliationSucceeded fluxinstance/flux Flux v2.8.8 installed... 2026-07-03 06:57:39.302710 | ubuntu-noble-large | mariadb-system 17m Normal HelmChartCreated helmrelease/mariadb-operator Created HelmChart/flux-system/mariadb-system-mariadb-operator with SourceRef 'HelmRepository/flux-system/mariadb-operator' 2026-07-03 06:57:39.302718 | ubuntu-noble-large | flux-system 17m Normal ReconciliationSucceeded resourceset/flux-web Reconciliation finished in 71ms 2026-07-03 06:57:39.302725 | ubuntu-noble-large | cert-manager 17m Normal HelmChartCreated helmrelease/cert-manager Created HelmChart/flux-system/cert-manager-cert-manager with SourceRef 'HelmRepository/flux-system/cert-manager' 2026-07-03 06:57:39.302734 | ubuntu-noble-large | mariadb-system 17m Normal HelmChartCreated helmrelease/mariadb-operator-crds Created HelmChart/flux-system/mariadb-system-mariadb-operator-crds with SourceRef 'HelmRepository/flux-system/mariadb-operator' 2026-07-03 06:57:39.302742 | ubuntu-noble-large | keystone-system 17m Normal HelmChartCreated helmrelease/keystone-operator Created HelmChart/flux-system/keystone-system-keystone-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-07-03 06:57:39.302750 | ubuntu-noble-large | external-secrets 17m Normal HelmChartCreated helmrelease/external-secrets Created HelmChart/flux-system/external-secrets-external-secrets with SourceRef 'HelmRepository/flux-system/external-secrets' 2026-07-03 06:57:39.302763 | ubuntu-noble-large | envoy-gateway-system 17m Normal HelmChartCreated helmrelease/envoy-gateway Created HelmChart/flux-system/envoy-gateway-system-envoy-gateway with SourceRef 'HelmRepository/flux-system/envoy-gateway-charts' 2026-07-03 06:57:39.302778 | ubuntu-noble-large | memcached-system 17m Normal HelmChartCreated helmrelease/memcached-operator Created HelmChart/flux-system/memcached-system-memcached-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-07-03 06:57:39.302786 | ubuntu-noble-large | c5c3-system 17m Normal HelmChartCreated helmrelease/c5c3-operator Created HelmChart/flux-system/c5c3-system-c5c3-operator with SourceRef 'HelmRepository/flux-system/c5c3-charts' 2026-07-03 06:57:39.302794 | ubuntu-noble-large | headlamp-system 17m Normal HelmChartCreated helmrelease/headlamp Created HelmChart/flux-system/headlamp-system-headlamp with SourceRef 'HelmRepository/flux-system/headlamp' 2026-07-03 06:57:39.302802 | ubuntu-noble-large | openbao-system 17m Normal HelmChartCreated helmrelease/openbao Created HelmChart/flux-system/openbao-system-openbao with SourceRef 'HelmRepository/flux-system/openbao' 2026-07-03 06:57:39.302810 | ubuntu-noble-large | flux-system 17m Normal ApplySucceeded resourceset/flux-web HelmRelease/flux-system/flux-web created... 2026-07-03 06:57:39.302818 | ubuntu-noble-large | monitoring 17m Normal HelmChartCreated helmrelease/prometheus-operator-crds Created HelmChart/flux-system/monitoring-prometheus-operator-crds with SourceRef 'HelmRepository/flux-system/prometheus-community' 2026-07-03 06:57:39.302826 | ubuntu-noble-large | flux-system 17m Normal NewArtifact helmrepository/external-secrets stored fetched index of size 143.9kB from 'https://charts.external-secrets.io' 2026-07-03 06:57:39.302834 | ubuntu-noble-large | flux-system 17m Normal NewArtifact helmrepository/headlamp stored fetched index of size 98.89kB from 'https://kubernetes-sigs.github.io/headlamp/' 2026-07-03 06:57:39.302842 | ubuntu-noble-large | flux-system 17m Normal NewArtifact helmrepository/openbao stored fetched index of size 93.63kB from 'https://openbao.github.io/openbao-helm' 2026-07-03 06:57:39.302858 | ubuntu-noble-large | flux-system 17m Normal NewArtifact helmrepository/cert-manager stored fetched index of size 573.3kB from 'https://charts.jetstack.io' 2026-07-03 06:57:39.302867 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/cert-manager-cert-manager pulled 'cert-manager' chart with version 'v1.20.3' 2026-07-03 06:57:39.302875 | ubuntu-noble-large | flux-system 17m Normal NewArtifact ocirepository/flux-web stored artifact with revision '0.52.0@sha256:e25cf78b888fb82afadcb0c06bbb3dce8c5c5d0313e304ce67b6a7744977e458' from 'oci://ghcr.io/controlplaneio-fluxcd/charts/flux-operator' 2026-07-03 06:57:39.302883 | ubuntu-noble-large | flux-system 17m Normal ArtifactUpToDate helmrepository/external-secrets artifact up-to-date with remote revision: 'sha256:172e4dbf6ac03ea2cf1cfd3d835f31c56dadd9698185fd667744845938cc055a' 2026-07-03 06:57:39.302891 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/keystone-system-keystone-operator pulled 'keystone-operator' chart with version '0.5.0' 2026-07-03 06:57:39.302899 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/external-secrets-external-secrets pulled 'external-secrets' chart with version '0.20.4' 2026-07-03 06:57:39.302911 | ubuntu-noble-large | flux-system 17m Normal ArtifactUpToDate helmrepository/mariadb-operator artifact up-to-date with remote revision: 'sha256:7f48d1a62b45a948ed6f710145ee3f36da382fa5cfab9a48aad0917244bf94c8' 2026-07-03 06:57:39.302930 | ubuntu-noble-large | flux-system 17m Normal NewArtifact helmrepository/mariadb-operator stored fetched index of size 105.7kB from 'https://mariadb-operator.github.io/mariadb-operator' 2026-07-03 06:57:39.302938 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/c5c3-system-c5c3-operator pulled 'c5c3-operator' chart with version '0.3.0' 2026-07-03 06:57:39.302946 | ubuntu-noble-large | flux-system 17m Normal Pulled pod/flux-web-f67d8b54-6fxvg Container image "ghcr.io/controlplaneio-fluxcd/flux-operator:v0.52.0" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.302954 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/headlamp-system-headlamp pulled 'headlamp' chart with version '0.43.0' 2026-07-03 06:57:39.302966 | ubuntu-noble-large | flux-system 17m Normal Started pod/flux-web-f67d8b54-6fxvg Container started 2026-07-03 06:57:39.302974 | ubuntu-noble-large | flux-system 17m Normal SuccessfulCreate replicaset/flux-web-f67d8b54 Created pod: flux-web-f67d8b54-6fxvg 2026-07-03 06:57:39.302982 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/envoy-gateway-system-envoy-gateway pulled 'gateway-helm' chart with version '1.8.2' 2026-07-03 06:57:39.302990 | ubuntu-noble-large | flux-system 17m Normal NewArtifact gitrepository/k-orc stored artifact for commit 'Release v2.5.0' 2026-07-03 06:57:39.302998 | ubuntu-noble-large | flux-system 17m Normal Scheduled pod/flux-web-f67d8b54-6fxvg Successfully assigned flux-system/flux-web-f67d8b54-6fxvg to forge-control-plane 2026-07-03 06:57:39.303006 | ubuntu-noble-large | flux-system 17m Normal ScalingReplicaSet deployment/flux-web Scaled up replica set flux-web-f67d8b54 from 0 to 1 2026-07-03 06:57:39.303017 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/mariadb-system-mariadb-operator-crds pulled 'mariadb-operator-crds' chart with version '0.38.1' 2026-07-03 06:57:39.303026 | ubuntu-noble-large | flux-system 17m Normal Created pod/flux-web-f67d8b54-6fxvg Container created 2026-07-03 06:57:39.303033 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/mariadb-system-mariadb-operator pulled 'mariadb-operator' chart with version '0.38.1' 2026-07-03 06:57:39.303044 | ubuntu-noble-large | headlamp-system 17m Normal SuccessfulCreate replicaset/headlamp-796ff44f7b Created pod: headlamp-796ff44f7b-gcx5n 2026-07-03 06:57:39.303056 | ubuntu-noble-large | headlamp-system 17m Normal ScalingReplicaSet deployment/headlamp Scaled up replica set headlamp-796ff44f7b from 0 to 1 2026-07-03 06:57:39.303068 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/memcached-system-memcached-operator pulled 'memcached-operator' chart with version '0.4.0' 2026-07-03 06:57:39.303079 | ubuntu-noble-large | cert-manager 17m Normal SuccessfulCreate replicaset/cert-manager-cainjector-78fdbbf665 Created pod: cert-manager-cainjector-78fdbbf665-h7fgq 2026-07-03 06:57:39.303097 | ubuntu-noble-large | headlamp-system 17m Normal Pulling pod/headlamp-796ff44f7b-gcx5n Pulling image "ghcr.io/headlamp-k8s/headlamp-plugin-flux:v0.6.0" 2026-07-03 06:57:39.303115 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/monitoring-prometheus-operator-crds pulled 'prometheus-operator-crds' chart with version '19.1.0' 2026-07-03 06:57:39.303133 | ubuntu-noble-large | flux-system 17m Normal ChartPullSucceeded helmchart/openbao-system-openbao pulled 'openbao' chart with version '0.28.4' 2026-07-03 06:57:39.303153 | ubuntu-noble-large | cert-manager 17m Normal Scheduled pod/cert-manager-c767877bd-l4mz4 Successfully assigned cert-manager/cert-manager-c767877bd-l4mz4 to forge-control-plane 2026-07-03 06:57:39.303174 | ubuntu-noble-large | cert-manager 17m Normal SuccessfulCreate replicaset/cert-manager-c767877bd Created pod: cert-manager-c767877bd-l4mz4 2026-07-03 06:57:39.303193 | ubuntu-noble-large | cert-manager 17m Normal SuccessfulCreate replicaset/cert-manager-webhook-66986b64b9 Created pod: cert-manager-webhook-66986b64b9-dcnw7 2026-07-03 06:57:39.303211 | ubuntu-noble-large | cert-manager 17m Normal ScalingReplicaSet deployment/cert-manager-webhook Scaled up replica set cert-manager-webhook-66986b64b9 from 0 to 1 2026-07-03 06:57:39.303232 | ubuntu-noble-large | cert-manager 17m Normal ScalingReplicaSet deployment/cert-manager-cainjector Scaled up replica set cert-manager-cainjector-78fdbbf665 from 0 to 1 2026-07-03 06:57:39.303252 | ubuntu-noble-large | cert-manager 17m Normal ScalingReplicaSet deployment/cert-manager Scaled up replica set cert-manager-c767877bd from 0 to 1 2026-07-03 06:57:39.303273 | ubuntu-noble-large | headlamp-system 17m Normal Scheduled pod/headlamp-796ff44f7b-gcx5n Successfully assigned headlamp-system/headlamp-796ff44f7b-gcx5n to forge-control-plane 2026-07-03 06:57:39.303338 | ubuntu-noble-large | cert-manager 17m Normal Scheduled pod/cert-manager-cainjector-78fdbbf665-h7fgq Successfully assigned cert-manager/cert-manager-cainjector-78fdbbf665-h7fgq to forge-control-plane 2026-07-03 06:57:39.303362 | ubuntu-noble-large | cert-manager 17m Normal Scheduled pod/cert-manager-webhook-66986b64b9-dcnw7 Successfully assigned cert-manager/cert-manager-webhook-66986b64b9-dcnw7 to forge-control-plane 2026-07-03 06:57:39.303376 | ubuntu-noble-large | orc-system 17m Normal Scheduled pod/orc-controller-manager-7bd5ff7754-4k6dc Successfully assigned orc-system/orc-controller-manager-7bd5ff7754-4k6dc to forge-control-plane 2026-07-03 06:57:39.303391 | ubuntu-noble-large | flux-system 17m Normal Progressing kustomization/k-orc CustomResourceDefinition/addressscopes.openstack.k-orc.cloud created... 2026-07-03 06:57:39.303411 | ubuntu-noble-large | orc-system 17m Normal ScalingReplicaSet deployment/orc-controller-manager Scaled up replica set orc-controller-manager-7bd5ff7754 from 0 to 1 2026-07-03 06:57:39.303425 | ubuntu-noble-large | orc-system 17m Normal SuccessfulCreate replicaset/orc-controller-manager-7bd5ff7754 Created pod: orc-controller-manager-7bd5ff7754-4k6dc 2026-07-03 06:57:39.303439 | ubuntu-noble-large | cert-manager 17m Normal Pulling pod/cert-manager-c767877bd-l4mz4 Pulling image "quay.io/jetstack/cert-manager-controller:v1.20.3" 2026-07-03 06:57:39.303493 | ubuntu-noble-large | cert-manager 17m Normal Pulling pod/cert-manager-cainjector-78fdbbf665-h7fgq Pulling image "quay.io/jetstack/cert-manager-cainjector:v1.20.3" 2026-07-03 06:57:39.303540 | ubuntu-noble-large | cert-manager 17m Normal Pulling pod/cert-manager-webhook-66986b64b9-dcnw7 Pulling image "quay.io/jetstack/cert-manager-webhook:v1.20.3" 2026-07-03 06:57:39.303555 | ubuntu-noble-large | headlamp-system 17m Normal Started pod/headlamp-796ff44f7b-gcx5n Container started 2026-07-03 06:57:39.303563 | ubuntu-noble-large | orc-system 17m Normal Pulling pod/orc-controller-manager-7bd5ff7754-4k6dc Pulling image "quay.io/orc/openstack-resource-controller:v2.5.0" 2026-07-03 06:57:39.303576 | ubuntu-noble-large | headlamp-system 17m Normal Created pod/headlamp-796ff44f7b-gcx5n Container created 2026-07-03 06:57:39.303590 | ubuntu-noble-large | headlamp-system 17m Normal Pulled pod/headlamp-796ff44f7b-gcx5n Successfully pulled image "ghcr.io/headlamp-k8s/headlamp-plugin-flux:v0.6.0" in 2.177s (2.178s including waiting). Image size: 3930787 bytes. 2026-07-03 06:57:39.303599 | ubuntu-noble-large | headlamp-system 17m Normal Pulling pod/headlamp-796ff44f7b-gcx5n Pulling image "ghcr.io/headlamp-k8s/headlamp:v0.43.0" 2026-07-03 06:57:39.303610 | ubuntu-noble-large | cert-manager 17m Normal Created pod/cert-manager-cainjector-78fdbbf665-h7fgq Container created 2026-07-03 06:57:39.303618 | ubuntu-noble-large | cert-manager 17m Normal Pulled pod/cert-manager-cainjector-78fdbbf665-h7fgq Successfully pulled image "quay.io/jetstack/cert-manager-cainjector:v1.20.3" in 3.083s (4.556s including waiting). Image size: 16409208 bytes. 2026-07-03 06:57:39.303629 | ubuntu-noble-large | cert-manager 17m Normal Started pod/cert-manager-cainjector-78fdbbf665-h7fgq Container started 2026-07-03 06:57:39.303640 | ubuntu-noble-large | kube-system 17m Normal LeaderElection lease/cert-manager-cainjector-leader-election cert-manager-cainjector-78fdbbf665-h7fgq_f8744cee-d305-4998-9d30-3f5b96c7f950 became leader 2026-07-03 06:57:39.303652 | ubuntu-noble-large | mariadb-system 17m Normal InstallSucceeded helmrelease/mariadb-operator-crds Helm install succeeded for release mariadb-system/mariadb-operator-crds.v1 with chart mariadb-operator-crds@0.38.1 2026-07-03 06:57:39.303670 | ubuntu-noble-large | cert-manager 17m Normal Pulled pod/cert-manager-c767877bd-l4mz4 Successfully pulled image "quay.io/jetstack/cert-manager-controller:v1.20.3" in 2.687s (7.234s including waiting). Image size: 23662428 bytes. 2026-07-03 06:57:39.303690 | ubuntu-noble-large | cert-manager 17m Normal Started pod/cert-manager-c767877bd-l4mz4 Container started 2026-07-03 06:57:39.303709 | ubuntu-noble-large | cert-manager 17m Normal Created pod/cert-manager-c767877bd-l4mz4 Container created 2026-07-03 06:57:39.303729 | ubuntu-noble-large | kube-system 17m Normal LeaderElection lease/cert-manager-controller cert-manager-c767877bd-l4mz4-external-cert-manager-controller became leader 2026-07-03 06:57:39.303751 | ubuntu-noble-large | cert-manager 17m Normal Created pod/cert-manager-webhook-66986b64b9-dcnw7 Container created 2026-07-03 06:57:39.303772 | ubuntu-noble-large | cert-manager 17m Normal Started pod/cert-manager-webhook-66986b64b9-dcnw7 Container started 2026-07-03 06:57:39.303791 | ubuntu-noble-large | cert-manager 17m Normal Pulled pod/cert-manager-webhook-66986b64b9-dcnw7 Successfully pulled image "quay.io/jetstack/cert-manager-webhook:v1.20.3" in 2.524s (9.716s including waiting). Image size: 19511753 bytes. 2026-07-03 06:57:39.303810 | ubuntu-noble-large | flux-system 17m Normal InstallSucceeded helmrelease/flux-web Helm install succeeded for release flux-system/flux-web.v1 with chart flux-operator@0.52.0+e25cf78b888f 2026-07-03 06:57:39.303826 | ubuntu-noble-large | keystone-system 17m Normal DependencyNotReady helmrelease/keystone-operator dependency 'cert-manager/cert-manager' is not ready 2026-07-03 06:57:39.303844 | ubuntu-noble-large | memcached-system 17m Normal DependencyNotReady helmrelease/memcached-operator dependency 'cert-manager/cert-manager' is not ready 2026-07-03 06:57:39.303862 | ubuntu-noble-large | external-secrets 17m Normal DependencyNotReady helmrelease/external-secrets dependency 'cert-manager/cert-manager' is not ready 2026-07-03 06:57:39.303882 | ubuntu-noble-large | mariadb-system 17m Normal DependencyNotReady helmrelease/mariadb-operator dependency 'cert-manager/cert-manager' is not ready 2026-07-03 06:57:39.303905 | ubuntu-noble-large | openbao-system 17m Normal DependencyNotReady helmrelease/openbao dependency 'cert-manager/cert-manager' is not ready 2026-07-03 06:57:39.303921 | ubuntu-noble-large | envoy-gateway-system 17m Normal Pulling pod/envoy-gateway-gateway-helm-certgen-55pjg Pulling image "docker.io/envoyproxy/gateway:v1.8.2" 2026-07-03 06:57:39.303939 | ubuntu-noble-large | envoy-gateway-system 17m Normal SuccessfulCreate job/envoy-gateway-gateway-helm-certgen Created pod: envoy-gateway-gateway-helm-certgen-55pjg 2026-07-03 06:57:39.303960 | ubuntu-noble-large | cert-manager 17m Normal InstallSucceeded helmrelease/cert-manager Helm install succeeded for release cert-manager/cert-manager.v1 with chart cert-manager@v1.20.3 2026-07-03 06:57:39.303977 | ubuntu-noble-large | envoy-gateway-system 17m Normal Scheduled pod/envoy-gateway-gateway-helm-certgen-55pjg Successfully assigned envoy-gateway-system/envoy-gateway-gateway-helm-certgen-55pjg to forge-control-plane 2026-07-03 06:57:39.303997 | ubuntu-noble-large | orc-system 17m Normal Pulled pod/orc-controller-manager-7bd5ff7754-4k6dc Successfully pulled image "quay.io/orc/openstack-resource-controller:v2.5.0" in 11.783s (20.539s including waiting). Image size: 38987232 bytes. 2026-07-03 06:57:39.304011 | ubuntu-noble-large | orc-system 17m Normal Created pod/orc-controller-manager-7bd5ff7754-4k6dc Container created 2026-07-03 06:57:39.304022 | ubuntu-noble-large | orc-system 17m Normal LeaderElection lease/f35396c5.k-orc.cloud orc-controller-manager-7bd5ff7754-4k6dc_ba6ab00d-ad22-44da-a2f3-d4d9e9817650 became leader 2026-07-03 06:57:39.304033 | ubuntu-noble-large | orc-system 17m Normal Started pod/orc-controller-manager-7bd5ff7754-4k6dc Container started 2026-07-03 06:57:39.304045 | ubuntu-noble-large | memcached-system 17m Normal DependencyNotReady helmrelease/memcached-operator dependency 'monitoring/prometheus-operator-crds' is not ready 2026-07-03 06:57:39.304056 | ubuntu-noble-large | openbao-system 17m Normal WaitForFirstConsumer persistentvolumeclaim/data-openbao-0 waiting for first consumer to be created before binding 2026-07-03 06:57:39.304068 | ubuntu-noble-large | openbao-system 17m Normal ExternalProvisioning persistentvolumeclaim/data-openbao-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.304087 | ubuntu-noble-large | openbao-system 17m Normal SuccessfulCreate statefulset/openbao Create Claim data-openbao-0 Pod openbao-0 in StatefulSet openbao success 2026-07-03 06:57:39.304095 | ubuntu-noble-large | openbao-system 17m Normal SuccessfulCreate statefulset/openbao Create Pod openbao-0 in StatefulSet openbao successful 2026-07-03 06:57:39.304106 | ubuntu-noble-large | openbao-system 17m Normal InstallSucceeded helmrelease/openbao Helm install succeeded for release openbao-system/openbao.v1 with chart openbao@0.28.4 2026-07-03 06:57:39.304115 | ubuntu-noble-large | openbao-system 17m Normal Provisioning persistentvolumeclaim/data-openbao-0 External provisioner is provisioning volume for claim "openbao-system/data-openbao-0" 2026-07-03 06:57:39.304126 | ubuntu-noble-large | local-path-storage 17m Normal Pulled pod/helper-pod-create-pvc-dadd06e2-dbd9-4d7b-8fdc-6d59a8353e68 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.304134 | ubuntu-noble-large | local-path-storage 17m Normal Started pod/helper-pod-create-pvc-dadd06e2-dbd9-4d7b-8fdc-6d59a8353e68 Container started 2026-07-03 06:57:39.304145 | ubuntu-noble-large | local-path-storage 17m Normal Created pod/helper-pod-create-pvc-dadd06e2-dbd9-4d7b-8fdc-6d59a8353e68 Container created 2026-07-03 06:57:39.304158 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304174 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304182 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304193 | ubuntu-noble-large | cert-manager 17m Normal Requested certificate/openbao-ca Created new CertificateRequest resource "openbao-ca-1" 2026-07-03 06:57:39.304201 | ubuntu-noble-large | default 17m Warning ErrInitIssuer clusterissuer/openbao-ca-issuer Error initializing issuer: secrets "openbao-ca" not found 2026-07-03 06:57:39.304209 | ubuntu-noble-large | default 17m Warning ErrGetKeyPair clusterissuer/openbao-ca-issuer Error getting keypair for CA issuer: secrets "openbao-ca" not found 2026-07-03 06:57:39.304220 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304231 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openbao-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304243 | ubuntu-noble-large | cert-manager 17m Normal Issuing certificate/openbao-ca Issuing certificate as Secret does not exist 2026-07-03 06:57:39.304262 | ubuntu-noble-large | cert-manager 17m Normal Generated certificate/openbao-ca Stored new private key in temporary Secret resource "openbao-ca-mfswz" 2026-07-03 06:57:39.304279 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304291 | ubuntu-noble-large | mariadb-system 17m Normal Scheduled pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Successfully assigned mariadb-system/mariadb-operator-cert-controller-58b95fd98-jzgsb to forge-control-plane 2026-07-03 06:57:39.304309 | ubuntu-noble-large | cert-manager 17m Normal CertificateIssued certificaterequest/openbao-ca-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.304327 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304345 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304366 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304388 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304408 | ubuntu-noble-large | cert-manager 17m Normal WaitingForApproval certificaterequest/openstack-db-ca-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304426 | ubuntu-noble-large | cert-manager 17m Normal CertificateIssued certificaterequest/openstack-db-ca-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.304499 | ubuntu-noble-large | cert-manager 17m Normal cert-manager.io certificaterequest/openstack-db-ca-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.304554 | ubuntu-noble-large | cert-manager 17m Normal cert-manager.io certificaterequest/openbao-ca-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.304583 | ubuntu-noble-large | monitoring 17m Normal InstallSucceeded helmrelease/prometheus-operator-crds Helm install succeeded for release monitoring/prometheus-operator-crds.v1 with chart prometheus-operator-crds@19.1.0 2026-07-03 06:57:39.304592 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304604 | ubuntu-noble-large | default 17m Warning ErrGetKeyPair clusterissuer/openstack-db-ca-issuer Error getting keypair for CA issuer: secrets "openstack-db-ca" not found 2026-07-03 06:57:39.304613 | ubuntu-noble-large | default 17m Warning ErrInitIssuer clusterissuer/openstack-db-ca-issuer Error initializing issuer: secrets "openstack-db-ca" not found 2026-07-03 06:57:39.304621 | ubuntu-noble-large | mariadb-system 17m Normal ScalingReplicaSet deployment/mariadb-operator Scaled up replica set mariadb-operator-756fd78967 from 0 to 1 2026-07-03 06:57:39.304628 | ubuntu-noble-large | mariadb-system 17m Normal ScalingReplicaSet deployment/mariadb-operator-webhook Scaled up replica set mariadb-operator-webhook-67d6d5db7b from 0 to 1 2026-07-03 06:57:39.304648 | ubuntu-noble-large | mariadb-system 17m Normal SuccessfulCreate replicaset/mariadb-operator-webhook-67d6d5db7b Created pod: mariadb-operator-webhook-67d6d5db7b-nmnnn 2026-07-03 06:57:39.304656 | ubuntu-noble-large | mariadb-system 17m Normal Scheduled pod/mariadb-operator-webhook-67d6d5db7b-nmnnn Successfully assigned mariadb-system/mariadb-operator-webhook-67d6d5db7b-nmnnn to forge-control-plane 2026-07-03 06:57:39.304664 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304676 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304684 | ubuntu-noble-large | openbao-system 17m Normal WaitingForApproval certificaterequest/openbao-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.304695 | ubuntu-noble-large | cert-manager 17m Normal Issuing certificate/openstack-db-ca Issuing certificate as Secret does not exist 2026-07-03 06:57:39.304706 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/openbao-tls Issuing certificate as Secret does not exist 2026-07-03 06:57:39.304727 | ubuntu-noble-large | cert-manager 17m Normal Requested certificate/openstack-db-ca Created new CertificateRequest resource "openstack-db-ca-1" 2026-07-03 06:57:39.304743 | ubuntu-noble-large | mariadb-system 17m Normal Scheduled pod/mariadb-operator-756fd78967-6wk5n Successfully assigned mariadb-system/mariadb-operator-756fd78967-6wk5n to forge-control-plane 2026-07-03 06:57:39.304760 | ubuntu-noble-large | mariadb-system 17m Normal SuccessfulCreate replicaset/mariadb-operator-756fd78967 Created pod: mariadb-operator-756fd78967-6wk5n 2026-07-03 06:57:39.304780 | ubuntu-noble-large | openbao-system 17m Normal Generated certificate/openbao-tls Stored new private key in temporary Secret resource "openbao-tls-sgp4k" 2026-07-03 06:57:39.304801 | ubuntu-noble-large | openbao-system 17m Normal Requested certificate/openbao-tls Created new CertificateRequest resource "openbao-tls-1" 2026-07-03 06:57:39.304822 | ubuntu-noble-large | cert-manager 17m Normal Issuing certificate/openbao-ca The certificate has been successfully issued 2026-07-03 06:57:39.304842 | ubuntu-noble-large | cert-manager 17m Normal Generated certificate/openstack-db-ca Stored new private key in temporary Secret resource "openstack-db-ca-vhpcr" 2026-07-03 06:57:39.304861 | ubuntu-noble-large | mariadb-system 17m Normal ScalingReplicaSet deployment/mariadb-operator-cert-controller Scaled up replica set mariadb-operator-cert-controller-58b95fd98 from 0 to 1 2026-07-03 06:57:39.304876 | ubuntu-noble-large | mariadb-system 17m Normal SuccessfulCreate replicaset/mariadb-operator-cert-controller-58b95fd98 Created pod: mariadb-operator-cert-controller-58b95fd98-jzgsb 2026-07-03 06:57:39.304894 | ubuntu-noble-large | headlamp-system 17m Warning Unhealthy pod/headlamp-796ff44f7b-gcx5n Readiness probe failed: Get "http://10.244.0.11:4466/": dial tcp 10.244.0.11:4466: connect: connection refused 2026-07-03 06:57:39.304912 | ubuntu-noble-large | openbao-system 17m Normal Issuing certificate/openbao-tls The certificate has been successfully issued 2026-07-03 06:57:39.304929 | ubuntu-noble-large | mariadb-system 17m Normal Pulling pod/mariadb-operator-756fd78967-6wk5n Pulling image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" 2026-07-03 06:57:39.304945 | ubuntu-noble-large | openbao-system 17m Normal CertificateIssued certificaterequest/openbao-tls-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.304968 | ubuntu-noble-large | openbao-system 17m Normal cert-manager.io certificaterequest/openbao-tls-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.304985 | ubuntu-noble-large | mariadb-system 17m Normal Pulling pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Pulling image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" 2026-07-03 06:57:39.305001 | ubuntu-noble-large | headlamp-system 17m Normal Started pod/headlamp-796ff44f7b-gcx5n Container started 2026-07-03 06:57:39.305020 | ubuntu-noble-large | headlamp-system 17m Normal Created pod/headlamp-796ff44f7b-gcx5n Container created 2026-07-03 06:57:39.305037 | ubuntu-noble-large | headlamp-system 17m Normal Pulled pod/headlamp-796ff44f7b-gcx5n Successfully pulled image "ghcr.io/headlamp-k8s/headlamp:v0.43.0" in 6.392s (25.516s including waiting). Image size: 96655717 bytes. 2026-07-03 06:57:39.305058 | ubuntu-noble-large | cert-manager 17m Normal Issuing certificate/openstack-db-ca The certificate has been successfully issued 2026-07-03 06:57:39.305073 | ubuntu-noble-large | openbao-system 17m Normal ProvisioningSucceeded persistentvolumeclaim/data-openbao-0 Successfully provisioned volume pvc-dadd06e2-dbd9-4d7b-8fdc-6d59a8353e68 2026-07-03 06:57:39.305094 | ubuntu-noble-large | headlamp-system 17m Normal InstallSucceeded helmrelease/headlamp Helm install succeeded for release headlamp-system/headlamp.v1 with chart headlamp@0.43.0 2026-07-03 06:57:39.305113 | ubuntu-noble-large | openbao-system 17m Normal Scheduled pod/openbao-0 Successfully assigned openbao-system/openbao-0 to forge-control-plane 2026-07-03 06:57:39.305127 | ubuntu-noble-large | external-secrets 17m Normal SuccessfulCreate replicaset/external-secrets-webhook-6955d84bd5 Created pod: external-secrets-webhook-6955d84bd5-mkwpc 2026-07-03 06:57:39.305148 | ubuntu-noble-large | external-secrets 17m Normal ScalingReplicaSet deployment/external-secrets Scaled up replica set external-secrets-5958b59f7d from 0 to 1 2026-07-03 06:57:39.305167 | ubuntu-noble-large | external-secrets 17m Normal SuccessfulCreate replicaset/external-secrets-5958b59f7d Created pod: external-secrets-5958b59f7d-h78sx 2026-07-03 06:57:39.305191 | ubuntu-noble-large | external-secrets 17m Normal ScalingReplicaSet deployment/external-secrets-cert-controller Scaled up replica set external-secrets-cert-controller-97b69894c from 0 to 1 2026-07-03 06:57:39.305202 | ubuntu-noble-large | external-secrets 17m Normal SuccessfulCreate replicaset/external-secrets-cert-controller-97b69894c Created pod: external-secrets-cert-controller-97b69894c-lrgkp 2026-07-03 06:57:39.305226 | ubuntu-noble-large | external-secrets 17m Normal Scheduled pod/external-secrets-webhook-6955d84bd5-mkwpc Successfully assigned external-secrets/external-secrets-webhook-6955d84bd5-mkwpc to forge-control-plane 2026-07-03 06:57:39.305242 | ubuntu-noble-large | external-secrets 17m Normal Scheduled pod/external-secrets-cert-controller-97b69894c-lrgkp Successfully assigned external-secrets/external-secrets-cert-controller-97b69894c-lrgkp to forge-control-plane 2026-07-03 06:57:39.305252 | ubuntu-noble-large | external-secrets 17m Normal Scheduled pod/external-secrets-5958b59f7d-h78sx Successfully assigned external-secrets/external-secrets-5958b59f7d-h78sx to forge-control-plane 2026-07-03 06:57:39.305263 | ubuntu-noble-large | external-secrets 17m Normal ScalingReplicaSet deployment/external-secrets-webhook Scaled up replica set external-secrets-webhook-6955d84bd5 from 0 to 1 2026-07-03 06:57:39.305280 | ubuntu-noble-large | external-secrets 17m Normal Pulling pod/external-secrets-cert-controller-97b69894c-lrgkp Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-07-03 06:57:39.305294 | ubuntu-noble-large | external-secrets 17m Normal Pulling pod/external-secrets-webhook-6955d84bd5-mkwpc Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-07-03 06:57:39.305312 | ubuntu-noble-large | default 17m Normal KeyPairVerified clusterissuer/openbao-ca-issuer Signing CA verified 2026-07-03 06:57:39.305328 | ubuntu-noble-large | external-secrets 17m Normal Pulling pod/external-secrets-5958b59f7d-h78sx Pulling image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" 2026-07-03 06:57:39.305345 | ubuntu-noble-large | default 17m Normal KeyPairVerified clusterissuer/openstack-db-ca-issuer Signing CA verified 2026-07-03 06:57:39.305361 | ubuntu-noble-large | envoy-gateway-system 17m Normal Started pod/envoy-gateway-gateway-helm-certgen-55pjg Container started 2026-07-03 06:57:39.305378 | ubuntu-noble-large | envoy-gateway-system 17m Normal Created pod/envoy-gateway-gateway-helm-certgen-55pjg Container created 2026-07-03 06:57:39.305395 | ubuntu-noble-large | envoy-gateway-system 17m Normal Pulled pod/envoy-gateway-gateway-helm-certgen-55pjg Successfully pulled image "docker.io/envoyproxy/gateway:v1.8.2" in 4.796s (15.195s including waiting). Image size: 73324485 bytes. 2026-07-03 06:57:39.305416 | ubuntu-noble-large | flux-system 17m Normal Progressing kustomization/k-orc Health check passed in 35.286173772s 2026-07-03 06:57:39.305432 | ubuntu-noble-large | mariadb-system 17m Warning FailedMount pod/mariadb-operator-webhook-67d6d5db7b-nmnnn MountVolume.SetUp failed for volume "ca" : secret "mariadb-operator-webhook-ca" not found 2026-07-03 06:57:39.305571 | ubuntu-noble-large | mariadb-system 17m Warning FailedMount pod/mariadb-operator-webhook-67d6d5db7b-nmnnn MountVolume.SetUp failed for volume "cert" : secret "mariadb-operator-webhook-cert" not found 2026-07-03 06:57:39.305597 | ubuntu-noble-large | flux-system 17m Normal ReconciliationSucceeded kustomization/k-orc Reconciliation finished in 38.659911485s, next run in 30m0s 2026-07-03 06:57:39.305618 | ubuntu-noble-large | envoy-gateway-system 17m Normal Completed job/envoy-gateway-gateway-helm-certgen Job completed 2026-07-03 06:57:39.305626 | ubuntu-noble-large | mariadb-system 17m Normal Created pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Container created 2026-07-03 06:57:39.305634 | ubuntu-noble-large | envoy-gateway-system 17m Normal Scheduled pod/envoy-gateway-df8fc66ff-9zgzc Successfully assigned envoy-gateway-system/envoy-gateway-df8fc66ff-9zgzc to forge-control-plane 2026-07-03 06:57:39.305651 | ubuntu-noble-large | mariadb-system 17m Normal Pulled pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Successfully pulled image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" in 4.756s (9.586s including waiting). Image size: 36312327 bytes. 2026-07-03 06:57:39.305675 | ubuntu-noble-large | envoy-gateway-system 17m Normal SuccessfulCreate replicaset/envoy-gateway-df8fc66ff Created pod: envoy-gateway-df8fc66ff-9zgzc 2026-07-03 06:57:39.305683 | ubuntu-noble-large | envoy-gateway-system 17m Normal ScalingReplicaSet deployment/envoy-gateway Scaled up replica set envoy-gateway-df8fc66ff from 0 to 1 2026-07-03 06:57:39.305690 | ubuntu-noble-large | envoy-gateway-system 17m Normal LeaderElection lease/5b9825d2.gateway.envoyproxy.io envoy-gateway-df8fc66ff-9zgzc_18171f57-4610-4606-8ace-20402318ab27 became leader 2026-07-03 06:57:39.305698 | ubuntu-noble-large | mariadb-system 17m Normal Pulled pod/mariadb-operator-756fd78967-6wk5n Successfully pulled image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" in 603ms (10.183s including waiting). Image size: 36312327 bytes. 2026-07-03 06:57:39.305708 | ubuntu-noble-large | envoy-gateway-system 17m Normal Started pod/envoy-gateway-df8fc66ff-9zgzc Container started 2026-07-03 06:57:39.305715 | ubuntu-noble-large | mariadb-system 17m Normal Created pod/mariadb-operator-756fd78967-6wk5n Container created 2026-07-03 06:57:39.305726 | ubuntu-noble-large | envoy-gateway-system 17m Normal Created pod/envoy-gateway-df8fc66ff-9zgzc Container created 2026-07-03 06:57:39.305736 | ubuntu-noble-large | envoy-gateway-system 17m Normal Pulled pod/envoy-gateway-df8fc66ff-9zgzc Container image "docker.io/envoyproxy/gateway:v1.8.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.305751 | ubuntu-noble-large | mariadb-system 17m Normal Started pod/mariadb-operator-756fd78967-6wk5n Container started 2026-07-03 06:57:39.305766 | ubuntu-noble-large | mariadb-system 17m Normal Started pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Container started 2026-07-03 06:57:39.305782 | ubuntu-noble-large | memcached-system 17m Normal Scheduled pod/memcached-operator-869dfff548-gt8xw Successfully assigned memcached-system/memcached-operator-869dfff548-gt8xw to forge-control-plane 2026-07-03 06:57:39.305797 | ubuntu-noble-large | memcached-system 17m Normal Pulling pod/memcached-operator-869dfff548-gt8xw Pulling image "ghcr.io/c5c3/memcached-operator:0.4.0" 2026-07-03 06:57:39.305814 | ubuntu-noble-large | memcached-system 17m Normal SuccessfulCreate replicaset/memcached-operator-869dfff548 Created pod: memcached-operator-869dfff548-gt8xw 2026-07-03 06:57:39.305826 | ubuntu-noble-large | memcached-system 17m Normal ScalingReplicaSet deployment/memcached-operator Scaled up replica set memcached-operator-869dfff548 from 0 to 1 2026-07-03 06:57:39.305845 | ubuntu-noble-large | mariadb-system 17m Normal Pulled pod/mariadb-operator-webhook-67d6d5db7b-nmnnn Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.305862 | ubuntu-noble-large | mariadb-system 17m Normal Started pod/mariadb-operator-webhook-67d6d5db7b-nmnnn Container started 2026-07-03 06:57:39.305877 | ubuntu-noble-large | mariadb-system 17m Normal Created pod/mariadb-operator-webhook-67d6d5db7b-nmnnn Container created 2026-07-03 06:57:39.305893 | ubuntu-noble-large | external-secrets 17m Normal Pulled pod/external-secrets-5958b59f7d-h78sx Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 549ms (13.728s including waiting). Image size: 89583295 bytes. 2026-07-03 06:57:39.305906 | ubuntu-noble-large | external-secrets 17m Normal Started pod/external-secrets-cert-controller-97b69894c-lrgkp Container started 2026-07-03 06:57:39.305921 | ubuntu-noble-large | external-secrets 17m Normal Created pod/external-secrets-cert-controller-97b69894c-lrgkp Container created 2026-07-03 06:57:39.305938 | ubuntu-noble-large | external-secrets 17m Normal Pulled pod/external-secrets-cert-controller-97b69894c-lrgkp Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 6.022s (13.26s including waiting). Image size: 89583295 bytes. 2026-07-03 06:57:39.305949 | ubuntu-noble-large | external-secrets 17m Normal Started pod/external-secrets-webhook-6955d84bd5-mkwpc Container started 2026-07-03 06:57:39.305960 | ubuntu-noble-large | external-secrets 17m Normal Created pod/external-secrets-5958b59f7d-h78sx Container created 2026-07-03 06:57:39.305976 | ubuntu-noble-large | external-secrets 17m Normal Pulled pod/external-secrets-webhook-6955d84bd5-mkwpc Successfully pulled image "oci.external-secrets.io/external-secrets/external-secrets:v0.20.4" in 562ms (14.269s including waiting). Image size: 89583295 bytes. 2026-07-03 06:57:39.305991 | ubuntu-noble-large | external-secrets 17m Normal Created pod/external-secrets-webhook-6955d84bd5-mkwpc Container created 2026-07-03 06:57:39.306007 | ubuntu-noble-large | default 17m Warning UpdateFailed validatingwebhookconfiguration/secretstore-validate ca cert not yet ready 2026-07-03 06:57:39.306020 | ubuntu-noble-large | default 17m Warning UpdateFailed validatingwebhookconfiguration/externalsecret-validate ca cert not yet ready 2026-07-03 06:57:39.306037 | ubuntu-noble-large | external-secrets 17m Normal Started pod/external-secrets-5958b59f7d-h78sx Container started 2026-07-03 06:57:39.306051 | ubuntu-noble-large | memcached-system 16m Normal LeaderElection lease/d4f3c8a2.c5c3.io memcached-operator-869dfff548-gt8xw_f6d2f8c5-f341-49b7-ab4a-8040bdc10cd0 became leader 2026-07-03 06:57:39.306069 | ubuntu-noble-large | memcached-system 16m Normal Started pod/memcached-operator-869dfff548-gt8xw Container started 2026-07-03 06:57:39.306083 | ubuntu-noble-large | memcached-system 16m Normal Created pod/memcached-operator-869dfff548-gt8xw Container created 2026-07-03 06:57:39.306102 | ubuntu-noble-large | memcached-system 16m Normal Pulled pod/memcached-operator-869dfff548-gt8xw Successfully pulled image "ghcr.io/c5c3/memcached-operator:0.4.0" in 2.939s (8.784s including waiting). Image size: 17406523 bytes. 2026-07-03 06:57:39.306117 | ubuntu-noble-large | envoy-gateway-system 16m Normal InstallSucceeded helmrelease/envoy-gateway Helm install succeeded for release envoy-gateway-system/envoy-gateway.v1 with chart gateway-helm@1.8.2 2026-07-03 06:57:39.306132 | ubuntu-noble-large | memcached-system 16m Normal InstallSucceeded helmrelease/memcached-operator Helm install succeeded for release memcached-system/memcached-operator.v1 with chart memcached-operator@0.4.0 2026-07-03 06:57:39.306147 | ubuntu-noble-large | mariadb-system 16m Warning Unhealthy pod/mariadb-operator-cert-controller-58b95fd98-jzgsb Readiness probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:39.306162 | ubuntu-noble-large | openbao-system 16m Warning FailedMount pod/openbao-0 MountVolume.SetUp failed for volume "client-tls" : secret "openbao-client-tls" not found 2026-07-03 06:57:39.306179 | ubuntu-noble-large | keystone-system 16m Normal DependencyNotReady helmrelease/keystone-operator dependency 'mariadb-system/mariadb-operator' is not ready 2026-07-03 06:57:39.306189 | ubuntu-noble-large | external-secrets 16m Warning Unhealthy pod/external-secrets-cert-controller-97b69894c-lrgkp Readiness probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:39.306204 | ubuntu-noble-large | mariadb-system 16m Normal InstallSucceeded helmrelease/mariadb-operator Helm install succeeded for release mariadb-system/mariadb-operator.v1 with chart mariadb-operator@0.38.1 2026-07-03 06:57:39.306222 | ubuntu-noble-large | external-secrets 16m Normal InstallSucceeded helmrelease/external-secrets Helm install succeeded for release external-secrets/external-secrets.v1 with chart external-secrets@0.20.4 2026-07-03 06:57:39.306235 | ubuntu-noble-large | keystone-system 16m Normal NoPods poddisruptionbudget/keystone-operator No matching pods found 2026-07-03 06:57:39.306251 | ubuntu-noble-large | keystone-system 16m Warning FailedMount pod/keystone-operator-66cf7cbc64-mtvhv MountVolume.SetUp failed for volume "webhook-certs" : secret "keystone-operator-webhook-cert" not found 2026-07-03 06:57:39.306263 | ubuntu-noble-large | keystone-system 16m Normal Scheduled pod/keystone-operator-66cf7cbc64-w9xzs Successfully assigned keystone-system/keystone-operator-66cf7cbc64-w9xzs to forge-control-plane 2026-07-03 06:57:39.306282 | ubuntu-noble-large | keystone-system 16m Normal Issuing certificate/keystone-operator-webhook Issuing certificate as Secret does not exist 2026-07-03 06:57:39.306299 | ubuntu-noble-large | keystone-system 16m Warning FailedMount pod/keystone-operator-66cf7cbc64-w9xzs MountVolume.SetUp failed for volume "webhook-certs" : secret "keystone-operator-webhook-cert" not found 2026-07-03 06:57:39.306311 | ubuntu-noble-large | keystone-system 16m Normal Scheduled pod/keystone-operator-66cf7cbc64-mtvhv Successfully assigned keystone-system/keystone-operator-66cf7cbc64-mtvhv to forge-control-plane 2026-07-03 06:57:39.306323 | ubuntu-noble-large | keystone-system 16m Normal SuccessfulCreate replicaset/keystone-operator-66cf7cbc64 Created pod: keystone-operator-66cf7cbc64-mtvhv 2026-07-03 06:57:39.306334 | ubuntu-noble-large | keystone-system 16m Normal SuccessfulCreate replicaset/keystone-operator-66cf7cbc64 Created pod: keystone-operator-66cf7cbc64-w9xzs 2026-07-03 06:57:39.306345 | ubuntu-noble-large | keystone-system 16m Normal ScalingReplicaSet deployment/keystone-operator Scaled up replica set keystone-operator-66cf7cbc64 from 0 to 2 2026-07-03 06:57:39.306356 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306373 | ubuntu-noble-large | keystone-system 16m Normal Pulling pod/keystone-operator-66cf7cbc64-mtvhv Pulling image "ghcr.io/c5c3/keystone-operator:latest" 2026-07-03 06:57:39.306393 | ubuntu-noble-large | keystone-system 16m Normal cert-manager.io certificaterequest/keystone-operator-webhook-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.306403 | ubuntu-noble-large | keystone-system 16m Warning BadConfig certificaterequest/keystone-operator-webhook-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-07-03 06:57:39.306415 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306425 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306436 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306504 | ubuntu-noble-large | keystone-system 16m Normal WaitingForApproval certificaterequest/keystone-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306518 | ubuntu-noble-large | keystone-system 16m Normal Requested certificate/keystone-operator-webhook Created new CertificateRequest resource "keystone-operator-webhook-1" 2026-07-03 06:57:39.306605 | ubuntu-noble-large | keystone-system 16m Normal Issuing certificate/keystone-operator-webhook The certificate has been successfully issued 2026-07-03 06:57:39.306623 | ubuntu-noble-large | keystone-system 16m Normal CertificateIssued certificaterequest/keystone-operator-webhook-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.306642 | ubuntu-noble-large | keystone-system 16m Normal Generated certificate/keystone-operator-webhook Stored new private key in temporary Secret resource "keystone-operator-webhook-gmq2q" 2026-07-03 06:57:39.306654 | ubuntu-noble-large | keystone-system 16m Normal Pulling pod/keystone-operator-66cf7cbc64-w9xzs Pulling image "ghcr.io/c5c3/keystone-operator:latest" 2026-07-03 06:57:39.306665 | ubuntu-noble-large | c5c3-system 16m Normal DependencyNotReady helmrelease/c5c3-operator dependency 'keystone-system/keystone-operator' is not ready 2026-07-03 06:57:39.306675 | ubuntu-noble-large | openstack 16m Normal Issuing certificate/keystone-nip-io-tls Issuing certificate as Secret does not exist 2026-07-03 06:57:39.306687 | ubuntu-noble-large | keystone-system 16m Warning Unhealthy pod/keystone-operator-66cf7cbc64-mtvhv Readiness probe failed: Get "http://10.244.0.26:8081/readyz": dial tcp 10.244.0.26:8081: connect: connection refused 2026-07-03 06:57:39.306698 | ubuntu-noble-large | keystone-system 16m Normal Created pod/keystone-operator-66cf7cbc64-mtvhv Container created 2026-07-03 06:57:39.306708 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306718 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306727 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306741 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306747 | ubuntu-noble-large | openbao-system 16m Normal CertificateIssued certificaterequest/openbao-client-tls-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.306753 | ubuntu-noble-large | openbao-system 16m Normal cert-manager.io certificaterequest/openbao-client-tls-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.306759 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306765 | ubuntu-noble-large | openbao-system 16m Normal Issuing certificate/openbao-client-tls Issuing certificate as Secret does not exist 2026-07-03 06:57:39.306771 | ubuntu-noble-large | openbao-system 16m Normal Issuing certificate/eso-openbao-client-tls The certificate has been successfully issued 2026-07-03 06:57:39.306777 | ubuntu-noble-large | openbao-system 16m Normal Requested certificate/eso-openbao-client-tls Created new CertificateRequest resource "eso-openbao-client-tls-1" 2026-07-03 06:57:39.306783 | ubuntu-noble-large | openbao-system 16m Normal Generated certificate/eso-openbao-client-tls Stored new private key in temporary Secret resource "eso-openbao-client-tls-dtvpg" 2026-07-03 06:57:39.306789 | ubuntu-noble-large | openbao-system 16m Normal Issuing certificate/eso-openbao-client-tls Issuing certificate as Secret does not exist 2026-07-03 06:57:39.306794 | ubuntu-noble-large | openbao-system 16m Normal CertificateIssued certificaterequest/eso-openbao-client-tls-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.306800 | ubuntu-noble-large | openbao-system 16m Normal cert-manager.io certificaterequest/eso-openbao-client-tls-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.306810 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306821 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306828 | ubuntu-noble-large | keystone-system 16m Normal Pulled pod/keystone-operator-66cf7cbc64-mtvhv Successfully pulled image "ghcr.io/c5c3/keystone-operator:latest" in 3.578s (3.578s including waiting). Image size: 28826767 bytes. 2026-07-03 06:57:39.306834 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306840 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306846 | ubuntu-noble-large | openbao-system 16m Normal WaitingForApproval certificaterequest/eso-openbao-client-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306852 | ubuntu-noble-large | openbao-system 16m Normal Generated certificate/openbao-client-tls Stored new private key in temporary Secret resource "openbao-client-tls-bfnhj" 2026-07-03 06:57:39.306862 | ubuntu-noble-large | openbao-system 16m Normal Requested certificate/openbao-client-tls Created new CertificateRequest resource "openbao-client-tls-1" 2026-07-03 06:57:39.306868 | ubuntu-noble-large | keystone-system 16m Normal Started pod/keystone-operator-66cf7cbc64-mtvhv Container started 2026-07-03 06:57:39.306874 | ubuntu-noble-large | openstack 16m Normal Generated certificate/keystone-nip-io-tls Stored new private key in temporary Secret resource "keystone-nip-io-tls-v8h4p" 2026-07-03 06:57:39.306880 | ubuntu-noble-large | openstack 16m Normal Requested certificate/keystone-nip-io-tls Created new CertificateRequest resource "keystone-nip-io-tls-1" 2026-07-03 06:57:39.306886 | ubuntu-noble-large | keystone-system 16m Normal Started pod/keystone-operator-66cf7cbc64-w9xzs Container started 2026-07-03 06:57:39.306892 | ubuntu-noble-large | openstack 16m Normal CertificateIssued certificaterequest/keystone-nip-io-tls-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.306898 | ubuntu-noble-large | openstack 16m Normal cert-manager.io certificaterequest/keystone-nip-io-tls-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.306903 | ubuntu-noble-large | openstack 16m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306909 | ubuntu-noble-large | openstack 16m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306915 | ubuntu-noble-large | keystone-system 16m Normal Pulled pod/keystone-operator-66cf7cbc64-w9xzs Successfully pulled image "ghcr.io/c5c3/keystone-operator:latest" in 493ms (4.056s including waiting). Image size: 28826767 bytes. 2026-07-03 06:57:39.306922 | ubuntu-noble-large | keystone-system 16m Normal Created pod/keystone-operator-66cf7cbc64-w9xzs Container created 2026-07-03 06:57:39.306931 | ubuntu-noble-large | openstack 16m Warning BadConfig certificaterequest/keystone-nip-io-tls-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-07-03 06:57:39.306937 | ubuntu-noble-large | keystone-system 16m Warning Unhealthy pod/keystone-operator-66cf7cbc64-w9xzs Readiness probe failed: Get "http://10.244.0.27:8081/readyz": dial tcp 10.244.0.27:8081: connect: connection refused 2026-07-03 06:57:39.306943 | ubuntu-noble-large | openbao-system 16m Normal Issuing certificate/openbao-client-tls The certificate has been successfully issued 2026-07-03 06:57:39.306949 | ubuntu-noble-large | keystone-system 16m Normal LeaderElection lease/keystone.openstack.c5c3.io keystone-operator-66cf7cbc64-w9xzs_bd6f3f19-cb10-45c4-8696-c759bd741820 became leader 2026-07-03 06:57:39.306955 | ubuntu-noble-large | openstack 16m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306961 | ubuntu-noble-large | openstack 16m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306967 | ubuntu-noble-large | openstack 16m Normal WaitingForApproval certificaterequest/keystone-nip-io-tls-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.306978 | ubuntu-noble-large | envoy-gateway-system 16m Normal Scheduled pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Successfully assigned envoy-gateway-system/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 to forge-control-plane 2026-07-03 06:57:39.306984 | ubuntu-noble-large | openstack 16m Normal Issuing certificate/keystone-nip-io-tls The certificate has been successfully issued 2026-07-03 06:57:39.306990 | ubuntu-noble-large | envoy-gateway-system 16m Normal ScalingReplicaSet deployment/envoy-openstack-openstack-gw-b67dc6f3 Scaled up replica set envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f from 0 to 1 2026-07-03 06:57:39.306996 | ubuntu-noble-large | envoy-gateway-system 16m Normal SuccessfulCreate replicaset/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f Created pod: envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 2026-07-03 06:57:39.307005 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulling pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Pulling image "docker.io/envoyproxy/envoy:distroless-v1.38.3" 2026-07-03 06:57:39.307012 | ubuntu-noble-large | keystone-system 16m Normal InstallSucceeded helmrelease/keystone-operator Helm install succeeded for release keystone-system/keystone-operator.v1 with chart keystone-operator@0.5.0 2026-07-03 06:57:39.307018 | ubuntu-noble-large | envoy-gateway-system 16m Normal Created pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Container created 2026-07-03 06:57:39.307023 | ubuntu-noble-large | envoy-gateway-system 16m Normal Started pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Container started 2026-07-03 06:57:39.307029 | ubuntu-noble-large | envoy-gateway-system 16m Normal Created pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Container created 2026-07-03 06:57:39.307035 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulled pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Container image "docker.io/envoyproxy/gateway:v1.8.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.307041 | ubuntu-noble-large | envoy-gateway-system 16m Normal Started pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Container started 2026-07-03 06:57:39.307047 | ubuntu-noble-large | envoy-gateway-system 16m Normal Pulled pod/envoy-openstack-openstack-gw-b67dc6f3-5dbb46785f-4n5x4 Successfully pulled image "docker.io/envoyproxy/envoy:distroless-v1.38.3" in 3.41s (3.41s including waiting). Image size: 41907812 bytes. 2026-07-03 06:57:39.307053 | ubuntu-noble-large | openbao-system 16m Normal Pulling pod/openbao-0 Pulling image "quay.io/openbao/openbao:2.5.5" 2026-07-03 06:57:39.307067 | ubuntu-noble-large | openbao-system 16m Normal Pulled pod/openbao-0 Successfully pulled image "quay.io/openbao/openbao:2.5.5" in 4.648s (4.648s including waiting). Image size: 76859931 bytes. 2026-07-03 06:57:39.307074 | ubuntu-noble-large | default 16m Warning InvalidProviderConfig clustersecretstore/openbao-cluster-store unable to log in to auth method: unable to log in with Kubernetes auth: Put "https://openbao.openbao-system.svc:8200/v1/auth/kubernetes/management/login": dial tcp 10.96.114.217:8200: connect: connection refused 2026-07-03 06:57:39.307089 | ubuntu-noble-large | openbao-system 16m Normal Created pod/openbao-0 Container created 2026-07-03 06:57:39.307095 | ubuntu-noble-large | openbao-system 16m Normal Started pod/openbao-0 Container started 2026-07-03 06:57:39.307105 | ubuntu-noble-large | c5c3-system 16m Normal Issuing certificate/c5c3-operator-webhook Issuing certificate as Secret does not exist 2026-07-03 06:57:39.307111 | ubuntu-noble-large | c5c3-system 16m Normal Scheduled pod/c5c3-operator-575bfd968-8cc5s Successfully assigned c5c3-system/c5c3-operator-575bfd968-8cc5s to forge-control-plane 2026-07-03 06:57:39.307120 | ubuntu-noble-large | c5c3-system 16m Normal ScalingReplicaSet deployment/c5c3-operator Scaled up replica set c5c3-operator-575bfd968 from 0 to 2 2026-07-03 06:57:39.307126 | ubuntu-noble-large | c5c3-system 16m Normal NoPods poddisruptionbudget/c5c3-operator No matching pods found 2026-07-03 06:57:39.307132 | ubuntu-noble-large | c5c3-system 16m Normal SuccessfulCreate replicaset/c5c3-operator-575bfd968 Created pod: c5c3-operator-575bfd968-n42td 2026-07-03 06:57:39.307138 | ubuntu-noble-large | c5c3-system 16m Normal SuccessfulCreate replicaset/c5c3-operator-575bfd968 Created pod: c5c3-operator-575bfd968-8cc5s 2026-07-03 06:57:39.307143 | ubuntu-noble-large | c5c3-system 16m Normal Scheduled pod/c5c3-operator-575bfd968-n42td Successfully assigned c5c3-system/c5c3-operator-575bfd968-n42td to forge-control-plane 2026-07-03 06:57:39.307149 | ubuntu-noble-large | c5c3-system 16m Normal Requested certificate/c5c3-operator-webhook Created new CertificateRequest resource "c5c3-operator-webhook-1" 2026-07-03 06:57:39.307158 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.307164 | ubuntu-noble-large | c5c3-system 16m Normal CertificateIssued certificaterequest/c5c3-operator-webhook-1 Certificate fetched from issuer successfully 2026-07-03 06:57:39.307170 | ubuntu-noble-large | c5c3-system 16m Normal cert-manager.io certificaterequest/c5c3-operator-webhook-1 Certificate request has been approved by cert-manager.io 2026-07-03 06:57:39.307176 | ubuntu-noble-large | c5c3-system 16m Warning FailedMount pod/c5c3-operator-575bfd968-n42td MountVolume.SetUp failed for volume "webhook-certs" : secret "c5c3-operator-webhook-cert" not found 2026-07-03 06:57:39.307185 | ubuntu-noble-large | c5c3-system 16m Normal Generated certificate/c5c3-operator-webhook Stored new private key in temporary Secret resource "c5c3-operator-webhook-dsgph" 2026-07-03 06:57:39.307191 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.307197 | ubuntu-noble-large | c5c3-system 16m Warning BadConfig certificaterequest/c5c3-operator-webhook-1 Certificate will be issued with an empty Issuer DN, which contravenes RFC 5280 and could break some strict clients 2026-07-03 06:57:39.307206 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.307212 | ubuntu-noble-large | c5c3-system 16m Warning FailedMount pod/c5c3-operator-575bfd968-8cc5s MountVolume.SetUp failed for volume "webhook-certs" : secret "c5c3-operator-webhook-cert" not found 2026-07-03 06:57:39.307223 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.307232 | ubuntu-noble-large | c5c3-system 16m Normal Issuing certificate/c5c3-operator-webhook The certificate has been successfully issued 2026-07-03 06:57:39.307241 | ubuntu-noble-large | c5c3-system 16m Normal WaitingForApproval certificaterequest/c5c3-operator-webhook-1 Not signing CertificateRequest until it is Approved 2026-07-03 06:57:39.307250 | ubuntu-noble-large | c5c3-system 16m Normal Pulling pod/c5c3-operator-575bfd968-8cc5s Pulling image "ghcr.io/c5c3/c5c3-operator:latest" 2026-07-03 06:57:39.307256 | ubuntu-noble-large | c5c3-system 16m Normal Pulling pod/c5c3-operator-575bfd968-n42td Pulling image "ghcr.io/c5c3/c5c3-operator:latest" 2026-07-03 06:57:39.307266 | ubuntu-noble-large | openbao-system 16m Warning Unhealthy pod/openbao-0 Readiness probe failed: Key Value... 2026-07-03 06:57:39.307272 | ubuntu-noble-large | c5c3-system 16m Normal Started pod/c5c3-operator-575bfd968-n42td Container started 2026-07-03 06:57:39.307281 | ubuntu-noble-large | c5c3-system 16m Normal Created pod/c5c3-operator-575bfd968-n42td Container created 2026-07-03 06:57:39.307290 | ubuntu-noble-large | c5c3-system 16m Normal Pulled pod/c5c3-operator-575bfd968-n42td Successfully pulled image "ghcr.io/c5c3/c5c3-operator:latest" in 3.324s (3.324s including waiting). Image size: 28614836 bytes. 2026-07-03 06:57:39.307299 | ubuntu-noble-large | c5c3-system 16m Normal LeaderElection lease/c5c3.openstack.c5c3.io c5c3-operator-575bfd968-n42td_376616b6-0da5-4bb6-8560-0459fb1b74e7 became leader 2026-07-03 06:57:39.307308 | ubuntu-noble-large | c5c3-system 16m Normal Pulled pod/c5c3-operator-575bfd968-8cc5s Successfully pulled image "ghcr.io/c5c3/c5c3-operator:latest" in 467ms (3.775s including waiting). Image size: 28614836 bytes. 2026-07-03 06:57:39.307317 | ubuntu-noble-large | c5c3-system 16m Normal Created pod/c5c3-operator-575bfd968-8cc5s Container created 2026-07-03 06:57:39.307326 | ubuntu-noble-large | c5c3-system 15m Normal Started pod/c5c3-operator-575bfd968-8cc5s Container started 2026-07-03 06:57:39.307337 | ubuntu-noble-large | default 15m Warning InvalidProviderConfig clustersecretstore/openbao-cluster-store unable to log in to auth method: unable to log in with Kubernetes auth: Error making API request.... 2026-07-03 06:57:39.307348 | ubuntu-noble-large | c5c3-system 15m Warning Unhealthy pod/c5c3-operator-575bfd968-8cc5s Readiness probe failed: Get "http://10.244.0.30:8081/readyz": dial tcp 10.244.0.30:8081: connect: connection refused 2026-07-03 06:57:39.307364 | ubuntu-noble-large | c5c3-system 15m Normal InstallSucceeded helmrelease/c5c3-operator Helm install succeeded for release c5c3-system/c5c3-operator.v1 with chart c5c3-operator@0.3.0 2026-07-03 06:57:39.307377 | ubuntu-noble-large | openbao-system 15m Warning Unhealthy pod/openbao-0 Readiness probe failed: command timed out: "/bin/sh -ec bao status -tls-skip-verify" timed out after 3s 2026-07-03 06:57:39.307392 | ubuntu-noble-large | openstack 15m Warning UpdateFailed externalsecret/keystone-admin error processing spec.data[0] (key: bootstrap/openstack/controlplane-keystone/admin), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-07-03 06:57:39.307412 | ubuntu-noble-large | openstack 15m Warning UpdateFailed externalsecret/keystone-db error processing spec.data[0] (key: openstack/keystone/openstack/controlplane/db), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-07-03 06:57:39.307428 | ubuntu-noble-large | openbao-system 15m Warning Unhealthy pod/openbao-0 Readiness probe failed: Key Value... 2026-07-03 06:57:39.307461 | ubuntu-noble-large | openstack 15m Warning UpdateFailed externalsecret/mariadb-root-password error processing spec.data[0] (key: infrastructure/mariadb), err: ClusterSecretStore "openbao-cluster-store" is not ready 2026-07-03 06:57:39.307469 | ubuntu-noble-large | default 15m Warning InvalidProviderConfig clustersecretstore/openbao-cluster-store unable to log in to auth method: unable to log in with Kubernetes auth: Error making API request.... 2026-07-03 06:57:39.307475 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/keystone-admin secret created 2026-07-03 06:57:39.307485 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/mariadb-root-password secret created 2026-07-03 06:57:39.307491 | ubuntu-noble-large | openstack 15m Normal Created externalsecret/keystone-db secret created 2026-07-03 06:57:39.307497 | ubuntu-noble-large | openstack 15m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-0 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307503 | ubuntu-noble-large | openstack 15m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.307511 | ubuntu-noble-large | default 15m Warning OwnerRefInvalidNamespace clusterrolebinding/openstack-db-openstack-b026ebf5:auth-delegator ownerRef [k8s.mariadb.com/v1alpha1/MariaDB, namespace: , name: openstack-db, uid: b026ebf5-a2c4-42d4-96ae-6729551072b1] does not exist in namespace "" 2026-07-03 06:57:39.307538 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-9ms7j Successfully assigned openstack/openstack-memcached-f654cd846-9ms7j to forge-control-plane 2026-07-03 06:57:39.307550 | ubuntu-noble-large | openstack 15m Normal Provisioning persistentvolumeclaim/storage-openstack-db-0 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-0" 2026-07-03 06:57:39.307557 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-lq5jq Successfully assigned openstack/openstack-memcached-f654cd846-lq5jq to forge-control-plane 2026-07-03 06:57:39.307563 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate job/openstack-db-init Created pod: openstack-db-init-x4554 2026-07-03 06:57:39.307572 | ubuntu-noble-large | openstack 15m Normal ScalingReplicaSet deployment/openstack-memcached Scaled up replica set openstack-memcached-f654cd846 from 0 to 3 2026-07-03 06:57:39.307584 | ubuntu-noble-large | openstack 15m Normal Scheduled pod/openstack-memcached-f654cd846-nv658 Successfully assigned openstack/openstack-memcached-f654cd846-nv658 to forge-control-plane 2026-07-03 06:57:39.307590 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-9ms7j 2026-07-03 06:57:39.307596 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-nv658 2026-07-03 06:57:39.307605 | ubuntu-noble-large | openstack 15m Normal SuccessfulCreate replicaset/openstack-memcached-f654cd846 Created pod: openstack-memcached-f654cd846-lq5jq 2026-07-03 06:57:39.307611 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-nv658 Pulling image "memcached:1.6" 2026-07-03 06:57:39.307617 | ubuntu-noble-large | local-path-storage 15m Normal Pulled pod/helper-pod-create-pvc-8d44fcc1-feba-4082-8da8-0472bdd95ee5 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.307623 | ubuntu-noble-large | local-path-storage 15m Normal Created pod/helper-pod-create-pvc-8d44fcc1-feba-4082-8da8-0472bdd95ee5 Container created 2026-07-03 06:57:39.307634 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-lq5jq Pulling image "memcached:1.6" 2026-07-03 06:57:39.307644 | ubuntu-noble-large | openstack 15m Normal Pulling pod/openstack-memcached-f654cd846-9ms7j Pulling image "memcached:1.6" 2026-07-03 06:57:39.307655 | ubuntu-noble-large | local-path-storage 15m Normal Started pod/helper-pod-create-pvc-8d44fcc1-feba-4082-8da8-0472bdd95ee5 Container started 2026-07-03 06:57:39.307665 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-0 Successfully provisioned volume pvc-8d44fcc1-feba-4082-8da8-0472bdd95ee5 2026-07-03 06:57:39.307680 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-init-x4554 Successfully assigned openstack/openstack-db-init-x4554 to forge-control-plane 2026-07-03 06:57:39.307691 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-lq5jq Successfully pulled image "memcached:1.6" in 3.968s (3.968s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:39.307702 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-9ms7j Successfully pulled image "memcached:1.6" in 697ms (4.614s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:39.307713 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-9ms7j Container created 2026-07-03 06:57:39.307728 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-9ms7j Container started 2026-07-03 06:57:39.307739 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-lq5jq Container started 2026-07-03 06:57:39.307750 | ubuntu-noble-large | openstack 14m Normal Pulling pod/openstack-db-init-x4554 Pulling image "docker-registry1.mariadb.com/library/mariadb:11.4.5" 2026-07-03 06:57:39.307759 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-lq5jq Container created 2026-07-03 06:57:39.307778 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-memcached-f654cd846-nv658 Container created 2026-07-03 06:57:39.307784 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-memcached-f654cd846-nv658 Successfully pulled image "memcached:1.6" in 706ms (5.295s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:39.307793 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-memcached-f654cd846-nv658 Container started 2026-07-03 06:57:39.307800 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-init-x4554 Successfully pulled image "docker-registry1.mariadb.com/library/mariadb:11.4.5" in 6.741s (7.694s including waiting). Image size: 104480028 bytes. 2026-07-03 06:57:39.307806 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-init-x4554 Container started 2026-07-03 06:57:39.307812 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-init-x4554 Container created 2026-07-03 06:57:39.307820 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-1 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307826 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-0 Pod openstack-db-0 in StatefulSet openstack-db success 2026-07-03 06:57:39.307833 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-0 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307850 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-0 in StatefulSet openstack-db successful 2026-07-03 06:57:39.307856 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim storage-openstack-db-1 Pod openstack-db-1 in StatefulSet openstack-db success 2026-07-03 06:57:39.307865 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-2 Pod openstack-db-2 in StatefulSet openstack-db success 2026-07-03 06:57:39.307871 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim galera-openstack-db-1 Pod openstack-db-1 in StatefulSet openstack-db success 2026-07-03 06:57:39.307878 | ubuntu-noble-large | openstack 14m Normal NoPods poddisruptionbudget/openstack-db No matching pods found 2026-07-03 06:57:39.307887 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-1 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307893 | ubuntu-noble-large | openstack 14m Normal Completed job/openstack-db-init Job completed 2026-07-03 06:57:39.307901 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/storage-openstack-db-2 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307908 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Claim storage-openstack-db-2 Pod openstack-db-2 in StatefulSet openstack-db success 2026-07-03 06:57:39.307921 | ubuntu-noble-large | openstack 14m Normal WaitForFirstConsumer persistentvolumeclaim/galera-openstack-db-2 waiting for first consumer to be created before binding 2026-07-03 06:57:39.307927 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-0 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.307936 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-23f79fc4-9e9a-4a55-bbd4-e54f92c721f9 Container created 2026-07-03 06:57:39.307943 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-da26abb8-3ac4-41e9-baf7-80b092fc425e Container started 2026-07-03 06:57:39.307951 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-da26abb8-3ac4-41e9-baf7-80b092fc425e Container created 2026-07-03 06:57:39.307957 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-da26abb8-3ac4-41e9-baf7-80b092fc425e Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.307966 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-23f79fc4-9e9a-4a55-bbd4-e54f92c721f9 Container started 2026-07-03 06:57:39.307972 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-23f79fc4-9e9a-4a55-bbd4-e54f92c721f9 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.307981 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/storage-openstack-db-1 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-1" 2026-07-03 06:57:39.307987 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-0 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-0" 2026-07-03 06:57:39.308000 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-7afaff50-64b6-4f1e-be92-e8b3b598da76 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308007 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-7afaff50-64b6-4f1e-be92-e8b3b598da76 Container created 2026-07-03 06:57:39.308016 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-2 in StatefulSet openstack-db successful 2026-07-03 06:57:39.308025 | ubuntu-noble-large | openstack 14m Normal SuccessfulCreate statefulset/openstack-db Create Pod openstack-db-1 in StatefulSet openstack-db successful 2026-07-03 06:57:39.308031 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-7afaff50-64b6-4f1e-be92-e8b3b598da76 Container started 2026-07-03 06:57:39.308040 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-2 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-2" 2026-07-03 06:57:39.308049 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/galera-openstack-db-1 External provisioner is provisioning volume for claim "openstack/galera-openstack-db-1" 2026-07-03 06:57:39.308062 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-1 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.308069 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-60b0f8d2-9594-4263-b9e4-e7fe99f8e321 Container started 2026-07-03 06:57:39.308077 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-60b0f8d2-9594-4263-b9e4-e7fe99f8e321 Container created 2026-07-03 06:57:39.308084 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-60b0f8d2-9594-4263-b9e4-e7fe99f8e321 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308093 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-0 Successfully provisioned volume pvc-23f79fc4-9e9a-4a55-bbd4-e54f92c721f9 2026-07-03 06:57:39.308099 | ubuntu-noble-large | openstack 14m Normal Provisioning persistentvolumeclaim/storage-openstack-db-2 External provisioner is provisioning volume for claim "openstack/storage-openstack-db-2" 2026-07-03 06:57:39.308108 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-0 Successfully assigned openstack/openstack-db-0 to forge-control-plane 2026-07-03 06:57:39.308116 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-07-03 06:57:39.308125 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-07-03 06:57:39.308139 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308152 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308161 | ubuntu-noble-large | local-path-storage 14m Normal Created pod/helper-pod-create-pvc-9873b6f6-eaff-4295-a5ef-2d687277b174 Container created 2026-07-03 06:57:39.308177 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-07-03 06:57:39.308186 | ubuntu-noble-large | local-path-storage 14m Normal Started pod/helper-pod-create-pvc-9873b6f6-eaff-4295-a5ef-2d687277b174 Container started 2026-07-03 06:57:39.308195 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-07-03 06:57:39.308205 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-2 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.308218 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-0 Container started 2026-07-03 06:57:39.308227 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/storage-openstack-db-1 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.308236 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-1 Successfully provisioned volume pvc-7afaff50-64b6-4f1e-be92-e8b3b598da76 2026-07-03 06:57:39.308245 | ubuntu-noble-large | openstack 14m Normal ExternalProvisioning persistentvolumeclaim/galera-openstack-db-2 Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2026-07-03 06:57:39.308255 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-0 Container created 2026-07-03 06:57:39.308264 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-0 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308274 | ubuntu-noble-large | local-path-storage 14m Normal Pulled pod/helper-pod-create-pvc-9873b6f6-eaff-4295-a5ef-2d687277b174 Container image "docker.io/kindest/local-path-helper:v20260131-7181c60a" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308283 | ubuntu-noble-large | openstack 14m Warning Unhealthy pod/openstack-db-0 Readiness probe failed: Get "http://10.244.0.41:5566/health": dial tcp 10.244.0.41:5566: connect: connection refused 2026-07-03 06:57:39.308292 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/galera-openstack-db-2 Successfully provisioned volume pvc-60b0f8d2-9594-4263-b9e4-e7fe99f8e321 2026-07-03 06:57:39.308301 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-1 Successfully provisioned volume pvc-da26abb8-3ac4-41e9-baf7-80b092fc425e 2026-07-03 06:57:39.308310 | ubuntu-noble-large | openstack 14m Normal ProvisioningSucceeded persistentvolumeclaim/storage-openstack-db-2 Successfully provisioned volume pvc-9873b6f6-eaff-4295-a5ef-2d687277b174 2026-07-03 06:57:39.308321 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-1 Container started 2026-07-03 06:57:39.308334 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-1 Container created 2026-07-03 06:57:39.308347 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-1 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308368 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-1 Successfully assigned openstack/openstack-db-1 to forge-control-plane 2026-07-03 06:57:39.308377 | ubuntu-noble-large | openstack 14m Normal Scheduled pod/openstack-db-2 Successfully assigned openstack/openstack-db-2 to forge-control-plane 2026-07-03 06:57:39.308390 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-2 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308399 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-2 Container created 2026-07-03 06:57:39.308408 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-2 Container started 2026-07-03 06:57:39.308417 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-1 Container started 2026-07-03 06:57:39.308428 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-1 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308458 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-1 Container created 2026-07-03 06:57:39.308490 | ubuntu-noble-large | openstack 14m Normal Pulled pod/openstack-db-1 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308499 | ubuntu-noble-large | openstack 14m Normal Created pod/openstack-db-1 Container created 2026-07-03 06:57:39.308510 | ubuntu-noble-large | openstack 14m Normal Started pod/openstack-db-1 Container started 2026-07-03 06:57:39.308539 | ubuntu-noble-large | openstack 14m Warning Unhealthy pod/openstack-db-1 Readiness probe failed: Get "http://10.244.0.43:5566/health": dial tcp 10.244.0.43:5566: connect: connection refused 2026-07-03 06:57:39.308552 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-1 Startup probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:39.308574 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-2 Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308593 | ubuntu-noble-large | openstack 13m Normal Pulled pod/openstack-db-2 Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308608 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-2 Container created 2026-07-03 06:57:39.308627 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-2 Container started 2026-07-03 06:57:39.308654 | ubuntu-noble-large | openstack 13m Normal Started pod/openstack-db-2 Container started 2026-07-03 06:57:39.308676 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-2 Readiness probe failed: Get "http://10.244.0.44:5566/health": dial tcp 10.244.0.44:5566: connect: connection refused 2026-07-03 06:57:39.308694 | ubuntu-noble-large | openstack 13m Normal Created pod/openstack-db-2 Container created 2026-07-03 06:57:39.308709 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-2 Startup probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:39.308724 | ubuntu-noble-large | openstack 13m Warning Unhealthy pod/openstack-db-0 Readiness probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:39.308735 | ubuntu-noble-large | openstack 12m Normal Created externalsecret/controlplane-keystone-db-credentials secret created 2026-07-03 06:57:39.308749 | ubuntu-noble-large | openstack 12m Normal GaleraClusterHealthy mariadb/openstack-db Galera cluster is healthy 2026-07-03 06:57:39.308760 | ubuntu-noble-large | openstack 12m Normal CredentialKeysGenerated keystone/controlplane-keystone Initial credential encryption keys have been generated 2026-07-03 06:57:39.308773 | ubuntu-noble-large | openstack 12m Normal FernetKeysGenerated keystone/controlplane-keystone Initial Fernet encryption keys have been generated 2026-07-03 06:57:39.308784 | ubuntu-noble-large | openstack 12m Normal Created externalsecret/controlplane-keystone-admin-credentials secret created 2026-07-03 06:57:39.308800 | ubuntu-noble-large | openstack 12m Normal Synced pushsecret/controlplane-keystone-credential-keys-backup PushSecret synced successfully 2026-07-03 06:57:39.308811 | ubuntu-noble-large | openstack 12m Normal Synced pushsecret/controlplane-keystone-fernet-keys-backup PushSecret synced successfully 2026-07-03 06:57:39.308825 | ubuntu-noble-large | openstack 12m Normal Scheduled pod/controlplane-keystone-db-sync-xt5jh Successfully assigned openstack/controlplane-keystone-db-sync-xt5jh to forge-control-plane 2026-07-03 06:57:39.308837 | ubuntu-noble-large | openstack 12m Normal SuccessfulCreate job/controlplane-keystone-db-sync Created pod: controlplane-keystone-db-sync-xt5jh 2026-07-03 06:57:39.308847 | ubuntu-noble-large | openstack 12m Normal Pulling pod/controlplane-keystone-db-sync-xt5jh Pulling image "ghcr.io/c5c3/keystone:2025.2" 2026-07-03 06:57:39.308861 | ubuntu-noble-large | openstack 12m Normal Pulled pod/controlplane-keystone-db-sync-xt5jh Successfully pulled image "ghcr.io/c5c3/keystone:2025.2" in 9.107s (9.108s including waiting). Image size: 111505124 bytes. 2026-07-03 06:57:39.308868 | ubuntu-noble-large | openstack 12m Normal Created pod/controlplane-keystone-db-sync-xt5jh Container created 2026-07-03 06:57:39.308897 | ubuntu-noble-large | openstack 12m Normal Started pod/controlplane-keystone-db-sync-xt5jh Container started 2026-07-03 06:57:39.308907 | ubuntu-noble-large | openstack 12m Normal Completed job/controlplane-keystone-db-sync Job completed 2026-07-03 06:57:39.308913 | ubuntu-noble-large | openstack 12m Normal Scheduled pod/controlplane-keystone-schema-check-wg5rb Successfully assigned openstack/controlplane-keystone-schema-check-wg5rb to forge-control-plane 2026-07-03 06:57:39.308920 | ubuntu-noble-large | openstack 12m Normal SuccessfulCreate job/controlplane-keystone-schema-check Created pod: controlplane-keystone-schema-check-wg5rb 2026-07-03 06:57:39.308935 | ubuntu-noble-large | openstack 12m Normal Pulled pod/controlplane-keystone-schema-check-wg5rb Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.308942 | ubuntu-noble-large | openstack 12m Normal Created pod/controlplane-keystone-schema-check-wg5rb Container created 2026-07-03 06:57:39.308948 | ubuntu-noble-large | openstack 12m Normal Started pod/controlplane-keystone-schema-check-wg5rb Container started 2026-07-03 06:57:39.308960 | ubuntu-noble-large | openstack 11m Normal ScalingReplicaSet deployment/controlplane-keystone Scaled up replica set controlplane-keystone-6d68dcd67c from 0 to 1 2026-07-03 06:57:39.308966 | ubuntu-noble-large | openstack 11m Normal SuccessfulCreate replicaset/controlplane-keystone-6d68dcd67c Created pod: controlplane-keystone-6d68dcd67c-6l6p9 2026-07-03 06:57:39.308972 | ubuntu-noble-large | openstack 11m Normal Completed job/controlplane-keystone-schema-check Job completed 2026-07-03 06:57:39.308981 | ubuntu-noble-large | openstack 11m Normal Scheduled pod/controlplane-keystone-6d68dcd67c-6l6p9 Successfully assigned openstack/controlplane-keystone-6d68dcd67c-6l6p9 to forge-control-plane 2026-07-03 06:57:39.308988 | ubuntu-noble-large | openstack 5m31s Warning Unhealthy pod/controlplane-keystone-6d68dcd67c-6l6p9 Startup probe failed: Get "http://10.244.0.47:5000/v3": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-07-03 06:57:39.308994 | ubuntu-noble-large | openstack 2m54s Normal DatabaseSynced keystone/controlplane-keystone Database schema is up to date 2026-07-03 06:57:39.309003 | ubuntu-noble-large | openstack 20s Normal Started pod/controlplane-keystone-6d68dcd67c-6l6p9 Container started 2026-07-03 06:57:39.309009 | ubuntu-noble-large | openstack 20s Normal Created pod/controlplane-keystone-6d68dcd67c-6l6p9 Container created 2026-07-03 06:57:39.309018 | ubuntu-noble-large | openstack 20s Normal Pulled pod/controlplane-keystone-6d68dcd67c-6l6p9 Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.309024 | ubuntu-noble-large | openstack 15s Warning BackOff pod/controlplane-keystone-6d68dcd67c-6l6p9 Back-off restarting failed container keystone in pod controlplane-keystone-6d68dcd67c-6l6p9_openstack(4096fdc2-ea12-432d-9041-3bab9b5a9000) 2026-07-03 06:57:39.309033 | ubuntu-noble-large | default 14s Normal Valid clustersecretstore/openbao-cluster-store store validated 2026-07-03 06:57:39.314690 | ubuntu-noble-large | === Pod descriptions and logs in namespace openstack === 2026-07-03 06:57:39.479030 | ubuntu-noble-large | --- describe pod/controlplane-keystone-6d68dcd67c-6l6p9 --- 2026-07-03 06:57:39.616042 | ubuntu-noble-large | Name: controlplane-keystone-6d68dcd67c-6l6p9 2026-07-03 06:57:39.616130 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:39.616144 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:39.616155 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:39.616165 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:39.616176 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:45:46 +0000 2026-07-03 06:57:39.616186 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=controlplane-keystone 2026-07-03 06:57:39.616198 | ubuntu-noble-large | app.kubernetes.io/managed-by=keystone-operator 2026-07-03 06:57:39.616231 | ubuntu-noble-large | app.kubernetes.io/name=keystone 2026-07-03 06:57:39.616242 | ubuntu-noble-large | pod-template-hash=6d68dcd67c 2026-07-03 06:57:39.616252 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:39.616262 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:39.616271 | ubuntu-noble-large | IP: 10.244.0.47 2026-07-03 06:57:39.616281 | ubuntu-noble-large | IPs: 2026-07-03 06:57:39.616292 | ubuntu-noble-large | IP: 10.244.0.47 2026-07-03 06:57:39.616302 | ubuntu-noble-large | Controlled By: ReplicaSet/controlplane-keystone-6d68dcd67c 2026-07-03 06:57:39.616312 | ubuntu-noble-large | Containers: 2026-07-03 06:57:39.616321 | ubuntu-noble-large | keystone: 2026-07-03 06:57:39.616331 | ubuntu-noble-large | Container ID: containerd://aed3aefac187fa2784bb42e81db44b25de1cee0c4aed75250e36e38f126201b3 2026-07-03 06:57:39.616341 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-07-03 06:57:39.616352 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:fecb7b2fa7d6acb68460965207f93f6d92ba64df880b7d3e303bbf87a6f7db35 2026-07-03 06:57:39.616362 | ubuntu-noble-large | Port: 5000/TCP (keystone) 2026-07-03 06:57:39.616372 | ubuntu-noble-large | Host Port: 0/TCP (keystone) 2026-07-03 06:57:39.616381 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-07-03 06:57:39.616391 | ubuntu-noble-large | Command: 2026-07-03 06:57:39.616401 | ubuntu-noble-large | uwsgi 2026-07-03 06:57:39.616411 | ubuntu-noble-large | --http 2026-07-03 06:57:39.616420 | ubuntu-noble-large | :5000 2026-07-03 06:57:39.616430 | ubuntu-noble-large | --http-keepalive 2026-07-03 06:57:39.616440 | ubuntu-noble-large | --log-master 2026-07-03 06:57:39.616474 | ubuntu-noble-large | --log-format 2026-07-03 06:57:39.616484 | ubuntu-noble-large | %(method) %(uri) => generated %(rsize) bytes in %(msecs) msecs (%(proto) %(status)) 2026-07-03 06:57:39.616494 | ubuntu-noble-large | --wsgi-file 2026-07-03 06:57:39.616503 | ubuntu-noble-large | /var/lib/openstack/bin/keystone-wsgi-public 2026-07-03 06:57:39.616513 | ubuntu-noble-large | --master 2026-07-03 06:57:39.616563 | ubuntu-noble-large | --lazy-apps 2026-07-03 06:57:39.616575 | ubuntu-noble-large | --need-app 2026-07-03 06:57:39.616585 | ubuntu-noble-large | --processes 2026-07-03 06:57:39.616594 | ubuntu-noble-large | 2 2026-07-03 06:57:39.616604 | ubuntu-noble-large | --threads 2026-07-03 06:57:39.616614 | ubuntu-noble-large | 1 2026-07-03 06:57:39.616624 | ubuntu-noble-large | --pyargv=--config-dir=/etc/keystone/keystone.conf.d/ 2026-07-03 06:57:39.616634 | ubuntu-noble-large | State: Waiting 2026-07-03 06:57:39.616644 | ubuntu-noble-large | Reason: CrashLoopBackOff 2026-07-03 06:57:39.616654 | ubuntu-noble-large | Last State: Terminated 2026-07-03 06:57:39.616663 | ubuntu-noble-large | Reason: OOMKilled 2026-07-03 06:57:39.616673 | ubuntu-noble-large | Exit Code: 137 2026-07-03 06:57:39.616682 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:57:19 +0000 2026-07-03 06:57:39.616692 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:57:23 +0000 2026-07-03 06:57:39.616701 | ubuntu-noble-large | Ready: False 2026-07-03 06:57:39.616711 | ubuntu-noble-large | Restart Count: 7 2026-07-03 06:57:39.616721 | ubuntu-noble-large | Limits: 2026-07-03 06:57:39.616730 | ubuntu-noble-large | cpu: 500m 2026-07-03 06:57:39.616740 | ubuntu-noble-large | memory: 512Mi 2026-07-03 06:57:39.616749 | ubuntu-noble-large | Requests: 2026-07-03 06:57:39.616759 | ubuntu-noble-large | cpu: 100m 2026-07-03 06:57:39.616768 | ubuntu-noble-large | memory: 256Mi 2026-07-03 06:57:39.616779 | ubuntu-noble-large | Liveness: tcp-socket :5000 delay=15s timeout=1s period=20s #success=1 #failure=3 2026-07-03 06:57:39.616791 | ubuntu-noble-large | Readiness: exec [/bin/sh -c python3 -c "import os,socket; from urllib.parse import urlparse; raw=os.environ.get('OS_DATABASE__CONNECTION',''); u=urlparse('//'+raw.split('://',1)[-1]); socket.create_connection((u.hostname, u.port or 3306), 20).close()"] delay=10s timeout=25s period=30s #success=1 #failure=3 2026-07-03 06:57:39.616803 | ubuntu-noble-large | Startup: http-get http://:5000/v3 delay=0s timeout=1s period=10s #success=1 #failure=30 2026-07-03 06:57:39.616813 | ubuntu-noble-large | Environment: 2026-07-03 06:57:39.616823 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-07-03 06:57:39.616833 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:39.616842 | ubuntu-noble-large | /etc/keystone/credential-keys/ from credential-keys (ro) 2026-07-03 06:57:39.616852 | ubuntu-noble-large | /etc/keystone/fernet-keys/ from fernet-keys (ro) 2026-07-03 06:57:39.616862 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-07-03 06:57:39.616871 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-62cbm (ro) 2026-07-03 06:57:39.616890 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:39.616900 | ubuntu-noble-large | Type Status 2026-07-03 06:57:39.616909 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:39.616919 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:39.616928 | ubuntu-noble-large | Ready False 2026-07-03 06:57:39.616938 | ubuntu-noble-large | ContainersReady False 2026-07-03 06:57:39.616947 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:39.616957 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:39.616967 | ubuntu-noble-large | config: 2026-07-03 06:57:39.616976 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-07-03 06:57:39.616986 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-07-03 06:57:39.616996 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:39.617005 | ubuntu-noble-large | fernet-keys: 2026-07-03 06:57:39.617015 | ubuntu-noble-large | Type: Secret (a volume populated by a Secret) 2026-07-03 06:57:39.617024 | ubuntu-noble-large | SecretName: controlplane-keystone-fernet-keys 2026-07-03 06:57:39.617034 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:39.617044 | ubuntu-noble-large | credential-keys: 2026-07-03 06:57:39.617053 | ubuntu-noble-large | Type: Secret (a volume populated by a Secret) 2026-07-03 06:57:39.617063 | ubuntu-noble-large | SecretName: controlplane-keystone-credential-keys 2026-07-03 06:57:39.617073 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:39.617082 | ubuntu-noble-large | kube-api-access-62cbm: 2026-07-03 06:57:39.617092 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:39.617102 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:39.617112 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:39.617121 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:39.617131 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:39.617140 | ubuntu-noble-large | QoS Class: Burstable 2026-07-03 06:57:39.617150 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:39.617159 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:39.617169 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:39.617194 | ubuntu-noble-large | Topology Spread Constraints: kubernetes.io/hostname:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/instance=controlplane-keystone,app.kubernetes.io/name=keystone 2026-07-03 06:57:39.617208 | ubuntu-noble-large | topology.kubernetes.io/zone:ScheduleAnyway when max skew 1 is exceeded for selector app.kubernetes.io/instance=controlplane-keystone,app.kubernetes.io/name=keystone 2026-07-03 06:57:39.617219 | ubuntu-noble-large | Events: 2026-07-03 06:57:39.617228 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:39.617238 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:39.617248 | ubuntu-noble-large | Normal Scheduled 11m default-scheduler Successfully assigned openstack/controlplane-keystone-6d68dcd67c-6l6p9 to forge-control-plane 2026-07-03 06:57:39.617258 | ubuntu-noble-large | Warning Unhealthy 5m31s (x3 over 11m) kubelet spec.containers{keystone}: Startup probe failed: Get "http://10.244.0.47:5000/v3": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-07-03 06:57:39.617269 | ubuntu-noble-large | Normal Pulled 20s (x8 over 11m) kubelet spec.containers{keystone}: Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:39.617278 | ubuntu-noble-large | Normal Created 20s (x8 over 11m) kubelet spec.containers{keystone}: Container created 2026-07-03 06:57:39.617288 | ubuntu-noble-large | Normal Started 20s (x8 over 11m) kubelet spec.containers{keystone}: Container started 2026-07-03 06:57:39.617299 | ubuntu-noble-large | Warning BackOff 15s (x24 over 11m) kubelet spec.containers{keystone}: Back-off restarting failed container keystone in pod controlplane-keystone-6d68dcd67c-6l6p9_openstack(4096fdc2-ea12-432d-9041-3bab9b5a9000) 2026-07-03 06:57:39.621949 | ubuntu-noble-large | --- logs pod/controlplane-keystone-6d68dcd67c-6l6p9 (current) --- 2026-07-03 06:57:39.779973 | ubuntu-noble-large | *** Starting uWSGI 2.0.31 (64bit) on [Fri Jul 3 06:57:19 2026] *** 2026-07-03 06:57:39.780076 | ubuntu-noble-large | compiled with version: 13.3.0 on 26 June 2026 06:54:41 2026-07-03 06:57:39.780088 | ubuntu-noble-large | os: Linux-6.8.0-134-generic #134-Ubuntu SMP PREEMPT_DYNAMIC Fri Jun 26 18:43:11 UTC 2026 2026-07-03 06:57:39.780097 | ubuntu-noble-large | nodename: controlplane-keystone-6d68dcd67c-6l6p9 2026-07-03 06:57:39.780105 | ubuntu-noble-large | machine: x86_64 2026-07-03 06:57:39.780112 | ubuntu-noble-large | clock source: unix 2026-07-03 06:57:39.780120 | ubuntu-noble-large | detected number of CPU cores: 8 2026-07-03 06:57:39.780127 | ubuntu-noble-large | current working directory: / 2026-07-03 06:57:39.780134 | ubuntu-noble-large | detected binary path: /var/lib/openstack/bin/uwsgi 2026-07-03 06:57:39.780155 | ubuntu-noble-large | !!! no internal routing support, rebuild with pcre support !!! 2026-07-03 06:57:39.780162 | ubuntu-noble-large | your memory page size is 4096 bytes 2026-07-03 06:57:39.780169 | ubuntu-noble-large | detected max file descriptor number: 1073741816 2026-07-03 06:57:39.780176 | ubuntu-noble-large | lock engine: pthread robust mutexes 2026-07-03 06:57:39.780183 | ubuntu-noble-large | thunder lock: disabled (you can enable it with --thunder-lock) 2026-07-03 06:57:39.780190 | ubuntu-noble-large | uWSGI http bound on :5000 fd 7 2026-07-03 06:57:39.780197 | ubuntu-noble-large | uwsgi socket 0 bound to TCP address 127.0.0.1:46189 (port auto-assigned) fd 6 2026-07-03 06:57:39.780204 | ubuntu-noble-large | Python version: 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0] 2026-07-03 06:57:39.780211 | ubuntu-noble-large | Python main interpreter initialized at 0x713c6dd27668 2026-07-03 06:57:39.780227 | ubuntu-noble-large | python threads support enabled 2026-07-03 06:57:39.780234 | ubuntu-noble-large | your server socket listen backlog is limited to 100 connections 2026-07-03 06:57:39.780241 | ubuntu-noble-large | your mercy for graceful operations on workers is 60 seconds 2026-07-03 06:57:39.780248 | ubuntu-noble-large | mapped 218760 bytes (213 KB) for 2 cores 2026-07-03 06:57:39.780256 | ubuntu-noble-large | *** Operational MODE: preforking *** 2026-07-03 06:57:39.780263 | ubuntu-noble-large | *** uWSGI is running in multiple interpreter mode *** 2026-07-03 06:57:39.780270 | ubuntu-noble-large | spawned uWSGI master process (pid: 1) 2026-07-03 06:57:39.780277 | ubuntu-noble-large | spawned uWSGI worker 1 (pid: 14, cores: 1) 2026-07-03 06:57:39.780284 | ubuntu-noble-large | spawned uWSGI worker 2 (pid: 15, cores: 1) 2026-07-03 06:57:39.780291 | ubuntu-noble-large | spawned uWSGI http 1 (pid: 16) 2026-07-03 06:57:39.785185 | ubuntu-noble-large | --- logs pod/controlplane-keystone-6d68dcd67c-6l6p9 (previous) --- 2026-07-03 06:57:39.935024 | ubuntu-noble-large | *** Starting uWSGI 2.0.31 (64bit) on [Fri Jul 3 06:57:19 2026] *** 2026-07-03 06:57:39.935101 | ubuntu-noble-large | compiled with version: 13.3.0 on 26 June 2026 06:54:41 2026-07-03 06:57:39.935112 | ubuntu-noble-large | os: Linux-6.8.0-134-generic #134-Ubuntu SMP PREEMPT_DYNAMIC Fri Jun 26 18:43:11 UTC 2026 2026-07-03 06:57:39.935121 | ubuntu-noble-large | nodename: controlplane-keystone-6d68dcd67c-6l6p9 2026-07-03 06:57:39.935129 | ubuntu-noble-large | machine: x86_64 2026-07-03 06:57:39.935137 | ubuntu-noble-large | clock source: unix 2026-07-03 06:57:39.935144 | ubuntu-noble-large | detected number of CPU cores: 8 2026-07-03 06:57:39.935380 | ubuntu-noble-large | current working directory: / 2026-07-03 06:57:39.935411 | ubuntu-noble-large | detected binary path: /var/lib/openstack/bin/uwsgi 2026-07-03 06:57:39.935429 | ubuntu-noble-large | !!! no internal routing support, rebuild with pcre support !!! 2026-07-03 06:57:39.935437 | ubuntu-noble-large | your memory page size is 4096 bytes 2026-07-03 06:57:39.935468 | ubuntu-noble-large | detected max file descriptor number: 1073741816 2026-07-03 06:57:39.935476 | ubuntu-noble-large | lock engine: pthread robust mutexes 2026-07-03 06:57:39.935605 | ubuntu-noble-large | thunder lock: disabled (you can enable it with --thunder-lock) 2026-07-03 06:57:39.935613 | ubuntu-noble-large | uWSGI http bound on :5000 fd 7 2026-07-03 06:57:39.935621 | ubuntu-noble-large | uwsgi socket 0 bound to TCP address 127.0.0.1:46189 (port auto-assigned) fd 6 2026-07-03 06:57:39.935629 | ubuntu-noble-large | Python version: 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0] 2026-07-03 06:57:39.935636 | ubuntu-noble-large | Python main interpreter initialized at 0x713c6dd27668 2026-07-03 06:57:39.935643 | ubuntu-noble-large | python threads support enabled 2026-07-03 06:57:39.935651 | ubuntu-noble-large | your server socket listen backlog is limited to 100 connections 2026-07-03 06:57:39.935658 | ubuntu-noble-large | your mercy for graceful operations on workers is 60 seconds 2026-07-03 06:57:39.935666 | ubuntu-noble-large | mapped 218760 bytes (213 KB) for 2 cores 2026-07-03 06:57:39.935673 | ubuntu-noble-large | *** Operational MODE: preforking *** 2026-07-03 06:57:39.935680 | ubuntu-noble-large | *** uWSGI is running in multiple interpreter mode *** 2026-07-03 06:57:39.935687 | ubuntu-noble-large | spawned uWSGI master process (pid: 1) 2026-07-03 06:57:39.935719 | ubuntu-noble-large | spawned uWSGI worker 1 (pid: 14, cores: 1) 2026-07-03 06:57:39.935727 | ubuntu-noble-large | spawned uWSGI worker 2 (pid: 15, cores: 1) 2026-07-03 06:57:39.935734 | ubuntu-noble-large | spawned uWSGI http 1 (pid: 16) 2026-07-03 06:57:39.941010 | ubuntu-noble-large | --- describe pod/controlplane-keystone-db-sync-xt5jh --- 2026-07-03 06:57:40.074152 | ubuntu-noble-large | Name: controlplane-keystone-db-sync-xt5jh 2026-07-03 06:57:40.074217 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:40.074225 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:40.074229 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:40.074234 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:40.074239 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:45:13 +0000 2026-07-03 06:57:40.074244 | ubuntu-noble-large | Labels: batch.kubernetes.io/controller-uid=c9104837-e309-4501-9bd4-c7595498c31a 2026-07-03 06:57:40.074250 | ubuntu-noble-large | batch.kubernetes.io/job-name=controlplane-keystone-db-sync 2026-07-03 06:57:40.074255 | ubuntu-noble-large | controller-uid=c9104837-e309-4501-9bd4-c7595498c31a 2026-07-03 06:57:40.074259 | ubuntu-noble-large | job-name=controlplane-keystone-db-sync 2026-07-03 06:57:40.074264 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:40.074268 | ubuntu-noble-large | Status: Succeeded 2026-07-03 06:57:40.074272 | ubuntu-noble-large | IP: 10.244.0.45 2026-07-03 06:57:40.074276 | ubuntu-noble-large | IPs: 2026-07-03 06:57:40.074280 | ubuntu-noble-large | IP: 10.244.0.45 2026-07-03 06:57:40.074284 | ubuntu-noble-large | Controlled By: Job/controlplane-keystone-db-sync 2026-07-03 06:57:40.074288 | ubuntu-noble-large | Containers: 2026-07-03 06:57:40.074292 | ubuntu-noble-large | db-sync: 2026-07-03 06:57:40.074297 | ubuntu-noble-large | Container ID: containerd://7547c10661b46b81c591b97bf5e8c74f5e941e17f902e0c4f0ae8d3e2be1c7bc 2026-07-03 06:57:40.074301 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-07-03 06:57:40.074305 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:fecb7b2fa7d6acb68460965207f93f6d92ba64df880b7d3e303bbf87a6f7db35 2026-07-03 06:57:40.074309 | ubuntu-noble-large | Port: 2026-07-03 06:57:40.074313 | ubuntu-noble-large | Host Port: 2026-07-03 06:57:40.074317 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-07-03 06:57:40.074322 | ubuntu-noble-large | Command: 2026-07-03 06:57:40.074326 | ubuntu-noble-large | keystone-manage 2026-07-03 06:57:40.074330 | ubuntu-noble-large | --config-dir=/etc/keystone/keystone.conf.d/ 2026-07-03 06:57:40.074334 | ubuntu-noble-large | db_sync 2026-07-03 06:57:40.074338 | ubuntu-noble-large | State: Terminated 2026-07-03 06:57:40.074342 | ubuntu-noble-large | Reason: Completed 2026-07-03 06:57:40.074346 | ubuntu-noble-large | Exit Code: 0 2026-07-03 06:57:40.074350 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:45:23 +0000 2026-07-03 06:57:40.074354 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:45:33 +0000 2026-07-03 06:57:40.074358 | ubuntu-noble-large | Ready: False 2026-07-03 06:57:40.074362 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:40.074366 | ubuntu-noble-large | Environment: 2026-07-03 06:57:40.074371 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-07-03 06:57:40.074375 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:40.074379 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-07-03 06:57:40.074383 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-97q8l (ro) 2026-07-03 06:57:40.074387 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:40.074391 | ubuntu-noble-large | Type Status 2026-07-03 06:57:40.074405 | ubuntu-noble-large | PodReadyToStartContainers False 2026-07-03 06:57:40.074409 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:40.074413 | ubuntu-noble-large | Ready False 2026-07-03 06:57:40.074417 | ubuntu-noble-large | ContainersReady False 2026-07-03 06:57:40.074421 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:40.074426 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:40.074430 | ubuntu-noble-large | config: 2026-07-03 06:57:40.074434 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-07-03 06:57:40.074438 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-07-03 06:57:40.074465 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.074471 | ubuntu-noble-large | kube-api-access-97q8l: 2026-07-03 06:57:40.074478 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:40.074504 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:40.074512 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:40.074541 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.074567 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:40.074572 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:40.074576 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:40.074580 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:40.074584 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:40.074588 | ubuntu-noble-large | Events: 2026-07-03 06:57:40.074592 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:40.074596 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:40.074601 | ubuntu-noble-large | Normal Scheduled 12m default-scheduler Successfully assigned openstack/controlplane-keystone-db-sync-xt5jh to forge-control-plane 2026-07-03 06:57:40.074607 | ubuntu-noble-large | Normal Pulling 12m kubelet spec.containers{db-sync}: Pulling image "ghcr.io/c5c3/keystone:2025.2" 2026-07-03 06:57:40.074612 | ubuntu-noble-large | Normal Pulled 12m kubelet spec.containers{db-sync}: Successfully pulled image "ghcr.io/c5c3/keystone:2025.2" in 9.107s (9.108s including waiting). Image size: 111505124 bytes. 2026-07-03 06:57:40.074617 | ubuntu-noble-large | Normal Created 12m kubelet spec.containers{db-sync}: Container created 2026-07-03 06:57:40.074621 | ubuntu-noble-large | Normal Started 12m kubelet spec.containers{db-sync}: Container started 2026-07-03 06:57:40.080287 | ubuntu-noble-large | --- logs pod/controlplane-keystone-db-sync-xt5jh (current) --- 2026-07-03 06:57:40.186140 | ubuntu-noble-large | Config file not found, using default configs. 2026-07-03 06:57:40.186221 | ubuntu-noble-large | 2026-07-03 06:45:29.753 1 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-07-03 06:57:40.186235 | ubuntu-noble-large | 2026-07-03 06:45:29.754 1 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-07-03 06:57:40.186245 | ubuntu-noble-large | 2026-07-03 06:45:29.841 1 INFO alembic.runtime.migration [-] Running upgrade -> 27e647c0fad4, Initial version. 2026-07-03 06:57:40.186254 | ubuntu-noble-large | 2026-07-03 06:45:32.987 1 INFO alembic.runtime.migration [-] Running upgrade 27e647c0fad4 -> 29e87d24a316, Initial no-op Yoga expand migration. 2026-07-03 06:57:40.186275 | ubuntu-noble-large | 2026-07-03 06:45:32.991 1 INFO alembic.runtime.migration [-] Running upgrade 29e87d24a316 -> b4f8b3f584e0, Fix incorrect constraints. 2026-07-03 06:57:40.186286 | ubuntu-noble-large | 2026-07-03 06:45:33.051 1 INFO alembic.runtime.migration [-] Running upgrade b4f8b3f584e0 -> 11c3b243b4cb, Remove service_provider.relay_state_prefix server default. 2026-07-03 06:57:40.186296 | ubuntu-noble-large | 2026-07-03 06:45:33.096 1 INFO alembic.runtime.migration [-] Running upgrade 11c3b243b4cb -> 47147121, Add Identity Federation attribute mapping schema version. 2026-07-03 06:57:40.186306 | ubuntu-noble-large | 2026-07-03 06:45:33.148 1 INFO alembic.runtime.migration [-] Running upgrade 27e647c0fad4 -> e25ffa003242, Initial no-op Yoga contract migration. 2026-07-03 06:57:40.186315 | ubuntu-noble-large | 2026-07-03 06:45:33.151 1 INFO alembic.runtime.migration [-] Running upgrade e25ffa003242 -> 99de3849d860, Fix incorrect constraints. 2026-07-03 06:57:40.186324 | ubuntu-noble-large | 2026-07-03 06:45:33.239 1 INFO alembic.runtime.migration [-] Running upgrade 99de3849d860 -> c88cdce8f248, Remove duplicate constraints. 2026-07-03 06:57:40.192071 | ubuntu-noble-large | --- logs pod/controlplane-keystone-db-sync-xt5jh (previous) --- 2026-07-03 06:57:40.320322 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "db-sync" in pod "controlplane-keystone-db-sync-xt5jh" not found 2026-07-03 06:57:40.326837 | ubuntu-noble-large | --- describe pod/controlplane-keystone-schema-check-wg5rb --- 2026-07-03 06:57:40.452271 | ubuntu-noble-large | Name: controlplane-keystone-schema-check-wg5rb 2026-07-03 06:57:40.452363 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:40.452377 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:40.452388 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:40.452398 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:40.452409 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:45:36 +0000 2026-07-03 06:57:40.452486 | ubuntu-noble-large | Labels: batch.kubernetes.io/controller-uid=a6df246c-fcd5-4846-aa36-201c51f01165 2026-07-03 06:57:40.452500 | ubuntu-noble-large | batch.kubernetes.io/job-name=controlplane-keystone-schema-check 2026-07-03 06:57:40.452511 | ubuntu-noble-large | controller-uid=a6df246c-fcd5-4846-aa36-201c51f01165 2026-07-03 06:57:40.452611 | ubuntu-noble-large | job-name=controlplane-keystone-schema-check 2026-07-03 06:57:40.452622 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:40.452632 | ubuntu-noble-large | Status: Succeeded 2026-07-03 06:57:40.452642 | ubuntu-noble-large | IP: 10.244.0.46 2026-07-03 06:57:40.452652 | ubuntu-noble-large | IPs: 2026-07-03 06:57:40.452663 | ubuntu-noble-large | IP: 10.244.0.46 2026-07-03 06:57:40.452672 | ubuntu-noble-large | Controlled By: Job/controlplane-keystone-schema-check 2026-07-03 06:57:40.452682 | ubuntu-noble-large | Containers: 2026-07-03 06:57:40.452692 | ubuntu-noble-large | schema-check: 2026-07-03 06:57:40.452703 | ubuntu-noble-large | Container ID: containerd://6e1c196a411ba39e8b19bc47eee2962669ca8a340d20ab962c109657af226baf 2026-07-03 06:57:40.452713 | ubuntu-noble-large | Image: ghcr.io/c5c3/keystone:2025.2 2026-07-03 06:57:40.452723 | ubuntu-noble-large | Image ID: ghcr.io/c5c3/keystone@sha256:fecb7b2fa7d6acb68460965207f93f6d92ba64df880b7d3e303bbf87a6f7db35 2026-07-03 06:57:40.452733 | ubuntu-noble-large | Port: 2026-07-03 06:57:40.452743 | ubuntu-noble-large | Host Port: 2026-07-03 06:57:40.452753 | ubuntu-noble-large | SeccompProfile: RuntimeDefault 2026-07-03 06:57:40.452763 | ubuntu-noble-large | Command: 2026-07-03 06:57:40.452773 | ubuntu-noble-large | /bin/sh 2026-07-03 06:57:40.452782 | ubuntu-noble-large | -eu 2026-07-03 06:57:40.452792 | ubuntu-noble-large | -c 2026-07-03 06:57:40.452802 | ubuntu-noble-large | keystone-manage --config-dir=/etc/keystone/keystone.conf.d/ db_sync --check 2026-07-03 06:57:40.452812 | ubuntu-noble-large | State: Terminated 2026-07-03 06:57:40.452822 | ubuntu-noble-large | Reason: Completed 2026-07-03 06:57:40.452831 | ubuntu-noble-large | Exit Code: 0 2026-07-03 06:57:40.452841 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:45:37 +0000 2026-07-03 06:57:40.452851 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:45:44 +0000 2026-07-03 06:57:40.452860 | ubuntu-noble-large | Ready: False 2026-07-03 06:57:40.452870 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:40.452880 | ubuntu-noble-large | Environment: 2026-07-03 06:57:40.452889 | ubuntu-noble-large | OS_DATABASE__CONNECTION: Optional: false 2026-07-03 06:57:40.452900 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:40.452909 | ubuntu-noble-large | /etc/keystone/keystone.conf.d/ from config (ro) 2026-07-03 06:57:40.452919 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qdhmq (ro) 2026-07-03 06:57:40.452929 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:40.452939 | ubuntu-noble-large | Type Status 2026-07-03 06:57:40.452949 | ubuntu-noble-large | PodReadyToStartContainers False 2026-07-03 06:57:40.452964 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:40.452981 | ubuntu-noble-large | Ready False 2026-07-03 06:57:40.452997 | ubuntu-noble-large | ContainersReady False 2026-07-03 06:57:40.453015 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:40.453031 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:40.453050 | ubuntu-noble-large | config: 2026-07-03 06:57:40.453069 | ubuntu-noble-large | Type: ConfigMap (a volume populated by a ConfigMap) 2026-07-03 06:57:40.453085 | ubuntu-noble-large | Name: controlplane-keystone-config-0e92e01f 2026-07-03 06:57:40.453102 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.453119 | ubuntu-noble-large | kube-api-access-qdhmq: 2026-07-03 06:57:40.453135 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:40.453153 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:40.453171 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:40.453182 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.453199 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:40.453215 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:40.453232 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:40.453249 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:40.453266 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:40.453300 | ubuntu-noble-large | Events: 2026-07-03 06:57:40.453318 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:40.453334 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:40.453344 | ubuntu-noble-large | Normal Scheduled 12m default-scheduler Successfully assigned openstack/controlplane-keystone-schema-check-wg5rb to forge-control-plane 2026-07-03 06:57:40.453357 | ubuntu-noble-large | Normal Pulled 12m kubelet spec.containers{schema-check}: Container image "ghcr.io/c5c3/keystone:2025.2" already present on machine and can be accessed by the pod 2026-07-03 06:57:40.453368 | ubuntu-noble-large | Normal Created 12m kubelet spec.containers{schema-check}: Container created 2026-07-03 06:57:40.453378 | ubuntu-noble-large | Normal Started 12m kubelet spec.containers{schema-check}: Container started 2026-07-03 06:57:40.458253 | ubuntu-noble-large | --- logs pod/controlplane-keystone-schema-check-wg5rb (current) --- 2026-07-03 06:57:40.602185 | ubuntu-noble-large | Config file not found, using default configs. 2026-07-03 06:57:40.602257 | ubuntu-noble-large | 2026-07-03 06:45:43.824 14 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-07-03 06:57:40.602270 | ubuntu-noble-large | 2026-07-03 06:45:43.825 14 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-07-03 06:57:40.602278 | ubuntu-noble-large | 2026-07-03 06:45:43.864 14 INFO alembic.runtime.migration [-] Context impl MySQLImpl. 2026-07-03 06:57:40.602287 | ubuntu-noble-large | 2026-07-03 06:45:43.864 14 INFO alembic.runtime.migration [-] Will assume non-transactional DDL. 2026-07-03 06:57:40.602303 | ubuntu-noble-large | 2026-07-03 06:45:43.895 14 INFO keystone.cmd.cli [-] All db_sync commands are upgraded to the same version and up-to-date. 2026-07-03 06:57:40.602312 | ubuntu-noble-large | 2026-07-03 06:45:43.895 14 INFO keystone.cmd.cli [-] Current repository versions: 2026-07-03 06:57:40.602320 | ubuntu-noble-large | Expand: 47147121 (head: 47147121) 2026-07-03 06:57:40.602329 | ubuntu-noble-large | Contract: c88cdce8f248 (head: c88cdce8f248) 2026-07-03 06:57:40.606965 | ubuntu-noble-large | --- logs pod/controlplane-keystone-schema-check-wg5rb (previous) --- 2026-07-03 06:57:40.722481 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "schema-check" in pod "controlplane-keystone-schema-check-wg5rb" not found 2026-07-03 06:57:40.727428 | ubuntu-noble-large | --- describe pod/openstack-db-0 --- 2026-07-03 06:57:40.851028 | ubuntu-noble-large | Name: openstack-db-0 2026-07-03 06:57:40.851153 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:40.851178 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:40.851196 | ubuntu-noble-large | Service Account: openstack-db 2026-07-03 06:57:40.851207 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:40.851251 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:43:07 +0000 2026-07-03 06:57:40.851263 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-07-03 06:57:40.851304 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-07-03 06:57:40.851315 | ubuntu-noble-large | apps.kubernetes.io/pod-index=0 2026-07-03 06:57:40.851325 | ubuntu-noble-large | controller-revision-hash=openstack-db-f48987fbf 2026-07-03 06:57:40.851343 | ubuntu-noble-large | k8s.mariadb.com/role=primary 2026-07-03 06:57:40.851360 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-0 2026-07-03 06:57:40.851386 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 6af4942ab90e621aaeb4962c0bdbad83799aab604deec714102280b4726e3409 2026-07-03 06:57:40.851406 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 29b59d6de7b57529398f6a03cff81fff8f2eddb129482df0ae5e158e051d9f31 2026-07-03 06:57:40.851423 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-07-03 06:57:40.851496 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-07-03 06:57:40.851574 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-07-03 06:57:40.851608 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-07-03 06:57:40.851626 | ubuntu-noble-large | k8s.mariadb.com/server-cert: f4889bc7e8bdd97f326bd3435ace6ea30f6a24fe4fc13fa50dbb6671a1736ab1 2026-07-03 06:57:40.851642 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:40.851659 | ubuntu-noble-large | IP: 10.244.0.41 2026-07-03 06:57:40.851706 | ubuntu-noble-large | IPs: 2026-07-03 06:57:40.851725 | ubuntu-noble-large | IP: 10.244.0.41 2026-07-03 06:57:40.851742 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-07-03 06:57:40.851753 | ubuntu-noble-large | Init Containers: 2026-07-03 06:57:40.851763 | ubuntu-noble-large | init: 2026-07-03 06:57:40.851773 | ubuntu-noble-large | Container ID: containerd://09ecaf0080fe45ba69ddc48a9f8a18cd324d4d9d8eef8903f6f8d9116ee86d08 2026-07-03 06:57:40.851783 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:40.851793 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:40.851805 | ubuntu-noble-large | Port: 2026-07-03 06:57:40.851814 | ubuntu-noble-large | Host Port: 2026-07-03 06:57:40.851824 | ubuntu-noble-large | Args: 2026-07-03 06:57:40.851834 | ubuntu-noble-large | init 2026-07-03 06:57:40.851974 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:40.851988 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:40.851999 | ubuntu-noble-large | State: Terminated 2026-07-03 06:57:40.852009 | ubuntu-noble-large | Reason: Completed 2026-07-03 06:57:40.852018 | ubuntu-noble-large | Exit Code: 0 2026-07-03 06:57:40.852034 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:07 +0000 2026-07-03 06:57:40.852050 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:43:08 +0000 2026-07-03 06:57:40.852066 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:40.852084 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:40.852101 | ubuntu-noble-large | Environment: 2026-07-03 06:57:40.852117 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:40.852135 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:40.852152 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:40.852170 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-07-03 06:57:40.852188 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:40.852204 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:40.852220 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:40.852230 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:40.852240 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:40.852250 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:40.852259 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:40.852269 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:40.852278 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:40.852288 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:40.852298 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:40.852308 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:40.852317 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:40.852327 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:40.852337 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:40.852346 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:40.852356 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:40.852366 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:40.852375 | ubuntu-noble-large | Containers: 2026-07-03 06:57:40.852385 | ubuntu-noble-large | mariadb: 2026-07-03 06:57:40.852395 | ubuntu-noble-large | Container ID: containerd://d47cdb91feea5710cc4cb30011f9643a555ad8646f00eda20172d5fbc8c5989c 2026-07-03 06:57:40.852404 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-07-03 06:57:40.852414 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-07-03 06:57:40.852425 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-07-03 06:57:40.852435 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-07-03 06:57:40.852475 | ubuntu-noble-large | State: Running 2026-07-03 06:57:40.852494 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:08 +0000 2026-07-03 06:57:40.852566 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:40.852593 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:40.852612 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:40.852630 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:40.852675 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:40.852694 | ubuntu-noble-large | Environment: 2026-07-03 06:57:40.852712 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:40.852728 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:40.852745 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:40.852763 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-07-03 06:57:40.852780 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:40.852796 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:40.852813 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:40.852828 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:40.852844 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:40.852859 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:40.852888 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:40.852906 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:40.852923 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:40.852942 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:40.852958 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:40.852975 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:40.852993 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:40.853010 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:40.853027 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:40.853045 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:40.853061 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:40.853079 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:40.853090 | ubuntu-noble-large | agent: 2026-07-03 06:57:40.853100 | ubuntu-noble-large | Container ID: containerd://b6704157f32f8defc4bdffd2467d98d02067b099a1acddc5b3d6a74c7192401d 2026-07-03 06:57:40.853109 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:40.853119 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:40.853129 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-07-03 06:57:40.853139 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-07-03 06:57:40.853148 | ubuntu-noble-large | Args: 2026-07-03 06:57:40.853158 | ubuntu-noble-large | agent 2026-07-03 06:57:40.853168 | ubuntu-noble-large | --addr=:5555 2026-07-03 06:57:40.853178 | ubuntu-noble-large | --probe-addr=:5566 2026-07-03 06:57:40.853187 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:40.853197 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:40.853207 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-07-03 06:57:40.853216 | ubuntu-noble-large | --kubernetes-auth 2026-07-03 06:57:40.853226 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-07-03 06:57:40.853235 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-07-03 06:57:40.853245 | ubuntu-noble-large | State: Running 2026-07-03 06:57:40.853254 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:08 +0000 2026-07-03 06:57:40.853264 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:40.853274 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:40.853283 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:40.853294 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:40.853303 | ubuntu-noble-large | Environment: 2026-07-03 06:57:40.853313 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:40.853334 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:40.853344 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:40.853354 | ubuntu-noble-large | POD_NAME: openstack-db-0 (v1:metadata.name) 2026-07-03 06:57:40.853364 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:40.853373 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:40.853383 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:40.853392 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:40.853402 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:40.853411 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:40.853421 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:40.853430 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:40.853440 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:40.853478 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:40.853488 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:40.853498 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:40.853507 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:40.853517 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:40.853563 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:40.853573 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:40.853583 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:40.853592 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:40.853602 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:40.853612 | ubuntu-noble-large | Type Status 2026-07-03 06:57:40.853621 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:40.853631 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:40.853641 | ubuntu-noble-large | Ready True 2026-07-03 06:57:40.853651 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:40.853660 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:40.853670 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:40.853680 | ubuntu-noble-large | storage: 2026-07-03 06:57:40.853690 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:40.853699 | ubuntu-noble-large | ClaimName: storage-openstack-db-0 2026-07-03 06:57:40.853709 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:40.853719 | ubuntu-noble-large | galera: 2026-07-03 06:57:40.853729 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:40.853738 | ubuntu-noble-large | ClaimName: galera-openstack-db-0 2026-07-03 06:57:40.853748 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:40.853758 | ubuntu-noble-large | config: 2026-07-03 06:57:40.853768 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:40.853790 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-07-03 06:57:40.853801 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853811 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-07-03 06:57:40.853820 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853830 | ubuntu-noble-large | pki: 2026-07-03 06:57:40.853840 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:40.853850 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-07-03 06:57:40.853859 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853869 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-07-03 06:57:40.853878 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853888 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-07-03 06:57:40.853898 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853908 | ubuntu-noble-large | serviceaccount: 2026-07-03 06:57:40.853918 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:40.853928 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-07-03 06:57:40.853945 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:40.853955 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:40.853973 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:40.853991 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:40.854007 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:40.854024 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:40.854041 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:40.854058 | ubuntu-noble-large | Events: 2026-07-03 06:57:40.854074 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:40.854091 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:40.854109 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-0 to forge-control-plane 2026-07-03 06:57:40.854129 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:40.854150 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-07-03 06:57:40.854167 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-07-03 06:57:40.854186 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:40.854205 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{mariadb}: Container created 2026-07-03 06:57:40.854222 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{mariadb}: Container started 2026-07-03 06:57:40.854236 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:40.854246 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{agent}: Container created 2026-07-03 06:57:40.854256 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{agent}: Container started 2026-07-03 06:57:40.854267 | ubuntu-noble-large | Warning Unhealthy 14m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.41:5566/health": dial tcp 10.244.0.41:5566: connect: connection refused 2026-07-03 06:57:40.854277 | ubuntu-noble-large | Warning Unhealthy 13m (x3 over 13m) kubelet spec.containers{mariadb}: Readiness probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:40.857148 | ubuntu-noble-large | --- logs pod/openstack-db-0 (current) --- 2026-07-03 06:57:40.978815 | ubuntu-noble-large | {"level":"info","ts":1783060987.9710827,"msg":"Starting init"} 2026-07-03 06:57:40.978886 | ubuntu-noble-large | {"level":"info","ts":1783060988.0097356,"msg":"Configuring Galera"} 2026-07-03 06:57:40.978896 | ubuntu-noble-large | {"level":"info","ts":1783060988.0100124,"msg":"Configuring Galera bootstrap"} 2026-07-03 06:57:40.978903 | ubuntu-noble-large | {"level":"info","ts":1783060988.0100799,"msg":"Init done"} 2026-07-03 06:57:40.989032 | ubuntu-noble-large | 2026-07-03 6:43:09 2 [Note] WSREP: Server status change joined -> synced 2026-07-03 06:57:40.989086 | ubuntu-noble-large | 2026-07-03 6:43:09 2 [Note] WSREP: Synchronized with group, ready for connections 2026-07-03 06:57:40.989095 | ubuntu-noble-large | 2026-07-03 6:43:09 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.989101 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: (74715322-a6c8, 'tcp://0.0.0.0:4567') connection established to 89b29eee-8dce tcp://10.244.0.43:4567 2026-07-03 06:57:40.989116 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: declaring 89b29eee-8dce at tcp://10.244.0.43:4567 stable 2026-07-03 06:57:40.989122 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: Node 74715322-a6c8 state prim 2026-07-03 06:57:40.989129 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: view(view_id(PRIM,74715322-a6c8,2) memb { 2026-07-03 06:57:40.989134 | ubuntu-noble-large | 74715322-a6c8,0 2026-07-03 06:57:40.989165 | ubuntu-noble-large | 89b29eee-8dce,0 2026-07-03 06:57:40.989171 | ubuntu-noble-large | } joined { 2026-07-03 06:57:40.989177 | ubuntu-noble-large | } left { 2026-07-03 06:57:40.989183 | ubuntu-noble-large | } partitioned { 2026-07-03 06:57:40.989189 | ubuntu-noble-large | }) 2026-07-03 06:57:40.989195 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: save pc into disk 2026-07-03 06:57:40.989201 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2026-07-03 06:57:40.989207 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8ac04437-76aa-11f1-910f-1be6beceef4b 2026-07-03 06:57:40.989213 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b 2026-07-03 06:57:40.989219 | ubuntu-noble-large | 2026-07-03 6:43:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b from 0 (openstack-db-0) 2026-07-03 06:57:40.989225 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b from 1 (openstack-db-1) 2026-07-03 06:57:40.989231 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Quorum results: 2026-07-03 06:57:40.989237 | ubuntu-noble-large | version = 6, 2026-07-03 06:57:40.989243 | ubuntu-noble-large | component = PRIMARY, 2026-07-03 06:57:40.989248 | ubuntu-noble-large | conf_id = 1, 2026-07-03 06:57:40.989254 | ubuntu-noble-large | members = 1/2 (joined/total), 2026-07-03 06:57:40.989259 | ubuntu-noble-large | act_id = 1, 2026-07-03 06:57:40.989265 | ubuntu-noble-large | last_appl. = 0, 2026-07-03 06:57:40.989271 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-07-03 06:57:40.989287 | ubuntu-noble-large | vote policy= 0, 2026-07-03 06:57:40.989293 | ubuntu-noble-large | group UUID = 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:40.989299 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Flow-control interval: [23, 23] 2026-07-03 06:57:40.989304 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### processing CC 2, local, ordered 2026-07-03 06:57:40.989310 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### My UUID: 74715322-76aa-11f1-a6c8-62ca602be188 2026-07-03 06:57:40.989316 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Skipping cert index reset 2026-07-03 06:57:40.989321 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:40.989327 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2026-07-03 06:57:40.989332 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:40.989338 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ================================================ 2026-07-03 06:57:40.989344 | ubuntu-noble-large | View: 2026-07-03 06:57:40.989350 | ubuntu-noble-large | id: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:40.989355 | ubuntu-noble-large | status: primary 2026-07-03 06:57:40.989361 | ubuntu-noble-large | protocol_version: 4 2026-07-03 06:57:40.989366 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-07-03 06:57:40.989373 | ubuntu-noble-large | final: no 2026-07-03 06:57:40.989379 | ubuntu-noble-large | own_index: 0 2026-07-03 06:57:40.989385 | ubuntu-noble-large | members(2): 2026-07-03 06:57:40.989390 | ubuntu-noble-large | 0: 74715322-76aa-11f1-a6c8-62ca602be188, openstack-db-0 2026-07-03 06:57:40.989396 | ubuntu-noble-large | 1: 89b29eee-76aa-11f1-8dce-768ae6febba1, openstack-db-1 2026-07-03 06:57:40.989402 | ubuntu-noble-large | ================================================= 2026-07-03 06:57:40.989407 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.989413 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Lowest cert index boundary for CC from group: 2 2026-07-03 06:57:40.989418 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Min available from gcache for CC from group: 1 2026-07-03 06:57:40.989424 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Member 1.0 (openstack-db-1) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-07-03 06:57:40.989430 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2) 2026-07-03 06:57:40.989435 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Detected STR version: 1, req_len: 126, req: STRv1 2026-07-03 06:57:40.989441 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Cert index preload: 2 -> 2 2026-07-03 06:57:40.989459 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Server status change synced -> donor 2026-07-03 06:57:40.989476 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.989482 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: async IST sender starting to serve tcp://10.244.0.43:4568 sending 2-2, preload starts from 2 2026-07-03 06:57:40.989490 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.244.0.43:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '747a920c-76aa-11f1-8105-5b9b008b772f:2' --gtid-domain-id 0' 2026-07-03 06:57:40.989498 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Donor monitor thread started to monitor 2026-07-03 06:57:40.989504 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: sst_donor_thread signaled with 0 2026-07-03 06:57:40.989509 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: IST sender 2 -> 2 2026-07-03 06:57:40.989785 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on donor (20260703 06:43:48.987) 2026-07-03 06:57:40.989807 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260703 06:43:49.102) 2026-07-03 06:57:40.989818 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260703 06:43:49.512) 2026-07-03 06:57:40.989829 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260703 06:43:49.517) 2026-07-03 06:57:40.989885 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260703 06:43:49.542) 2026-07-03 06:57:40.989895 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260703 06:43:49.547) 2026-07-03 06:57:40.989905 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.DkBYOyz4m8' as mariadb-backup temporary directory (20260703 06:43:49.619) 2026-07-03 06:57:40.989915 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.ZCDeN83tOp' as mariadb-backup working directory (20260703 06:43:49.625) 2026-07-03 06:57:40.989926 | ubuntu-noble-large | WSREP_SST: [INFO] Estimating total transfer size (20260703 06:43:49.631) 2026-07-03 06:57:40.989971 | ubuntu-noble-large | WSREP_SST: [INFO] SST footprint estimate: data: 44613632, undo: 0 (20260703 06:43:49.648) 2026-07-03 06:57:40.989982 | ubuntu-noble-large | WSREP_SST: [INFO] To transfer: 44613632 (20260703 06:43:49.653) 2026-07-03 06:57:40.989992 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming GTID file before SST (20260703 06:43:49.658) 2026-07-03 06:57:40.990002 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'mariadb_backup_galera_info' 'donor_galera_info' | socat -u stdio TCP:10.244.0.43:4444; RC=( ${PIPESTATUS[@]} ) (20260703 06:43:49.664) 2026-07-03 06:57:40.990012 | ubuntu-noble-large | WSREP_SST: [INFO] Sleeping before data transfer for SST (20260703 06:43:49.679) 2026-07-03 06:57:40.990021 | ubuntu-noble-large | 2026-07-03 6:43:49 0 [Note] WSREP: (74715322-a6c8, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-07-03 06:57:40.990110 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming the backup to joiner at 10.244.0.43:4444 (20260703 06:43:59.689) 2026-07-03 06:57:40.990131 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --backup --no-version-check --databases-exclude='lost+found' --tmpdir='/tmp/tmp.DkBYOyz4m8' --innodb-data-home-dir='.' --user='root' --socket='/run/mysqld/mysqld.sock' --galera-info --stream=mbstream --target-dir='/tmp/tmp.ZCDeN83tOp' --datadir='/var/lib/mysql' 2> '/var/lib/mysql/mariabackup.backup.log' | socat -u stdio TCP:10.244.0.43:4444; RC=( ${PIPESTATUS[@]} ) (20260703 06:43:59.695) 2026-07-03 06:57:40.990185 | ubuntu-noble-large | 2026-07-03 6:44:00 15 [Note] WSREP: Server not desynched from group at BLOCK_DDL because mariabackup is used. 2026-07-03 06:57:40.990194 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: SST sent: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:40.990200 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Server status change donor -> joined 2026-07-03 06:57:40.990206 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 1.0 (openstack-db-1) complete. 2026-07-03 06:57:40.990211 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2) 2026-07-03 06:57:40.990217 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-07-03 06:57:40.990230 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-07-03 06:57:40.990263 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-07-03 06:57:40.990270 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2026-07-03 06:57:40.990275 | ubuntu-noble-large | 2026-07-03 6:44:05 2 [Note] WSREP: Server openstack-db-0 synced with group 2026-07-03 06:57:40.990281 | ubuntu-noble-large | 2026-07-03 6:44:05 2 [Note] WSREP: Server status change joined -> synced 2026-07-03 06:57:40.990286 | ubuntu-noble-large | 2026-07-03 6:44:05 2 [Note] WSREP: Synchronized with group, ready for connections 2026-07-03 06:57:40.990292 | ubuntu-noble-large | 2026-07-03 6:44:05 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.990297 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on donor: 0 seconds (20260703 06:44:05.462) 2026-07-03 06:57:40.990303 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on donor (20260703 06:44:05.469) 2026-07-03 06:57:40.990308 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260703 06:44:05.487) 2026-07-03 06:57:40.990313 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Donor monitor thread ended with total time 17 sec 2026-07-03 06:57:40.990319 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: async IST sender served 2026-07-03 06:57:40.990352 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: 1.0 (openstack-db-1): State transfer from 0.0 (openstack-db-0) complete. 2026-07-03 06:57:40.990358 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Member 1.0 (openstack-db-1) synced with group. 2026-07-03 06:57:40.990364 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: (74715322-a6c8, 'tcp://0.0.0.0:4567') connection established to 9db38154-a0e4 tcp://10.244.0.44:4567 2026-07-03 06:57:40.990370 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 89b29eee-8dce at tcp://10.244.0.43:4567 stable 2026-07-03 06:57:40.990376 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 9db38154-a0e4 at tcp://10.244.0.44:4567 stable 2026-07-03 06:57:40.991101 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: Node 74715322-a6c8 state prim 2026-07-03 06:57:40.991117 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: view(view_id(PRIM,74715322-a6c8,3) memb { 2026-07-03 06:57:40.991123 | ubuntu-noble-large | 74715322-a6c8,0 2026-07-03 06:57:40.991129 | ubuntu-noble-large | 89b29eee-8dce,0 2026-07-03 06:57:40.991134 | ubuntu-noble-large | 9db38154-a0e4,0 2026-07-03 06:57:40.991140 | ubuntu-noble-large | } joined { 2026-07-03 06:57:40.991146 | ubuntu-noble-large | } left { 2026-07-03 06:57:40.991151 | ubuntu-noble-large | } partitioned { 2026-07-03 06:57:40.991170 | ubuntu-noble-large | }) 2026-07-03 06:57:40.991176 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: save pc into disk 2026-07-03 06:57:40.991182 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 2026-07-03 06:57:40.991187 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 2026-07-03 06:57:40.991193 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 2026-07-03 06:57:40.991199 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 1 (openstack-db-1) 2026-07-03 06:57:40.991204 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 0 (openstack-db-0) 2026-07-03 06:57:40.991210 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 2 (openstack-db-2) 2026-07-03 06:57:40.991215 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Quorum results: 2026-07-03 06:57:40.991221 | ubuntu-noble-large | version = 6, 2026-07-03 06:57:40.991227 | ubuntu-noble-large | component = PRIMARY, 2026-07-03 06:57:40.991234 | ubuntu-noble-large | conf_id = 2, 2026-07-03 06:57:40.991247 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-07-03 06:57:40.991256 | ubuntu-noble-large | act_id = 2, 2026-07-03 06:57:40.991264 | ubuntu-noble-large | last_appl. = 0, 2026-07-03 06:57:40.991316 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-07-03 06:57:40.991324 | ubuntu-noble-large | vote policy= 0, 2026-07-03 06:57:40.991329 | ubuntu-noble-large | group UUID = 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:40.991394 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-07-03 06:57:40.991439 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-07-03 06:57:40.991470 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### My UUID: 74715322-76aa-11f1-a6c8-62ca602be188 2026-07-03 06:57:40.991476 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Skipping cert index reset 2026-07-03 06:57:40.991481 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:40.991486 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-07-03 06:57:40.991539 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:40.991549 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ================================================ 2026-07-03 06:57:40.991554 | ubuntu-noble-large | View: 2026-07-03 06:57:40.991559 | ubuntu-noble-large | id: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:40.991564 | ubuntu-noble-large | status: primary 2026-07-03 06:57:40.991569 | ubuntu-noble-large | protocol_version: 4 2026-07-03 06:57:40.991574 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-07-03 06:57:40.991606 | ubuntu-noble-large | final: no 2026-07-03 06:57:40.991612 | ubuntu-noble-large | own_index: 0 2026-07-03 06:57:40.991617 | ubuntu-noble-large | members(3): 2026-07-03 06:57:40.991622 | ubuntu-noble-large | 0: 74715322-76aa-11f1-a6c8-62ca602be188, openstack-db-0 2026-07-03 06:57:40.991627 | ubuntu-noble-large | 1: 89b29eee-76aa-11f1-8dce-768ae6febba1, openstack-db-1 2026-07-03 06:57:40.991632 | ubuntu-noble-large | 2: 9db38154-76aa-11f1-a0e4-5f77cf226244, openstack-db-2 2026-07-03 06:57:40.991637 | ubuntu-noble-large | ================================================= 2026-07-03 06:57:40.991642 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.991647 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Lowest cert index boundary for CC from group: 3 2026-07-03 06:57:40.991652 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Min available from gcache for CC from group: 1 2026-07-03 06:57:40.991657 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-07-03 06:57:40.991662 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 3) 2026-07-03 06:57:40.991689 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Detected STR version: 1, req_len: 126, req: STRv1 2026-07-03 06:57:40.991694 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Cert index preload: 3 -> 3 2026-07-03 06:57:40.991699 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Server status change synced -> donor 2026-07-03 06:57:40.991704 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.991709 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: async IST sender starting to serve tcp://10.244.0.44:4568 sending 3-3, preload starts from 3 2026-07-03 06:57:40.991737 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Donor monitor thread started to monitor 2026-07-03 06:57:40.991744 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.244.0.44:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '747a920c-76aa-11f1-8105-5b9b008b772f:3' --gtid-domain-id 0' 2026-07-03 06:57:40.991749 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: sst_donor_thread signaled with 0 2026-07-03 06:57:40.991754 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: IST sender 3 -> 3 2026-07-03 06:57:40.991759 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on donor (20260703 06:44:22.603) 2026-07-03 06:57:40.991764 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260703 06:44:22.725) 2026-07-03 06:57:40.992129 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260703 06:44:23.124) 2026-07-03 06:57:40.992140 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260703 06:44:23.127) 2026-07-03 06:57:40.992152 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260703 06:44:23.151) 2026-07-03 06:57:40.992157 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260703 06:44:23.155) 2026-07-03 06:57:40.992207 | ubuntu-noble-large | WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.backup.log' to '/tmp/sst_log_archive/mariabackup.backup.log.2026.07.03-06.44.23.161955325' (20260703 06:44:23.169) 2026-07-03 06:57:40.992215 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.e7uShYX1R4' as mariadb-backup temporary directory (20260703 06:44:23.234) 2026-07-03 06:57:40.992228 | ubuntu-noble-large | WSREP_SST: [INFO] Using '/tmp/tmp.pR6IkKsU8X' as mariadb-backup working directory (20260703 06:44:23.239) 2026-07-03 06:57:40.992233 | ubuntu-noble-large | WSREP_SST: [INFO] Estimating total transfer size (20260703 06:44:23.243) 2026-07-03 06:57:40.992238 | ubuntu-noble-large | WSREP_SST: [INFO] SST footprint estimate: data: 44613632, undo: 0 (20260703 06:44:23.258) 2026-07-03 06:57:40.992247 | ubuntu-noble-large | WSREP_SST: [INFO] To transfer: 44613632 (20260703 06:44:23.264) 2026-07-03 06:57:40.992252 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming GTID file before SST (20260703 06:44:23.269) 2026-07-03 06:57:40.992257 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating '/usr//bin/mbstream' -c 'mariadb_backup_galera_info' 'donor_galera_info' | socat -u stdio TCP:10.244.0.44:4444; RC=( ${PIPESTATUS[@]} ) (20260703 06:44:23.276) 2026-07-03 06:57:40.992262 | ubuntu-noble-large | WSREP_SST: [INFO] Sleeping before data transfer for SST (20260703 06:44:23.289) 2026-07-03 06:57:40.992267 | ubuntu-noble-large | 2026-07-03 6:44:23 0 [Note] WSREP: (74715322-a6c8, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-07-03 06:57:40.992272 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming the backup to joiner at 10.244.0.44:4444 (20260703 06:44:33.297) 2026-07-03 06:57:40.992281 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --backup --no-version-check --databases-exclude='lost+found' --tmpdir='/tmp/tmp.e7uShYX1R4' --innodb-data-home-dir='.' --user='root' --socket='/run/mysqld/mysqld.sock' --galera-info --stream=mbstream --target-dir='/tmp/tmp.pR6IkKsU8X' --datadir='/var/lib/mysql' 2> '/var/lib/mysql/mariabackup.backup.log' | socat -u stdio TCP:10.244.0.44:4444; RC=( ${PIPESTATUS[@]} ) (20260703 06:44:33.302) 2026-07-03 06:57:40.992286 | ubuntu-noble-large | 2026-07-03 6:44:34 24 [Note] WSREP: Server not desynched from group at BLOCK_DDL because mariabackup is used. 2026-07-03 06:57:40.992291 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: SST sent: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:40.992296 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Server status change donor -> joined 2026-07-03 06:57:40.992303 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-07-03 06:57:40.992309 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 3) 2026-07-03 06:57:40.992314 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-07-03 06:57:40.992318 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-07-03 06:57:40.992323 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-07-03 06:57:40.992328 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 3) 2026-07-03 06:57:40.992333 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Server openstack-db-0 synced with group 2026-07-03 06:57:40.992338 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Server status change joined -> synced 2026-07-03 06:57:40.992342 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Synchronized with group, ready for connections 2026-07-03 06:57:40.992347 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:40.992352 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on donor: 0 seconds (20260703 06:44:39.198) 2026-07-03 06:57:40.992357 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on donor (20260703 06:44:39.203) 2026-07-03 06:57:40.992362 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260703 06:44:39.216) 2026-07-03 06:57:40.992366 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Donor monitor thread ended with total time 17 sec 2026-07-03 06:57:40.992371 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: async IST sender served 2026-07-03 06:57:40.992381 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-07-03 06:57:40.992386 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-07-03 06:57:41.002615 | ubuntu-noble-large | {"level":"info","ts":1783060988.7190611,"msg":"Agent starting"} 2026-07-03 06:57:41.002887 | ubuntu-noble-large | {"level":"info","ts":1783060988.719584,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-07-03 06:57:41.002901 | ubuntu-noble-large | {"level":"info","ts":1783060988.7212744,"logger":"api","msg":"Configuring TLS"} 2026-07-03 06:57:41.002912 | ubuntu-noble-large | {"level":"info","ts":1783060988.7238138,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-07-03 06:57:41.002921 | ubuntu-noble-large | {"level":"info","ts":1783060988.723808,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-07-03 06:57:41.002936 | ubuntu-noble-large | {"level":"error","ts":1783061037.4373856,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-07-03 06:57:41.002965 | ubuntu-noble-large | {"level":"error","ts":1783061067.4381492,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-07-03 06:57:41.002993 | ubuntu-noble-large | {"level":"error","ts":1783061077.433261,"logger":"probe.readiness","msg":"Pod in non ready state","state":"Donor/Desynced","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Readiness\n\t/app/pkg/galera/agent/handler/probe.go:148\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-07-03 06:57:41.003026 | ubuntu-noble-large | 2026/07/03 06:44:41 "DELETE https://openstack-db-0.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.19:46598 - 200 0B in 4.910852ms 2026-07-03 06:57:41.006621 | ubuntu-noble-large | --- logs pod/openstack-db-0 (previous) --- 2026-07-03 06:57:41.131920 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "init" in pod "openstack-db-0" not found 2026-07-03 06:57:41.137127 | ubuntu-noble-large | --- describe pod/openstack-db-1 --- 2026-07-03 06:57:41.259775 | ubuntu-noble-large | Name: openstack-db-1 2026-07-03 06:57:41.259835 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:41.259841 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:41.259845 | ubuntu-noble-large | Service Account: openstack-db 2026-07-03 06:57:41.259849 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:41.259853 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:43:10 +0000 2026-07-03 06:57:41.259857 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-07-03 06:57:41.259861 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-07-03 06:57:41.259865 | ubuntu-noble-large | apps.kubernetes.io/pod-index=1 2026-07-03 06:57:41.259869 | ubuntu-noble-large | controller-revision-hash=openstack-db-f48987fbf 2026-07-03 06:57:41.259872 | ubuntu-noble-large | k8s.mariadb.com/role=replica 2026-07-03 06:57:41.259876 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-1 2026-07-03 06:57:41.259881 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 6af4942ab90e621aaeb4962c0bdbad83799aab604deec714102280b4726e3409 2026-07-03 06:57:41.259885 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 29b59d6de7b57529398f6a03cff81fff8f2eddb129482df0ae5e158e051d9f31 2026-07-03 06:57:41.259889 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-07-03 06:57:41.259893 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-07-03 06:57:41.259897 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-07-03 06:57:41.259900 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-07-03 06:57:41.259904 | ubuntu-noble-large | k8s.mariadb.com/server-cert: f4889bc7e8bdd97f326bd3435ace6ea30f6a24fe4fc13fa50dbb6671a1736ab1 2026-07-03 06:57:41.259908 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:41.259911 | ubuntu-noble-large | IP: 10.244.0.43 2026-07-03 06:57:41.259915 | ubuntu-noble-large | IPs: 2026-07-03 06:57:41.259919 | ubuntu-noble-large | IP: 10.244.0.43 2026-07-03 06:57:41.259922 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-07-03 06:57:41.259926 | ubuntu-noble-large | Init Containers: 2026-07-03 06:57:41.259929 | ubuntu-noble-large | init: 2026-07-03 06:57:41.259933 | ubuntu-noble-large | Container ID: containerd://073c08796bcf818fe12846ddf1bafcd8dbd009ad153234f134ac83a562a3bd25 2026-07-03 06:57:41.259937 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:41.259940 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:41.259951 | ubuntu-noble-large | Port: 2026-07-03 06:57:41.259955 | ubuntu-noble-large | Host Port: 2026-07-03 06:57:41.259958 | ubuntu-noble-large | Args: 2026-07-03 06:57:41.259962 | ubuntu-noble-large | init 2026-07-03 06:57:41.259965 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:41.259969 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:41.259972 | ubuntu-noble-large | State: Terminated 2026-07-03 06:57:41.259976 | ubuntu-noble-large | Reason: Completed 2026-07-03 06:57:41.259979 | ubuntu-noble-large | Exit Code: 0 2026-07-03 06:57:41.259982 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:10 +0000 2026-07-03 06:57:41.259999 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:43:38 +0000 2026-07-03 06:57:41.260003 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.260006 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.260355 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.260359 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.260362 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.260366 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.260369 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-07-03 06:57:41.260373 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.260376 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.260379 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.260383 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.260386 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.260389 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.260393 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.260396 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.260399 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.260403 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.260406 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.260410 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.260413 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.260417 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.260420 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.260423 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.260427 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.260430 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.260434 | ubuntu-noble-large | Containers: 2026-07-03 06:57:41.260437 | ubuntu-noble-large | mariadb: 2026-07-03 06:57:41.260440 | ubuntu-noble-large | Container ID: containerd://26ac52109a5ff111c8758f907f8e601316a4b2290286ae64ba6614dcb9287fcc 2026-07-03 06:57:41.260471 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-07-03 06:57:41.260475 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-07-03 06:57:41.260480 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-07-03 06:57:41.260483 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-07-03 06:57:41.260487 | ubuntu-noble-large | State: Running 2026-07-03 06:57:41.260490 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:38 +0000 2026-07-03 06:57:41.260494 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.260497 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.260500 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.260504 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.261418 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.261512 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.261554 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.261565 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.261574 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.261582 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-07-03 06:57:41.261591 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.261599 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.261607 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.261615 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.261623 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.261653 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.261661 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.261669 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.261677 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.261685 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.261693 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.261701 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.261710 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.261718 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.261726 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.261734 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.261742 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.261750 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.261758 | ubuntu-noble-large | agent: 2026-07-03 06:57:41.261765 | ubuntu-noble-large | Container ID: containerd://bb9802bba6c841faddd02e8db3792bb4342be8590696143276dadf9376a0908f 2026-07-03 06:57:41.261774 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:41.261783 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:41.261792 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-07-03 06:57:41.261799 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-07-03 06:57:41.261807 | ubuntu-noble-large | Args: 2026-07-03 06:57:41.261815 | ubuntu-noble-large | agent 2026-07-03 06:57:41.261823 | ubuntu-noble-large | --addr=:5555 2026-07-03 06:57:41.261842 | ubuntu-noble-large | --probe-addr=:5566 2026-07-03 06:57:41.261851 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:41.261859 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:41.261867 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-07-03 06:57:41.261875 | ubuntu-noble-large | --kubernetes-auth 2026-07-03 06:57:41.261882 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-07-03 06:57:41.261890 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-07-03 06:57:41.261898 | ubuntu-noble-large | State: Running 2026-07-03 06:57:41.261905 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:38 +0000 2026-07-03 06:57:41.261914 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.261921 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.261929 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:41.261937 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:41.261945 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.261953 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.261961 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.261968 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.261976 | ubuntu-noble-large | POD_NAME: openstack-db-1 (v1:metadata.name) 2026-07-03 06:57:41.261984 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.261992 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.262000 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.262008 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.262015 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.262023 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.262031 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.262039 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.262046 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.262054 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.262062 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.262076 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.262084 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.262092 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.262100 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.262108 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.262115 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.262123 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.262131 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:41.262139 | ubuntu-noble-large | Type Status 2026-07-03 06:57:41.262147 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:41.262155 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:41.262162 | ubuntu-noble-large | Ready True 2026-07-03 06:57:41.262170 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:41.262178 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:41.262186 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:41.262194 | ubuntu-noble-large | storage: 2026-07-03 06:57:41.262202 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:41.262209 | ubuntu-noble-large | ClaimName: storage-openstack-db-1 2026-07-03 06:57:41.262217 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:41.262225 | ubuntu-noble-large | galera: 2026-07-03 06:57:41.262233 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:41.262241 | ubuntu-noble-large | ClaimName: galera-openstack-db-1 2026-07-03 06:57:41.262249 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:41.262257 | ubuntu-noble-large | config: 2026-07-03 06:57:41.262265 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.262289 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-07-03 06:57:41.262298 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262306 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-07-03 06:57:41.262313 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262322 | ubuntu-noble-large | pki: 2026-07-03 06:57:41.262330 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.262338 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-07-03 06:57:41.262345 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262353 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-07-03 06:57:41.262361 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262369 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-07-03 06:57:41.262376 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262384 | ubuntu-noble-large | serviceaccount: 2026-07-03 06:57:41.262392 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.262400 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-07-03 06:57:41.262408 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:41.262415 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.262423 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:41.262430 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:41.262438 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:41.262498 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:41.262507 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:41.262515 | ubuntu-noble-large | Events: 2026-07-03 06:57:41.262550 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:41.262558 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:41.262566 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-1 to forge-control-plane 2026-07-03 06:57:41.262576 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.262585 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-07-03 06:57:41.262592 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-07-03 06:57:41.262615 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.262625 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{mariadb}: Container created 2026-07-03 06:57:41.262633 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{mariadb}: Container started 2026-07-03 06:57:41.262641 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.262649 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{agent}: Container created 2026-07-03 06:57:41.262656 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{agent}: Container started 2026-07-03 06:57:41.262679 | ubuntu-noble-large | Warning Unhealthy 14m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.43:5566/health": dial tcp 10.244.0.43:5566: connect: connection refused 2026-07-03 06:57:41.262687 | ubuntu-noble-large | Warning Unhealthy 13m kubelet spec.containers{mariadb}: Startup probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:41.264218 | ubuntu-noble-large | --- logs pod/openstack-db-1 (current) --- 2026-07-03 06:57:41.376370 | ubuntu-noble-large | {"level":"info","ts":1783060990.9391303,"msg":"Starting init"} 2026-07-03 06:57:41.376467 | ubuntu-noble-large | {"level":"info","ts":1783060990.9767764,"msg":"Configuring Galera"} 2026-07-03 06:57:41.376484 | ubuntu-noble-large | {"level":"info","ts":1783060990.9772606,"msg":"Waiting for previous Pod to be ready","pod":"openstack-db-0"} 2026-07-03 06:57:41.376492 | ubuntu-noble-large | {"level":"info","ts":1783061017.9903724,"msg":"Init done"} 2026-07-03 06:57:41.384915 | ubuntu-noble-large | ================================================= 2026-07-03 06:57:41.384964 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Non-primary view 2026-07-03 06:57:41.384971 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b 2026-07-03 06:57:41.384976 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Server status change disconnected -> connected 2026-07-03 06:57:41.384982 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b from 0 (openstack-db-0) 2026-07-03 06:57:41.384987 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.384991 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8ac04437-76aa-11f1-910f-1be6beceef4b from 1 (openstack-db-1) 2026-07-03 06:57:41.385001 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Quorum results: 2026-07-03 06:57:41.385006 | ubuntu-noble-large | version = 6, 2026-07-03 06:57:41.385010 | ubuntu-noble-large | component = PRIMARY, 2026-07-03 06:57:41.385014 | ubuntu-noble-large | conf_id = 1, 2026-07-03 06:57:41.385019 | ubuntu-noble-large | members = 1/2 (joined/total), 2026-07-03 06:57:41.385023 | ubuntu-noble-large | act_id = 1, 2026-07-03 06:57:41.385027 | ubuntu-noble-large | last_appl. = 0, 2026-07-03 06:57:41.385031 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-07-03 06:57:41.385035 | ubuntu-noble-large | vote policy= 0, 2026-07-03 06:57:41.385039 | ubuntu-noble-large | group UUID = 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:41.385043 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Flow-control interval: [23, 23] 2026-07-03 06:57:41.385047 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2026-07-03 06:57:41.385050 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### processing CC 2, local, ordered 2026-07-03 06:57:41.385054 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Process first view: 747a920c-76aa-11f1-8105-5b9b008b772f my uuid: 89b29eee-76aa-11f1-8dce-768ae6febba1 2026-07-03 06:57:41.385059 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Server openstack-db-1 connected to cluster at position 747a920c-76aa-11f1-8105-5b9b008b772f:2 with ID 89b29eee-76aa-11f1-8dce-768ae6febba1 2026-07-03 06:57:41.385064 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Server status change connected -> connected 2026-07-03 06:57:41.385067 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### My UUID: 89b29eee-76aa-11f1-8dce-768ae6febba1 2026-07-03 06:57:41.385089 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes 2026-07-03 06:57:41.385093 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.385096 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 2026-07-03 06:57:41.385101 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: State transfer required: 2026-07-03 06:57:41.385105 | ubuntu-noble-large | Group state: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385108 | ubuntu-noble-large | Local state: 00000000-0000-0000-0000-000000000000:-1 2026-07-03 06:57:41.385111 | ubuntu-noble-large | 2026-07-03 6:43:47 2 [Note] WSREP: Server status change connected -> joiner 2026-07-03 06:57:41.385115 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Joiner monitor thread started to monitor 2026-07-03 06:57:41.385119 | ubuntu-noble-large | 2026-07-03 6:43:47 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.244.0.43:4444' --datadir '/var/lib/mysql/' --parent 1 --progress 0' 2026-07-03 06:57:41.385122 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on joiner (20260703 06:43:47.498) 2026-07-03 06:57:41.385126 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260703 06:43:47.612) 2026-07-03 06:57:41.385138 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260703 06:43:47.964) 2026-07-03 06:57:41.385142 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260703 06:43:47.968) 2026-07-03 06:57:41.385146 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260703 06:43:47.995) 2026-07-03 06:57:41.385149 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260703 06:43:48.001) 2026-07-03 06:57:41.385152 | ubuntu-noble-large | WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20260703 06:43:48.091) 2026-07-03 06:57:41.385156 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260703 06:43:48.107) 2026-07-03 06:57:41.385159 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2026-07-03 06:57:41.385163 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: IST receiver addr using tcp://10.244.0.43:4568 2026-07-03 06:57:41.385166 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://10.244.0.43:4568 2026-07-03 06:57:41.385170 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Member 1.0 (openstack-db-1) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-07-03 06:57:41.385174 | ubuntu-noble-large | 2026-07-03 6:43:48 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2026-07-03 06:57:41.385177 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2026-07-03 06:57:41.385181 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2026-07-03 06:57:41.385248 | ubuntu-noble-large | 2026-07-03 6:43:48 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385254 | ubuntu-noble-large | 2026-07-03 6:43:49 0 [Note] WSREP: (89b29eee-8dce, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-07-03 06:57:41.385257 | ubuntu-noble-large | WSREP_SST: [INFO] Proceeding with SST (20260703 06:43:49.697) 2026-07-03 06:57:41.385263 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260703 06:43:49.697) 2026-07-03 06:57:41.385293 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20260703 06:43:49.758) 2026-07-03 06:57:41.385297 | ubuntu-noble-large | WSREP_SST: [INFO] Waiting for SST streaming to complete! (20260703 06:43:49.782) 2026-07-03 06:57:41.385300 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 1.0 (openstack-db-1) complete. 2026-07-03 06:57:41.385323 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-07-03 06:57:41.385339 | ubuntu-noble-large | WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql/.sst (20260703 06:44:05.589) 2026-07-03 06:57:41.385343 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --prepare --no-version-check --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql/.sst' > '/var/lib/mysql/mariabackup.prepare.log' 2>&1 (20260703 06:44:05.596) 2026-07-03 06:57:41.385349 | ubuntu-noble-large | WSREP_SST: [INFO] Moving the backup to /var/lib/mysql (20260703 06:44:05.808) 2026-07-03 06:57:41.385367 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --move-back --no-version-check --galera-info --force-non-empty-directories --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql' > '/var/lib/mysql/mariabackup.move.log' 2>&1 (20260703 06:44:05.813) 2026-07-03 06:57:41.385384 | ubuntu-noble-large | WSREP_SST: [INFO] Move successful, removing /var/lib/mysql/.sst (20260703 06:44:05.849) 2026-07-03 06:57:41.385388 | ubuntu-noble-large | WSREP_SST: [INFO] Galera co-ords from donor: 747a920c-76aa-11f1-8105-5b9b008b772f:2 0 (20260703 06:44:05.863) 2026-07-03 06:57:41.385392 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on joiner: 0 seconds (20260703 06:44:05.868) 2026-07-03 06:57:41.385395 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on joiner (20260703 06:44:05.877) 2026-07-03 06:57:41.385399 | ubuntu-noble-large | WSREP_SST: [INFO] Removing the sst_in_progress file (20260703 06:44:05.887) 2026-07-03 06:57:41.385415 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260703 06:44:05.899) 2026-07-03 06:57:41.385431 | ubuntu-noble-large | 2026-07-03 6:44:05 3 [Note] WSREP: SST received 2026-07-03 06:57:41.385435 | ubuntu-noble-large | 2026-07-03 6:44:05 3 [Note] WSREP: Server status change joiner -> initializing 2026-07-03 06:57:41.385439 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Compressed tables use zlib 1.3 2026-07-03 06:57:41.385453 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Number of transaction pools: 1 2026-07-03 06:57:41.385457 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Using AVX512 instructions 2026-07-03 06:57:41.385461 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2026-07-03 06:57:41.385491 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Using liburing 2026-07-03 06:57:41.385495 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB 2026-07-03 06:57:41.385498 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Completed initialization of buffer pool 2026-07-03 06:57:41.385502 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-07-03 06:57:41.385505 | ubuntu-noble-large | 2026-07-03 6:44:05 0 [Note] InnoDB: End of log at LSN=57993 2026-07-03 06:57:41.385509 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Resizing redo log from 12.016KiB to 96.000MiB; LSN=57993 2026-07-03 06:57:41.385512 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-07-03 06:57:41.385552 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Opened 3 undo tablespaces 2026-07-03 06:57:41.385576 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. 2026-07-03 06:57:41.385580 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2026-07-03 06:57:41.385583 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2026-07-03 06:57:41.385587 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: log sequence number 57993; transaction id 32 2026-07-03 06:57:41.385590 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2026-07-03 06:57:41.385594 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] Plugin 'FEEDBACK' is disabled. 2026-07-03 06:57:41.385597 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 2026-07-03 06:57:41.385601 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] Server socket created on IP: '0.0.0.0'. 2026-07-03 06:57:41.385604 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] Server socket created on IP: '::'. 2026-07-03 06:57:41.385655 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] mariadbd: Event Scheduler: Loaded 0 events 2026-07-03 06:57:41.385660 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2026-07-03 06:57:41.385663 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Server initialized 2026-07-03 06:57:41.385667 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Server status change initializing -> initialized 2026-07-03 06:57:41.385853 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: Recovered position from storage: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385858 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: Server status change initialized -> joined 2026-07-03 06:57:41.385861 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: Recovered view from SST: 2026-07-03 06:57:41.385867 | ubuntu-noble-large | id: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385878 | ubuntu-noble-large | status: primary 2026-07-03 06:57:41.385882 | ubuntu-noble-large | protocol_version: 4 2026-07-03 06:57:41.385886 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-07-03 06:57:41.385889 | ubuntu-noble-large | final: no 2026-07-03 06:57:41.385893 | ubuntu-noble-large | own_index: 1 2026-07-03 06:57:41.385899 | ubuntu-noble-large | members(2): 2026-07-03 06:57:41.385903 | ubuntu-noble-large | 0: 74715322-76aa-11f1-a6c8-62ca602be188, openstack-db-0 2026-07-03 06:57:41.385906 | ubuntu-noble-large | 1: 89b29eee-76aa-11f1-8dce-768ae6febba1, openstack-db-1 2026-07-03 06:57:41.385910 | ubuntu-noble-large | 2026-07-03 06:57:41.385914 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.385918 | ubuntu-noble-large | 2026-07-03 6:44:06 6 [Note] WSREP: Recovered cluster id 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:41.385921 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: SST received: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385924 | ubuntu-noble-large | 2026-07-03 6:44:06 3 [Note] WSREP: SST succeeded for position 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385928 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Joiner monitor thread ended with total time 19 sec 2026-07-03 06:57:41.385931 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Installed new state from SST: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385935 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] mariadbd: ready for connections. 2026-07-03 06:57:41.385938 | ubuntu-noble-large | Version: '11.4.5-MariaDB-ubu2404' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2026-07-03 06:57:41.385941 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Cert. index preload up to 2 2026-07-03 06:57:41.385945 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: ####### IST applying starts with 3 2026-07-03 06:57:41.385948 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: ####### IST current seqno initialized to 2 2026-07-03 06:57:41.385952 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2026-07-03 06:57:41.385958 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: IST preload starting at 2 2026-07-03 06:57:41.385961 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:41.385964 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.385968 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: ####### Assign initial position for certification: 747a920c-76aa-11f1-8105-5b9b008b772f:1, protocol version: 6 2026-07-03 06:57:41.385971 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:41.385975 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2026-07-03 06:57:41.385978 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.385981 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 2 2026-07-03 06:57:41.385985 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2026-07-03 06:57:41.385988 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete. 2026-07-03 06:57:41.385991 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: IST received: 747a920c-76aa-11f1-8105-5b9b008b772f:2 2026-07-03 06:57:41.385995 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 2 2026-07-03 06:57:41.386002 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Min available from gcache for CC from sst: 2 2026-07-03 06:57:41.386008 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: 1.0 (openstack-db-1): State transfer from 0.0 (openstack-db-0) complete. 2026-07-03 06:57:41.386012 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2026-07-03 06:57:41.386015 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-07-03 06:57:41.386019 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Member 1.0 (openstack-db-1) synced with group. 2026-07-03 06:57:41.386022 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-07-03 06:57:41.386026 | ubuntu-noble-large | 2026-07-03 6:44:06 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2026-07-03 06:57:41.386029 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Server openstack-db-1 synced with group 2026-07-03 06:57:41.386032 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Server status change joined -> synced 2026-07-03 06:57:41.386036 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: Synchronized with group, ready for connections 2026-07-03 06:57:41.386039 | ubuntu-noble-large | 2026-07-03 6:44:06 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.386043 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: (89b29eee-8dce, 'tcp://0.0.0.0:4567') connection established to 9db38154-a0e4 tcp://10.244.0.44:4567 2026-07-03 06:57:41.386046 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 74715322-a6c8 at tcp://10.244.0.41:4567 stable 2026-07-03 06:57:41.386049 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 9db38154-a0e4 at tcp://10.244.0.44:4567 stable 2026-07-03 06:57:41.386053 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: Node 74715322-a6c8 state prim 2026-07-03 06:57:41.386056 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: view(view_id(PRIM,74715322-a6c8,3) memb { 2026-07-03 06:57:41.386060 | ubuntu-noble-large | 74715322-a6c8,0 2026-07-03 06:57:41.386063 | ubuntu-noble-large | 89b29eee-8dce,0 2026-07-03 06:57:41.386066 | ubuntu-noble-large | 9db38154-a0e4,0 2026-07-03 06:57:41.386072 | ubuntu-noble-large | } joined { 2026-07-03 06:57:41.386075 | ubuntu-noble-large | } left { 2026-07-03 06:57:41.386078 | ubuntu-noble-large | } partitioned { 2026-07-03 06:57:41.386082 | ubuntu-noble-large | }) 2026-07-03 06:57:41.386439 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: save pc into disk 2026-07-03 06:57:41.386475 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2026-07-03 06:57:41.386481 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2026-07-03 06:57:41.386485 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 2026-07-03 06:57:41.386488 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 1 (openstack-db-1) 2026-07-03 06:57:41.386492 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 0 (openstack-db-0) 2026-07-03 06:57:41.386496 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 2 (openstack-db-2) 2026-07-03 06:57:41.386499 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Quorum results: 2026-07-03 06:57:41.386503 | ubuntu-noble-large | version = 6, 2026-07-03 06:57:41.386506 | ubuntu-noble-large | component = PRIMARY, 2026-07-03 06:57:41.386509 | ubuntu-noble-large | conf_id = 2, 2026-07-03 06:57:41.386513 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-07-03 06:57:41.386542 | ubuntu-noble-large | act_id = 2, 2026-07-03 06:57:41.386546 | ubuntu-noble-large | last_appl. = 0, 2026-07-03 06:57:41.386549 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-07-03 06:57:41.386552 | ubuntu-noble-large | vote policy= 0, 2026-07-03 06:57:41.386556 | ubuntu-noble-large | group UUID = 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:41.386559 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-07-03 06:57:41.386566 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-07-03 06:57:41.386569 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### My UUID: 89b29eee-76aa-11f1-8dce-768ae6febba1 2026-07-03 06:57:41.386573 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Skipping cert index reset 2026-07-03 06:57:41.386583 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:41.386586 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-07-03 06:57:41.386590 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.386593 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ================================================ 2026-07-03 06:57:41.386597 | ubuntu-noble-large | View: 2026-07-03 06:57:41.386600 | ubuntu-noble-large | id: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.386604 | ubuntu-noble-large | status: primary 2026-07-03 06:57:41.386607 | ubuntu-noble-large | protocol_version: 4 2026-07-03 06:57:41.386611 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-07-03 06:57:41.386614 | ubuntu-noble-large | final: no 2026-07-03 06:57:41.386618 | ubuntu-noble-large | own_index: 1 2026-07-03 06:57:41.386621 | ubuntu-noble-large | members(3): 2026-07-03 06:57:41.386625 | ubuntu-noble-large | 0: 74715322-76aa-11f1-a6c8-62ca602be188, openstack-db-0 2026-07-03 06:57:41.386628 | ubuntu-noble-large | 1: 89b29eee-76aa-11f1-8dce-768ae6febba1, openstack-db-1 2026-07-03 06:57:41.386632 | ubuntu-noble-large | 2: 9db38154-76aa-11f1-a0e4-5f77cf226244, openstack-db-2 2026-07-03 06:57:41.386635 | ubuntu-noble-large | ================================================= 2026-07-03 06:57:41.386639 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.386642 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Lowest cert index boundary for CC from group: 3 2026-07-03 06:57:41.386646 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Min available from gcache for CC from group: 2 2026-07-03 06:57:41.386649 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-07-03 06:57:41.386653 | ubuntu-noble-large | 2026-07-03 6:44:23 0 [Note] WSREP: (89b29eee-8dce, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-07-03 06:57:41.386656 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-07-03 06:57:41.386664 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-07-03 06:57:41.386668 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-07-03 06:57:41.386671 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-07-03 06:57:41.386675 | ubuntu-noble-large | 2026-07-03 6:45:33 26 [Warning] Aborted connection 26 to db: 'keystone' user: 'controlplane-keystone' host: '10.244.0.45' (Got an error reading communication packets) 2026-07-03 06:57:41.393009 | ubuntu-noble-large | {"level":"info","ts":1783061018.9391181,"msg":"Agent starting"} 2026-07-03 06:57:41.393048 | ubuntu-noble-large | {"level":"info","ts":1783061018.9394586,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-07-03 06:57:41.393053 | ubuntu-noble-large | {"level":"info","ts":1783061018.9419036,"logger":"api","msg":"Configuring TLS"} 2026-07-03 06:57:41.393064 | ubuntu-noble-large | {"level":"info","ts":1783061018.9445095,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-07-03 06:57:41.393069 | ubuntu-noble-large | {"level":"info","ts":1783061018.9445937,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-07-03 06:57:41.393076 | ubuntu-noble-large | {"level":"error","ts":1783061040.4375834,"logger":"probe.liveness","msg":"error getting SQL client","error":"dial tcp [::1]:3306: connect: connection refused","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Liveness\n\t/app/pkg/galera/agent/handler/probe.go:67\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-07-03 06:57:41.393098 | ubuntu-noble-large | 2026/07/03 06:44:41 "DELETE https://openstack-db-1.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.19:39702 - 404 41B in 4.680204ms 2026-07-03 06:57:41.398836 | ubuntu-noble-large | --- logs pod/openstack-db-1 (previous) --- 2026-07-03 06:57:41.520972 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "init" in pod "openstack-db-1" not found 2026-07-03 06:57:41.525146 | ubuntu-noble-large | --- describe pod/openstack-db-2 --- 2026-07-03 06:57:41.644744 | ubuntu-noble-large | Name: openstack-db-2 2026-07-03 06:57:41.644845 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:41.644859 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:41.644869 | ubuntu-noble-large | Service Account: openstack-db 2026-07-03 06:57:41.644880 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:41.644891 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:43:11 +0000 2026-07-03 06:57:41.644900 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-db 2026-07-03 06:57:41.644910 | ubuntu-noble-large | app.kubernetes.io/name=mariadb 2026-07-03 06:57:41.644920 | ubuntu-noble-large | apps.kubernetes.io/pod-index=2 2026-07-03 06:57:41.644930 | ubuntu-noble-large | controller-revision-hash=openstack-db-f48987fbf 2026-07-03 06:57:41.644940 | ubuntu-noble-large | k8s.mariadb.com/role=replica 2026-07-03 06:57:41.644949 | ubuntu-noble-large | statefulset.kubernetes.io/pod-name=openstack-db-2 2026-07-03 06:57:41.644960 | ubuntu-noble-large | Annotations: k8s.mariadb.com/ca: 6af4942ab90e621aaeb4962c0bdbad83799aab604deec714102280b4726e3409 2026-07-03 06:57:41.644970 | ubuntu-noble-large | k8s.mariadb.com/client-cert: 29b59d6de7b57529398f6a03cff81fff8f2eddb129482df0ae5e158e051d9f31 2026-07-03 06:57:41.644980 | ubuntu-noble-large | k8s.mariadb.com/config-galera: 757bb1c1291218e5f4f33f493a35eb5f0352ef68f5b84445811b41b2370a0e48 2026-07-03 06:57:41.644991 | ubuntu-noble-large | k8s.mariadb.com/config-tls: 169a08c8cb9d9b89643267e720eb6e3c3c7894d6c18d429404a88d762c7388cd 2026-07-03 06:57:41.645001 | ubuntu-noble-large | k8s.mariadb.com/galera: 2026-07-03 06:57:41.645011 | ubuntu-noble-large | k8s.mariadb.com/mariadb: openstack-db 2026-07-03 06:57:41.645021 | ubuntu-noble-large | k8s.mariadb.com/server-cert: f4889bc7e8bdd97f326bd3435ace6ea30f6a24fe4fc13fa50dbb6671a1736ab1 2026-07-03 06:57:41.645031 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:41.645040 | ubuntu-noble-large | IP: 10.244.0.44 2026-07-03 06:57:41.645050 | ubuntu-noble-large | IPs: 2026-07-03 06:57:41.645061 | ubuntu-noble-large | IP: 10.244.0.44 2026-07-03 06:57:41.645071 | ubuntu-noble-large | Controlled By: StatefulSet/openstack-db 2026-07-03 06:57:41.645080 | ubuntu-noble-large | Init Containers: 2026-07-03 06:57:41.645090 | ubuntu-noble-large | init: 2026-07-03 06:57:41.645100 | ubuntu-noble-large | Container ID: containerd://d5c182b7ee880c3db906274369eb03e369c10482d5b7209ab38d00eb1d7812b6 2026-07-03 06:57:41.645110 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:41.645138 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:41.645150 | ubuntu-noble-large | Port: 2026-07-03 06:57:41.645160 | ubuntu-noble-large | Host Port: 2026-07-03 06:57:41.645170 | ubuntu-noble-large | Args: 2026-07-03 06:57:41.645180 | ubuntu-noble-large | init 2026-07-03 06:57:41.645190 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:41.645200 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:41.645210 | ubuntu-noble-large | State: Terminated 2026-07-03 06:57:41.645220 | ubuntu-noble-large | Reason: Completed 2026-07-03 06:57:41.645230 | ubuntu-noble-large | Exit Code: 0 2026-07-03 06:57:41.645240 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:43:11 +0000 2026-07-03 06:57:41.645250 | ubuntu-noble-large | Finished: Fri, 03 Jul 2026 06:44:11 +0000 2026-07-03 06:57:41.645293 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.645304 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.645314 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.645324 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.645334 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.645344 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.645354 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-07-03 06:57:41.645364 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.645374 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.645384 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.645393 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.645403 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.645413 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.645423 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.645433 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.645462 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.645473 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.645483 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.645493 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.645503 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.645513 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.645562 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.645573 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.645583 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.645593 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.645602 | ubuntu-noble-large | Containers: 2026-07-03 06:57:41.645612 | ubuntu-noble-large | mariadb: 2026-07-03 06:57:41.645622 | ubuntu-noble-large | Container ID: containerd://85014da0a4bc324e26138613a83092f33f66ebcd1971d79c3c8bb2ba31783d25 2026-07-03 06:57:41.645632 | ubuntu-noble-large | Image: docker-registry1.mariadb.com/library/mariadb:11.4.5 2026-07-03 06:57:41.645642 | ubuntu-noble-large | Image ID: docker-registry1.mariadb.com/library/mariadb@sha256:49117dcc565cf51aa57ac5fca59ab31213402ff0eae6ffc13c46a37b938f7e4b 2026-07-03 06:57:41.645653 | ubuntu-noble-large | Ports: 3306/TCP (mariadb), 4567/TCP (cluster), 4568/TCP (ist), 4444/TCP (sst) 2026-07-03 06:57:41.645663 | ubuntu-noble-large | Host Ports: 0/TCP (mariadb), 0/TCP (cluster), 0/TCP (ist), 0/TCP (sst) 2026-07-03 06:57:41.645672 | ubuntu-noble-large | State: Running 2026-07-03 06:57:41.645682 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:44:11 +0000 2026-07-03 06:57:41.645692 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.645701 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.645711 | ubuntu-noble-large | Liveness: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.645721 | ubuntu-noble-large | Readiness: http-get http://:5566/readiness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.645750 | ubuntu-noble-large | Startup: http-get http://:5566/liveness delay=20s timeout=5s period=10s #success=1 #failure=3 2026-07-03 06:57:41.645761 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.645770 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.645780 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.645789 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.645799 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-07-03 06:57:41.645808 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.645818 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.645827 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.645836 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.645846 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.645855 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.645875 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.645885 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.645894 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.645904 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.645913 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.645923 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.645932 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.645942 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.645951 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.645961 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.645970 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.645980 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.645989 | ubuntu-noble-large | agent: 2026-07-03 06:57:41.645999 | ubuntu-noble-large | Container ID: containerd://a96f3e2b1ee769d6a33dd6a6f4ff79cfdcf146a2cf1e0abcb27c7d2cced66c68 2026-07-03 06:57:41.646008 | ubuntu-noble-large | Image: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1 2026-07-03 06:57:41.646018 | ubuntu-noble-large | Image ID: docker-registry3.mariadb.com/mariadb-operator/mariadb-operator@sha256:64cede8bb930e4c9a899084583878e4fe883c3fc34456c7dac56886fc30ead38 2026-07-03 06:57:41.646028 | ubuntu-noble-large | Ports: 5555/TCP (agent), 5566/TCP (agent-probe) 2026-07-03 06:57:41.646044 | ubuntu-noble-large | Host Ports: 0/TCP (agent), 0/TCP (agent-probe) 2026-07-03 06:57:41.646054 | ubuntu-noble-large | Args: 2026-07-03 06:57:41.646064 | ubuntu-noble-large | agent 2026-07-03 06:57:41.646074 | ubuntu-noble-large | --addr=:5555 2026-07-03 06:57:41.646083 | ubuntu-noble-large | --probe-addr=:5566 2026-07-03 06:57:41.646093 | ubuntu-noble-large | --config-dir=/etc/mysql/mariadb.conf.d 2026-07-03 06:57:41.646102 | ubuntu-noble-large | --state-dir=/var/lib/mysql 2026-07-03 06:57:41.646112 | ubuntu-noble-large | --graceful-shutdown-timeout=1s 2026-07-03 06:57:41.646121 | ubuntu-noble-large | --kubernetes-auth 2026-07-03 06:57:41.646131 | ubuntu-noble-large | --kubernetes-trusted-name=mariadb-operator 2026-07-03 06:57:41.646140 | ubuntu-noble-large | --kubernetes-trusted-namespace=mariadb-system 2026-07-03 06:57:41.646150 | ubuntu-noble-large | State: Running 2026-07-03 06:57:41.646159 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:44:12 +0000 2026-07-03 06:57:41.646169 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:41.646178 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:41.646188 | ubuntu-noble-large | Liveness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:41.646198 | ubuntu-noble-large | Readiness: http-get http://:5566/health delay=0s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:41.646207 | ubuntu-noble-large | Environment: 2026-07-03 06:57:41.646217 | ubuntu-noble-large | MYSQL_TCP_PORT: 3306 2026-07-03 06:57:41.646226 | ubuntu-noble-large | MARIADB_ROOT_HOST: % 2026-07-03 06:57:41.646236 | ubuntu-noble-large | CLUSTER_NAME: cluster.local 2026-07-03 06:57:41.646245 | ubuntu-noble-large | POD_NAME: openstack-db-2 (v1:metadata.name) 2026-07-03 06:57:41.646255 | ubuntu-noble-large | POD_NAMESPACE: openstack (v1:metadata.namespace) 2026-07-03 06:57:41.646264 | ubuntu-noble-large | POD_IP: (v1:status.podIP) 2026-07-03 06:57:41.646273 | ubuntu-noble-large | MARIADB_NAME: openstack-db 2026-07-03 06:57:41.646283 | ubuntu-noble-large | TLS_ENABLED: true 2026-07-03 06:57:41.646292 | ubuntu-noble-large | TLS_CA_CERT_PATH: /etc/pki/ca.crt 2026-07-03 06:57:41.646302 | ubuntu-noble-large | TLS_SERVER_CERT_PATH: /etc/pki/server.crt 2026-07-03 06:57:41.646311 | ubuntu-noble-large | TLS_SERVER_KEY_PATH: /etc/pki/server.key 2026-07-03 06:57:41.646320 | ubuntu-noble-large | TLS_CLIENT_CERT_PATH: /etc/pki/client.crt 2026-07-03 06:57:41.646330 | ubuntu-noble-large | TLS_CLIENT_KEY_PATH: /etc/pki/client.key 2026-07-03 06:57:41.646339 | ubuntu-noble-large | WSREP_SST_OPT_REMOTE_AUTH: openstack-db-client: 2026-07-03 06:57:41.646349 | ubuntu-noble-large | MARIADB_ROOT_PASSWORD: Optional: false 2026-07-03 06:57:41.646358 | ubuntu-noble-large | MYSQL_INITDB_SKIP_TZINFO: 1 2026-07-03 06:57:41.646368 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:41.646384 | ubuntu-noble-large | /etc/mysql/conf.d from config (rw) 2026-07-03 06:57:41.646393 | ubuntu-noble-large | /etc/mysql/mariadb.conf.d from galera (rw) 2026-07-03 06:57:41.646403 | ubuntu-noble-large | /etc/pki from pki (rw) 2026-07-03 06:57:41.646412 | ubuntu-noble-large | /var/lib/mysql from storage (rw) 2026-07-03 06:57:41.646422 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from serviceaccount (rw) 2026-07-03 06:57:41.646431 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:41.646441 | ubuntu-noble-large | Type Status 2026-07-03 06:57:41.646515 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:41.646557 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:41.646568 | ubuntu-noble-large | Ready True 2026-07-03 06:57:41.646577 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:41.646587 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:41.646597 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:41.646607 | ubuntu-noble-large | storage: 2026-07-03 06:57:41.646617 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:41.646627 | ubuntu-noble-large | ClaimName: storage-openstack-db-2 2026-07-03 06:57:41.646636 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:41.646646 | ubuntu-noble-large | galera: 2026-07-03 06:57:41.646656 | ubuntu-noble-large | Type: PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace) 2026-07-03 06:57:41.646666 | ubuntu-noble-large | ClaimName: galera-openstack-db-2 2026-07-03 06:57:41.646676 | ubuntu-noble-large | ReadOnly: false 2026-07-03 06:57:41.646686 | ubuntu-noble-large | config: 2026-07-03 06:57:41.646696 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.646714 | ubuntu-noble-large | ConfigMapName: openstack-db-config-default 2026-07-03 06:57:41.646725 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646735 | ubuntu-noble-large | ConfigMapName: openstack-db-config-tls 2026-07-03 06:57:41.646745 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646755 | ubuntu-noble-large | pki: 2026-07-03 06:57:41.646765 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.646775 | ubuntu-noble-large | SecretName: openstack-db-ca-bundle 2026-07-03 06:57:41.646784 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646794 | ubuntu-noble-large | SecretName: openstack-db-client-cert 2026-07-03 06:57:41.646804 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646813 | ubuntu-noble-large | SecretName: openstack-db-server-cert 2026-07-03 06:57:41.646823 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646833 | ubuntu-noble-large | serviceaccount: 2026-07-03 06:57:41.646843 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:41.646853 | ubuntu-noble-large | TokenExpirationSeconds: 3600 2026-07-03 06:57:41.646863 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:41.646872 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:41.646882 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:41.646892 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:41.646901 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:41.646911 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:41.646921 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:41.646931 | ubuntu-noble-large | Events: 2026-07-03 06:57:41.646941 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:41.646951 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:41.646960 | ubuntu-noble-large | Normal Scheduled 14m default-scheduler Successfully assigned openstack/openstack-db-2 to forge-control-plane 2026-07-03 06:57:41.646972 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.initContainers{init}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.646983 | ubuntu-noble-large | Normal Created 14m kubelet spec.initContainers{init}: Container created 2026-07-03 06:57:41.646993 | ubuntu-noble-large | Normal Started 14m kubelet spec.initContainers{init}: Container started 2026-07-03 06:57:41.647011 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{mariadb}: Container image "docker-registry1.mariadb.com/library/mariadb:11.4.5" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.647030 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{mariadb}: Container created 2026-07-03 06:57:41.647040 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{mariadb}: Container started 2026-07-03 06:57:41.647050 | ubuntu-noble-large | Normal Pulled 13m kubelet spec.containers{agent}: Container image "docker-registry3.mariadb.com/mariadb-operator/mariadb-operator:0.38.1" already present on machine and can be accessed by the pod 2026-07-03 06:57:41.647060 | ubuntu-noble-large | Normal Created 13m kubelet spec.containers{agent}: Container created 2026-07-03 06:57:41.647070 | ubuntu-noble-large | Normal Started 13m kubelet spec.containers{agent}: Container started 2026-07-03 06:57:41.647080 | ubuntu-noble-large | Warning Unhealthy 13m kubelet spec.containers{agent}: Readiness probe failed: Get "http://10.244.0.44:5566/health": dial tcp 10.244.0.44:5566: connect: connection refused 2026-07-03 06:57:41.647090 | ubuntu-noble-large | Warning Unhealthy 13m kubelet spec.containers{mariadb}: Startup probe failed: HTTP probe failed with statuscode: 500 2026-07-03 06:57:41.648548 | ubuntu-noble-large | --- logs pod/openstack-db-2 (current) --- 2026-07-03 06:57:41.782372 | ubuntu-noble-large | {"level":"info","ts":1783060991.9472713,"msg":"Starting init"} 2026-07-03 06:57:41.782497 | ubuntu-noble-large | {"level":"info","ts":1783060991.988603,"msg":"Configuring Galera"} 2026-07-03 06:57:41.782514 | ubuntu-noble-large | {"level":"info","ts":1783060991.9891074,"msg":"Waiting for previous Pod to be ready","pod":"openstack-db-1"} 2026-07-03 06:57:41.782580 | ubuntu-noble-large | {"level":"info","ts":1783061050.9958084,"msg":"Init done"} 2026-07-03 06:57:41.793599 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2026-07-03 06:57:41.793671 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: restore pc from disk failed 2026-07-03 06:57:41.793682 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: GMCast version 0 2026-07-03 06:57:41.793693 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: (9db38154-a0e4, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2026-07-03 06:57:41.793703 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: (9db38154-a0e4, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2026-07-03 06:57:41.793713 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: EVS version 1 2026-07-03 06:57:41.793726 | ubuntu-noble-large | 2026-07-03 6:44:18 0 [Note] WSREP: gcomm: connecting to group 'mariadb-operator', peer 'openstack-db-0.openstack-db-internal.openstack.svc.cluster.local:,openstack-db-1.openstack-db-internal.openstack.svc.cluster.local:,openstack-db-2.openstack-db-internal.openstack.svc.cluster.local:' 2026-07-03 06:57:41.793738 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: EVS version upgrade 0 -> 1 2026-07-03 06:57:41.793748 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2026-07-03 06:57:41.793758 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: No nodes coming from primary view, primary view is not possible 2026-07-03 06:57:41.793768 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: view(view_id(NON_PRIM,9db38154-a0e4,1) memb { 2026-07-03 06:57:41.793778 | ubuntu-noble-large | 9db38154-a0e4,0 2026-07-03 06:57:41.793789 | ubuntu-noble-large | } joined { 2026-07-03 06:57:41.793800 | ubuntu-noble-large | } left { 2026-07-03 06:57:41.793809 | ubuntu-noble-large | } partitioned { 2026-07-03 06:57:41.793820 | ubuntu-noble-large | }) 2026-07-03 06:57:41.793831 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: Failed to establish connection: wrong version number (SSL routines) 2026-07-03 06:57:41.793841 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: (9db38154-a0e4, 'tcp://0.0.0.0:4567') connection established to 74715322-a6c8 tcp://10.244.0.41:4567 2026-07-03 06:57:41.793852 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: (9db38154-a0e4, 'tcp://0.0.0.0:4567') connection established to 89b29eee-8dce tcp://10.244.0.43:4567 2026-07-03 06:57:41.793862 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 74715322-a6c8 at tcp://10.244.0.41:4567 stable 2026-07-03 06:57:41.793883 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: declaring 89b29eee-8dce at tcp://10.244.0.43:4567 stable 2026-07-03 06:57:41.793893 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: Node 74715322-a6c8 state prim 2026-07-03 06:57:41.793934 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: view(view_id(PRIM,74715322-a6c8,3) memb { 2026-07-03 06:57:41.793945 | ubuntu-noble-large | 74715322-a6c8,0 2026-07-03 06:57:41.793955 | ubuntu-noble-large | 89b29eee-8dce,0 2026-07-03 06:57:41.793965 | ubuntu-noble-large | 9db38154-a0e4,0 2026-07-03 06:57:41.793974 | ubuntu-noble-large | } joined { 2026-07-03 06:57:41.793984 | ubuntu-noble-large | } left { 2026-07-03 06:57:41.793994 | ubuntu-noble-large | } partitioned { 2026-07-03 06:57:41.794004 | ubuntu-noble-large | }) 2026-07-03 06:57:41.794014 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: save pc into disk 2026-07-03 06:57:41.794024 | ubuntu-noble-large | 2026-07-03 6:44:20 0 [Note] WSREP: discarding pending addr without UUID: tcp://10.244.0.44:4567 2026-07-03 06:57:41.794034 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: gcomm: connected 2026-07-03 06:57:41.794044 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2026-07-03 06:57:41.794055 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT2.26021S), skipping check 2026-07-03 06:57:41.794065 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2026-07-03 06:57:41.794075 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Opened channel 'mariadb-operator' 2026-07-03 06:57:41.794085 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2026-07-03 06:57:41.794095 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Flow-control interval: [16, 16] 2026-07-03 06:57:41.794119 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Received NON-PRIMARY. 2026-07-03 06:57:41.794130 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2026-07-03 06:57:41.794140 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2026-07-03 06:57:41.794150 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 2026-07-03 06:57:41.794160 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Initializing config service v1 2026-07-03 06:57:41.794169 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 1 (openstack-db-1) 2026-07-03 06:57:41.794180 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 0 (openstack-db-0) 2026-07-03 06:57:41.794190 | ubuntu-noble-large | 2026-07-03 6:44:21 1 [Note] WSREP: Starting rollbacker thread 1 2026-07-03 06:57:41.794199 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Starting applier thread 2 2026-07-03 06:57:41.794209 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ================================================ 2026-07-03 06:57:41.794219 | ubuntu-noble-large | View: 2026-07-03 06:57:41.794230 | ubuntu-noble-large | id: 00000000-0000-0000-0000-000000000000:-1 2026-07-03 06:57:41.794240 | ubuntu-noble-large | status: non-primary 2026-07-03 06:57:41.794249 | ubuntu-noble-large | protocol_version: -1 2026-07-03 06:57:41.794259 | ubuntu-noble-large | capabilities: 2026-07-03 06:57:41.794269 | ubuntu-noble-large | final: no 2026-07-03 06:57:41.794279 | ubuntu-noble-large | own_index: 0 2026-07-03 06:57:41.794289 | ubuntu-noble-large | members(1): 2026-07-03 06:57:41.794299 | ubuntu-noble-large | 0: 9db38154-76aa-11f1-a0e4-5f77cf226244, openstack-db-2 2026-07-03 06:57:41.794309 | ubuntu-noble-large | ================================================= 2026-07-03 06:57:41.794319 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Non-primary view 2026-07-03 06:57:41.794328 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Server status change disconnected -> connected 2026-07-03 06:57:41.794338 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.794348 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Deinitializing config service v1 2026-07-03 06:57:41.794358 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9ec1bbf9-76aa-11f1-8351-f777650be2d8 from 2 (openstack-db-2) 2026-07-03 06:57:41.794368 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Quorum results: 2026-07-03 06:57:41.794378 | ubuntu-noble-large | version = 6, 2026-07-03 06:57:41.794387 | ubuntu-noble-large | component = PRIMARY, 2026-07-03 06:57:41.794397 | ubuntu-noble-large | conf_id = 2, 2026-07-03 06:57:41.794407 | ubuntu-noble-large | members = 2/3 (joined/total), 2026-07-03 06:57:41.794417 | ubuntu-noble-large | act_id = 2, 2026-07-03 06:57:41.794427 | ubuntu-noble-large | last_appl. = 0, 2026-07-03 06:57:41.794490 | ubuntu-noble-large | protocols = 5/11/4 (gcs/repl/appl), 2026-07-03 06:57:41.794503 | ubuntu-noble-large | vote policy= 0, 2026-07-03 06:57:41.794513 | ubuntu-noble-large | group UUID = 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:41.794549 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Flow-control interval: [28, 28] 2026-07-03 06:57:41.794565 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 3) 2026-07-03 06:57:41.794574 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### processing CC 3, local, ordered 2026-07-03 06:57:41.794584 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Process first view: 747a920c-76aa-11f1-8105-5b9b008b772f my uuid: 9db38154-76aa-11f1-a0e4-5f77cf226244 2026-07-03 06:57:41.794595 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Server openstack-db-2 connected to cluster at position 747a920c-76aa-11f1-8105-5b9b008b772f:3 with ID 9db38154-76aa-11f1-a0e4-5f77cf226244 2026-07-03 06:57:41.794606 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Server status change connected -> connected 2026-07-03 06:57:41.794616 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### My UUID: 9db38154-76aa-11f1-a0e4-5f77cf226244 2026-07-03 06:57:41.794625 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 11), state transfer needed: yes 2026-07-03 06:57:41.794635 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.794645 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 2026-07-03 06:57:41.794656 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: State transfer required: 2026-07-03 06:57:41.794666 | ubuntu-noble-large | Group state: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.794684 | ubuntu-noble-large | Local state: 00000000-0000-0000-0000-000000000000:-1 2026-07-03 06:57:41.794695 | ubuntu-noble-large | 2026-07-03 6:44:21 2 [Note] WSREP: Server status change connected -> joiner 2026-07-03 06:57:41.794705 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Joiner monitor thread started to monitor 2026-07-03 06:57:41.794714 | ubuntu-noble-large | 2026-07-03 6:44:21 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.244.0.44:4444' --datadir '/var/lib/mysql/' --parent 1 --progress 0' 2026-07-03 06:57:41.794724 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST started on joiner (20260703 06:44:21.091) 2026-07-03 06:57:41.794734 | ubuntu-noble-large | WSREP_SST: [INFO] SSL configuration: CA='', CAPATH='', CERT='', KEY='', MODE='DISABLED', encrypt='0' (20260703 06:44:21.205) 2026-07-03 06:57:41.794745 | ubuntu-noble-large | WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/bin:/usr/local/sbin:/usr/bin:/bin:/usr/sbin:/sbin (20260703 06:44:21.590) 2026-07-03 06:57:41.794755 | ubuntu-noble-large | WSREP_SST: [INFO] Disabling all progress/rate-limiting (20260703 06:44:21.596) 2026-07-03 06:57:41.794765 | ubuntu-noble-large | WSREP_SST: [INFO] Streaming with mbstream (20260703 06:44:21.623) 2026-07-03 06:57:41.794775 | ubuntu-noble-large | WSREP_SST: [INFO] Using socat as streamer (20260703 06:44:21.629) 2026-07-03 06:57:41.794784 | ubuntu-noble-large | WSREP_SST: [INFO] 'ss' is selected as a socket information utility. (20260703 06:44:21.722) 2026-07-03 06:57:41.794794 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260703 06:44:21.744) 2026-07-03 06:57:41.794804 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 3, STRv: 3 2026-07-03 06:57:41.794814 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: IST receiver addr using tcp://10.244.0.44:4568 2026-07-03 06:57:41.794823 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Prepared IST receiver for 0-3, listening at: tcp://10.244.0.44:4568 2026-07-03 06:57:41.794834 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Member 2.0 (openstack-db-2) requested state transfer from '*any*'. Selected 0.0 (openstack-db-0)(SYNCED) as donor. 2026-07-03 06:57:41.794844 | ubuntu-noble-large | 2026-07-03 6:44:22 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 3) 2026-07-03 06:57:41.794853 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2026-07-03 06:57:41.794871 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2026-07-03 06:57:41.794881 | ubuntu-noble-large | 2026-07-03 6:44:22 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.794891 | ubuntu-noble-large | WSREP_SST: [INFO] Proceeding with SST (20260703 06:44:23.306) 2026-07-03 06:57:41.794901 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20260703 06:44:23.308) 2026-07-03 06:57:41.794911 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20260703 06:44:23.365) 2026-07-03 06:57:41.794921 | ubuntu-noble-large | WSREP_SST: [INFO] Waiting for SST streaming to complete! (20260703 06:44:23.387) 2026-07-03 06:57:41.794930 | ubuntu-noble-large | 2026-07-03 6:44:23 0 [Note] WSREP: (9db38154-a0e4, 'tcp://0.0.0.0:4567') turning message relay requesting off 2026-07-03 06:57:41.794940 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 0.0 (openstack-db-0): State transfer to 2.0 (openstack-db-2) complete. 2026-07-03 06:57:41.794950 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 0.0 (openstack-db-0) synced with group. 2026-07-03 06:57:41.794960 | ubuntu-noble-large | WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql/.sst (20260703 06:44:39.240) 2026-07-03 06:57:41.794969 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --prepare --no-version-check --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql/.sst' > '/var/lib/mysql/mariabackup.prepare.log' 2>&1 (20260703 06:44:39.247) 2026-07-03 06:57:41.794979 | ubuntu-noble-large | WSREP_SST: [INFO] Moving the backup to /var/lib/mysql (20260703 06:44:39.449) 2026-07-03 06:57:41.794991 | ubuntu-noble-large | WSREP_SST: [INFO] Evaluating /usr//bin/mariadb-backup --move-back --no-version-check --galera-info --force-non-empty-directories --target-dir='/var/lib/mysql/.sst' --datadir='/var/lib/mysql' > '/var/lib/mysql/mariabackup.move.log' 2>&1 (20260703 06:44:39.456) 2026-07-03 06:57:41.795001 | ubuntu-noble-large | WSREP_SST: [INFO] Move successful, removing /var/lib/mysql/.sst (20260703 06:44:39.494) 2026-07-03 06:57:41.795011 | ubuntu-noble-large | WSREP_SST: [INFO] Galera co-ords from donor: 747a920c-76aa-11f1-8105-5b9b008b772f:3 0 (20260703 06:44:39.507) 2026-07-03 06:57:41.795021 | ubuntu-noble-large | WSREP_SST: [INFO] Total time on joiner: 0 seconds (20260703 06:44:39.512) 2026-07-03 06:57:41.795031 | ubuntu-noble-large | WSREP_SST: [INFO] mariabackup SST completed on joiner (20260703 06:44:39.517) 2026-07-03 06:57:41.795041 | ubuntu-noble-large | WSREP_SST: [INFO] Removing the sst_in_progress file (20260703 06:44:39.526) 2026-07-03 06:57:41.795050 | ubuntu-noble-large | WSREP_SST: [INFO] Cleaning up temporary directories (20260703 06:44:39.533) 2026-07-03 06:57:41.795060 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: SST received 2026-07-03 06:57:41.795070 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: Server status change joiner -> initializing 2026-07-03 06:57:41.795086 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Compressed tables use zlib 1.3 2026-07-03 06:57:41.795096 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Number of transaction pools: 1 2026-07-03 06:57:41.795106 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Using AVX512 instructions 2026-07-03 06:57:41.795116 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts) 2026-07-03 06:57:41.795126 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Using liburing 2026-07-03 06:57:41.795146 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB 2026-07-03 06:57:41.795295 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Completed initialization of buffer pool 2026-07-03 06:57:41.795307 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-07-03 06:57:41.795317 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: End of log at LSN=60367 2026-07-03 06:57:41.795327 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Resizing redo log from 12.016KiB to 96.000MiB; LSN=60367 2026-07-03 06:57:41.795337 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2026-07-03 06:57:41.795346 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Opened 3 undo tablespaces 2026-07-03 06:57:41.795356 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. 2026-07-03 06:57:41.795375 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2026-07-03 06:57:41.795391 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2026-07-03 06:57:41.795401 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: log sequence number 60367; transaction id 34 2026-07-03 06:57:41.795477 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] Plugin 'FEEDBACK' is disabled. 2026-07-03 06:57:41.795489 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2026-07-03 06:57:41.795499 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] InnoDB: Cannot open '/var/lib/mysql/ib_buffer_pool' for reading: No such file or directory 2026-07-03 06:57:41.795509 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] Server socket created on IP: '0.0.0.0'. 2026-07-03 06:57:41.795518 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] Server socket created on IP: '::'. 2026-07-03 06:57:41.795561 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] mariadbd: Event Scheduler: Loaded 0 events 2026-07-03 06:57:41.795571 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2026-07-03 06:57:41.795580 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Server initialized 2026-07-03 06:57:41.795590 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Server status change initializing -> initialized 2026-07-03 06:57:41.795600 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: Recovered position from storage: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795609 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: Server status change initialized -> joined 2026-07-03 06:57:41.795619 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: Recovered view from SST: 2026-07-03 06:57:41.795629 | ubuntu-noble-large | id: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795638 | ubuntu-noble-large | status: primary 2026-07-03 06:57:41.795648 | ubuntu-noble-large | protocol_version: 4 2026-07-03 06:57:41.795658 | ubuntu-noble-large | capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO 2026-07-03 06:57:41.795668 | ubuntu-noble-large | final: no 2026-07-03 06:57:41.795678 | ubuntu-noble-large | own_index: 2 2026-07-03 06:57:41.795687 | ubuntu-noble-large | members(3): 2026-07-03 06:57:41.795697 | ubuntu-noble-large | 0: 74715322-76aa-11f1-a6c8-62ca602be188, openstack-db-0 2026-07-03 06:57:41.795707 | ubuntu-noble-large | 1: 89b29eee-76aa-11f1-8dce-768ae6febba1, openstack-db-1 2026-07-03 06:57:41.795716 | ubuntu-noble-large | 2: 9db38154-76aa-11f1-a0e4-5f77cf226244, openstack-db-2 2026-07-03 06:57:41.795728 | ubuntu-noble-large | 2026-07-03 06:57:41.795739 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.795749 | ubuntu-noble-large | 2026-07-03 6:44:39 6 [Note] WSREP: Recovered cluster id 747a920c-76aa-11f1-8105-5b9b008b772f 2026-07-03 06:57:41.795758 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: SST received: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795768 | ubuntu-noble-large | 2026-07-03 6:44:39 3 [Note] WSREP: SST succeeded for position 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795778 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Installed new state from SST: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795788 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Joiner monitor thread ended with total time 18 sec 2026-07-03 06:57:41.795798 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Cert. index preload up to 3 2026-07-03 06:57:41.795808 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: ####### IST applying starts with 4 2026-07-03 06:57:41.795818 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: ####### IST current seqno initialized to 3 2026-07-03 06:57:41.795828 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2026-07-03 06:57:41.795837 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: IST preload starting at 3 2026-07-03 06:57:41.795847 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:41.795857 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.795867 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: ####### Assign initial position for certification: 747a920c-76aa-11f1-8105-5b9b008b772f:2, protocol version: 6 2026-07-03 06:57:41.795885 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: REPL Protocols: 11 (6) 2026-07-03 06:57:41.795895 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: ####### Adjusting cert position: 2 -> 3 2026-07-03 06:57:41.795905 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Service thread queue flushed. 2026-07-03 06:57:41.795926 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 3 2026-07-03 06:57:41.795937 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Min available from gcache for CC from preload: 3 2026-07-03 06:57:41.795947 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Receiving IST... 100.0% (1/1 events) complete. 2026-07-03 06:57:41.795957 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: IST received: 747a920c-76aa-11f1-8105-5b9b008b772f:3 2026-07-03 06:57:41.795966 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 3 2026-07-03 06:57:41.795976 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Min available from gcache for CC from sst: 3 2026-07-03 06:57:41.795986 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: 2.0 (openstack-db-2): State transfer from 0.0 (openstack-db-0) complete. 2026-07-03 06:57:41.795996 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 3) 2026-07-03 06:57:41.796005 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] mariadbd: ready for connections. 2026-07-03 06:57:41.796015 | ubuntu-noble-large | Version: '11.4.5-MariaDB-ubu2404' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2026-07-03 06:57:41.796025 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. 2026-07-03 06:57:41.796035 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Member 2.0 (openstack-db-2) synced with group. 2026-07-03 06:57:41.796045 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Processing event queue:... 100.0% (1/1 events) complete. 2026-07-03 06:57:41.796062 | ubuntu-noble-large | 2026-07-03 6:44:39 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 3) 2026-07-03 06:57:41.796071 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Server openstack-db-2 synced with group 2026-07-03 06:57:41.796081 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Server status change joined -> synced 2026-07-03 06:57:41.796091 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: Synchronized with group, ready for connections 2026-07-03 06:57:41.796101 | ubuntu-noble-large | 2026-07-03 6:44:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2026-07-03 06:57:41.796111 | ubuntu-noble-large | 2026-07-03 6:45:44 22 [Warning] Aborted connection 22 to db: 'keystone' user: 'controlplane-keystone' host: '10.244.0.46' (Got an error reading communication packets) 2026-07-03 06:57:41.802559 | ubuntu-noble-large | {"level":"info","ts":1783061052.2546434,"msg":"Agent starting"} 2026-07-03 06:57:41.802627 | ubuntu-noble-large | {"level":"info","ts":1783061052.255039,"logger":"api","msg":"Configuring Kubernetes authentication"} 2026-07-03 06:57:41.802639 | ubuntu-noble-large | {"level":"info","ts":1783061052.257132,"logger":"api","msg":"Configuring TLS"} 2026-07-03 06:57:41.802648 | ubuntu-noble-large | {"level":"info","ts":1783061052.259177,"logger":"probe","msg":"Server listening","addr":":5566","tls":false} 2026-07-03 06:57:41.802658 | ubuntu-noble-large | {"level":"info","ts":1783061052.2591774,"logger":"api","msg":"Server listening","addr":":5555","tls":true} 2026-07-03 06:57:41.802671 | ubuntu-noble-large | {"level":"error","ts":1783061071.4611948,"logger":"probe.liveness","msg":"error getting SQL client","error":"dial tcp [::1]:3306: connect: connection refused","stacktrace":"github.com/mariadb-operator/mariadb-operator/pkg/galera/agent/handler.(*Probe).Liveness\n\t/app/pkg/galera/agent/handler/probe.go:67\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).routeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:480\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.Recoverer.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/recoverer.go:45\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5/middleware.(*Compressor).Handler-fm.(*Compressor).Handler.func1\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/middleware/compress.go:209\nnet/http.HandlerFunc.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:2294\ngithub.com/go-chi/chi/v5.(*Mux).ServeHTTP\n\t/go/pkg/mod/github.com/go-chi/chi/v5@v5.2.1/mux.go:90\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/go/src/net/http/server.go:3301\nnet/http.(*conn).serve\n\t/usr/local/go/src/net/http/server.go:2102"} 2026-07-03 06:57:41.802710 | ubuntu-noble-large | 2026/07/03 06:44:41 "DELETE https://openstack-db-2.openstack-db-internal.openstack.svc.cluster.local:5555/api/galera/bootstrap HTTP/1.1" from 10.244.0.19:42322 - 404 41B in 6.559373ms 2026-07-03 06:57:41.806349 | ubuntu-noble-large | --- logs pod/openstack-db-2 (previous) --- 2026-07-03 06:57:41.919740 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "agent" in pod "openstack-db-2" not found 2026-07-03 06:57:41.925061 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-9ms7j --- 2026-07-03 06:57:42.053683 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-9ms7j 2026-07-03 06:57:42.053855 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:42.053870 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:42.053878 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:42.053884 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:42.053892 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:42:38 +0000 2026-07-03 06:57:42.053899 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-07-03 06:57:42.053908 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-07-03 06:57:42.053915 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-07-03 06:57:42.053922 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-07-03 06:57:42.053929 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-07-03 06:57:42.053935 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:42.053940 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:42.053946 | ubuntu-noble-large | IP: 10.244.0.34 2026-07-03 06:57:42.053952 | ubuntu-noble-large | IPs: 2026-07-03 06:57:42.053959 | ubuntu-noble-large | IP: 10.244.0.34 2026-07-03 06:57:42.053965 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-07-03 06:57:42.053971 | ubuntu-noble-large | Containers: 2026-07-03 06:57:42.053976 | ubuntu-noble-large | memcached: 2026-07-03 06:57:42.053983 | ubuntu-noble-large | Container ID: containerd://0836112b5ebe48a02f2e154c00556d8e8fdd133b5e9b538262aa9e06b35227d2 2026-07-03 06:57:42.053989 | ubuntu-noble-large | Image: memcached:1.6 2026-07-03 06:57:42.053995 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-07-03 06:57:42.054002 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-07-03 06:57:42.054008 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-07-03 06:57:42.054013 | ubuntu-noble-large | Args: 2026-07-03 06:57:42.054019 | ubuntu-noble-large | -m 2026-07-03 06:57:42.054025 | ubuntu-noble-large | 64 2026-07-03 06:57:42.054030 | ubuntu-noble-large | -c 2026-07-03 06:57:42.054036 | ubuntu-noble-large | 1024 2026-07-03 06:57:42.054041 | ubuntu-noble-large | -t 2026-07-03 06:57:42.054047 | ubuntu-noble-large | 4 2026-07-03 06:57:42.054053 | ubuntu-noble-large | -I 2026-07-03 06:57:42.054058 | ubuntu-noble-large | 1m 2026-07-03 06:57:42.054064 | ubuntu-noble-large | State: Running 2026-07-03 06:57:42.054069 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:42:43 +0000 2026-07-03 06:57:42.054075 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:42.054081 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:42.054087 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:42.054092 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-07-03 06:57:42.054098 | ubuntu-noble-large | Environment: 2026-07-03 06:57:42.054104 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:42.054122 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-kzbkx (ro) 2026-07-03 06:57:42.054128 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:42.054134 | ubuntu-noble-large | Type Status 2026-07-03 06:57:42.054140 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:42.054145 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:42.054151 | ubuntu-noble-large | Ready True 2026-07-03 06:57:42.054157 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:42.054162 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:42.054168 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:42.054192 | ubuntu-noble-large | kube-api-access-kzbkx: 2026-07-03 06:57:42.054197 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:42.054203 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:42.054209 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:42.054215 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:42.054220 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:42.054226 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:42.054232 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:42.054237 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:42.054243 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:42.054249 | ubuntu-noble-large | Events: 2026-07-03 06:57:42.054255 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:42.054260 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:42.054266 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-9ms7j to forge-control-plane 2026-07-03 06:57:42.054282 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-07-03 06:57:42.054289 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 697ms (4.614s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:42.054302 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{memcached}: Container created 2026-07-03 06:57:42.054308 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{memcached}: Container started 2026-07-03 06:57:42.059384 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-9ms7j (current) --- 2026-07-03 06:57:42.187408 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-9ms7j (previous) --- 2026-07-03 06:57:42.304337 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-9ms7j" not found 2026-07-03 06:57:42.308512 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-lq5jq --- 2026-07-03 06:57:42.420119 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-lq5jq 2026-07-03 06:57:42.420208 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:42.420222 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:42.420281 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:42.420291 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:42.420303 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:42:38 +0000 2026-07-03 06:57:42.420313 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-07-03 06:57:42.420323 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-07-03 06:57:42.420333 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-07-03 06:57:42.420343 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-07-03 06:57:42.420353 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-07-03 06:57:42.420363 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:42.420373 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:42.420383 | ubuntu-noble-large | IP: 10.244.0.32 2026-07-03 06:57:42.420393 | ubuntu-noble-large | IPs: 2026-07-03 06:57:42.420403 | ubuntu-noble-large | IP: 10.244.0.32 2026-07-03 06:57:42.420413 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-07-03 06:57:42.420424 | ubuntu-noble-large | Containers: 2026-07-03 06:57:42.420434 | ubuntu-noble-large | memcached: 2026-07-03 06:57:42.420475 | ubuntu-noble-large | Container ID: containerd://409c66f81b79cdfdf8f74ed8b5c14ef1b68eff005d353d0bb3f8330cef268a63 2026-07-03 06:57:42.420487 | ubuntu-noble-large | Image: memcached:1.6 2026-07-03 06:57:42.420497 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-07-03 06:57:42.420508 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-07-03 06:57:42.420577 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-07-03 06:57:42.420594 | ubuntu-noble-large | Args: 2026-07-03 06:57:42.420604 | ubuntu-noble-large | -m 2026-07-03 06:57:42.420614 | ubuntu-noble-large | 64 2026-07-03 06:57:42.420624 | ubuntu-noble-large | -c 2026-07-03 06:57:42.420665 | ubuntu-noble-large | 1024 2026-07-03 06:57:42.420675 | ubuntu-noble-large | -t 2026-07-03 06:57:42.420685 | ubuntu-noble-large | 4 2026-07-03 06:57:42.420695 | ubuntu-noble-large | -I 2026-07-03 06:57:42.420705 | ubuntu-noble-large | 1m 2026-07-03 06:57:42.420715 | ubuntu-noble-large | State: Running 2026-07-03 06:57:42.420725 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:42:43 +0000 2026-07-03 06:57:42.420735 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:42.420745 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:42.420755 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:42.420766 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-07-03 06:57:42.420776 | ubuntu-noble-large | Environment: 2026-07-03 06:57:42.420786 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:42.420796 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-z9cgz (ro) 2026-07-03 06:57:42.420806 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:42.420816 | ubuntu-noble-large | Type Status 2026-07-03 06:57:42.420826 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:42.420836 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:42.420847 | ubuntu-noble-large | Ready True 2026-07-03 06:57:42.420857 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:42.420867 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:42.420876 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:42.420887 | ubuntu-noble-large | kube-api-access-z9cgz: 2026-07-03 06:57:42.420896 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:42.420907 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:42.420917 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:42.420926 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:42.420936 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:42.420946 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:42.420956 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:42.420993 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:42.421004 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:42.421014 | ubuntu-noble-large | Events: 2026-07-03 06:57:42.421024 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:42.421034 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:42.421044 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-lq5jq to forge-control-plane 2026-07-03 06:57:42.421056 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-07-03 06:57:42.421067 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 3.968s (3.968s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:42.421079 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{memcached}: Container created 2026-07-03 06:57:42.421089 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{memcached}: Container started 2026-07-03 06:57:42.423483 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-lq5jq (current) --- 2026-07-03 06:57:42.534701 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-lq5jq (previous) --- 2026-07-03 06:57:42.674609 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-lq5jq" not found 2026-07-03 06:57:42.677724 | ubuntu-noble-large | --- describe pod/openstack-memcached-f654cd846-nv658 --- 2026-07-03 06:57:42.814627 | ubuntu-noble-large | Name: openstack-memcached-f654cd846-nv658 2026-07-03 06:57:42.814723 | ubuntu-noble-large | Namespace: openstack 2026-07-03 06:57:42.814737 | ubuntu-noble-large | Priority: 0 2026-07-03 06:57:42.814748 | ubuntu-noble-large | Service Account: default 2026-07-03 06:57:42.814758 | ubuntu-noble-large | Node: forge-control-plane/172.18.0.2 2026-07-03 06:57:42.814769 | ubuntu-noble-large | Start Time: Fri, 03 Jul 2026 06:42:38 +0000 2026-07-03 06:57:42.814779 | ubuntu-noble-large | Labels: app.kubernetes.io/instance=openstack-memcached 2026-07-03 06:57:42.814790 | ubuntu-noble-large | app.kubernetes.io/managed-by=memcached-operator 2026-07-03 06:57:42.814830 | ubuntu-noble-large | app.kubernetes.io/name=memcached 2026-07-03 06:57:42.814841 | ubuntu-noble-large | app.kubernetes.io/version=1.6 2026-07-03 06:57:42.814851 | ubuntu-noble-large | pod-template-hash=f654cd846 2026-07-03 06:57:42.814861 | ubuntu-noble-large | Annotations: 2026-07-03 06:57:42.814871 | ubuntu-noble-large | Status: Running 2026-07-03 06:57:42.814881 | ubuntu-noble-large | IP: 10.244.0.33 2026-07-03 06:57:42.814891 | ubuntu-noble-large | IPs: 2026-07-03 06:57:42.814902 | ubuntu-noble-large | IP: 10.244.0.33 2026-07-03 06:57:42.814912 | ubuntu-noble-large | Controlled By: ReplicaSet/openstack-memcached-f654cd846 2026-07-03 06:57:42.814922 | ubuntu-noble-large | Containers: 2026-07-03 06:57:42.814932 | ubuntu-noble-large | memcached: 2026-07-03 06:57:42.814943 | ubuntu-noble-large | Container ID: containerd://226a0cef364f74d35c5ef2a5f6c7dcf94aff25e6aeb844783fed79949f8e26f3 2026-07-03 06:57:42.814954 | ubuntu-noble-large | Image: memcached:1.6 2026-07-03 06:57:42.814964 | ubuntu-noble-large | Image ID: docker.io/library/memcached@sha256:e2a8683c7fbb73d12dce8082525adf9df857765970e639bd9f4705acc31dfcba 2026-07-03 06:57:42.814975 | ubuntu-noble-large | Port: 11211/TCP (memcached) 2026-07-03 06:57:42.814985 | ubuntu-noble-large | Host Port: 0/TCP (memcached) 2026-07-03 06:57:42.814995 | ubuntu-noble-large | Args: 2026-07-03 06:57:42.815005 | ubuntu-noble-large | -m 2026-07-03 06:57:42.815015 | ubuntu-noble-large | 64 2026-07-03 06:57:42.815025 | ubuntu-noble-large | -c 2026-07-03 06:57:42.815035 | ubuntu-noble-large | 1024 2026-07-03 06:57:42.815045 | ubuntu-noble-large | -t 2026-07-03 06:57:42.815054 | ubuntu-noble-large | 4 2026-07-03 06:57:42.815064 | ubuntu-noble-large | -I 2026-07-03 06:57:42.815074 | ubuntu-noble-large | 1m 2026-07-03 06:57:42.815084 | ubuntu-noble-large | State: Running 2026-07-03 06:57:42.815094 | ubuntu-noble-large | Started: Fri, 03 Jul 2026 06:42:44 +0000 2026-07-03 06:57:42.815104 | ubuntu-noble-large | Ready: True 2026-07-03 06:57:42.815113 | ubuntu-noble-large | Restart Count: 0 2026-07-03 06:57:42.815123 | ubuntu-noble-large | Liveness: tcp-socket :memcached delay=10s timeout=1s period=10s #success=1 #failure=3 2026-07-03 06:57:42.815134 | ubuntu-noble-large | Readiness: tcp-socket :memcached delay=5s timeout=1s period=5s #success=1 #failure=3 2026-07-03 06:57:42.815143 | ubuntu-noble-large | Environment: 2026-07-03 06:57:42.815153 | ubuntu-noble-large | Mounts: 2026-07-03 06:57:42.815164 | ubuntu-noble-large | /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-rnsbk (ro) 2026-07-03 06:57:42.815174 | ubuntu-noble-large | Conditions: 2026-07-03 06:57:42.815184 | ubuntu-noble-large | Type Status 2026-07-03 06:57:42.815201 | ubuntu-noble-large | PodReadyToStartContainers True 2026-07-03 06:57:42.815219 | ubuntu-noble-large | Initialized True 2026-07-03 06:57:42.815235 | ubuntu-noble-large | Ready True 2026-07-03 06:57:42.815251 | ubuntu-noble-large | ContainersReady True 2026-07-03 06:57:42.815267 | ubuntu-noble-large | PodScheduled True 2026-07-03 06:57:42.815284 | ubuntu-noble-large | Volumes: 2026-07-03 06:57:42.815300 | ubuntu-noble-large | kube-api-access-rnsbk: 2026-07-03 06:57:42.815318 | ubuntu-noble-large | Type: Projected (a volume that contains injected data from multiple sources) 2026-07-03 06:57:42.815337 | ubuntu-noble-large | TokenExpirationSeconds: 3607 2026-07-03 06:57:42.815354 | ubuntu-noble-large | ConfigMapName: kube-root-ca.crt 2026-07-03 06:57:42.815371 | ubuntu-noble-large | Optional: false 2026-07-03 06:57:42.815389 | ubuntu-noble-large | DownwardAPI: true 2026-07-03 06:57:42.815406 | ubuntu-noble-large | QoS Class: BestEffort 2026-07-03 06:57:42.815423 | ubuntu-noble-large | Node-Selectors: 2026-07-03 06:57:42.815433 | ubuntu-noble-large | Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s 2026-07-03 06:57:42.815486 | ubuntu-noble-large | node.kubernetes.io/unreachable:NoExecute op=Exists for 300s 2026-07-03 06:57:42.815499 | ubuntu-noble-large | Events: 2026-07-03 06:57:42.815509 | ubuntu-noble-large | Type Reason Age From Message 2026-07-03 06:57:42.815519 | ubuntu-noble-large | ---- ------ ---- ---- ------- 2026-07-03 06:57:42.815574 | ubuntu-noble-large | Normal Scheduled 15m default-scheduler Successfully assigned openstack/openstack-memcached-f654cd846-nv658 to forge-control-plane 2026-07-03 06:57:42.815586 | ubuntu-noble-large | Normal Pulling 15m kubelet spec.containers{memcached}: Pulling image "memcached:1.6" 2026-07-03 06:57:42.815597 | ubuntu-noble-large | Normal Pulled 14m kubelet spec.containers{memcached}: Successfully pulled image "memcached:1.6" in 706ms (5.295s including waiting). Image size: 32221876 bytes. 2026-07-03 06:57:42.815621 | ubuntu-noble-large | Normal Created 14m kubelet spec.containers{memcached}: Container created 2026-07-03 06:57:42.815644 | ubuntu-noble-large | Normal Started 14m kubelet spec.containers{memcached}: Container started 2026-07-03 06:57:42.821409 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-nv658 (current) --- 2026-07-03 06:57:42.932084 | ubuntu-noble-large | --- logs pod/openstack-memcached-f654cd846-nv658 (previous) --- 2026-07-03 06:57:43.054375 | ubuntu-noble-large | Error from server (BadRequest): previous terminated container "memcached" in pod "openstack-memcached-f654cd846-nv658" not found 2026-07-03 06:57:43.058513 | ubuntu-noble-large | Deleting kind cluster forge 2026-07-03 06:57:43.091282 | ubuntu-noble-large | Deleting cluster "forge" ... 2026-07-03 06:57:45.834255 | ubuntu-noble-large | Deleted nodes: ["forge-control-plane"] 2026-07-03 06:57:45.840995 | ubuntu-noble-large | make: *** [Makefile:9: integration] Error 1 2026-07-03 06:57:46.247046 | ubuntu-noble-large | ERROR 2026-07-03 06:57:46.247570 | ubuntu-noble-large | { 2026-07-03 06:57:46.247670 | ubuntu-noble-large | "delta": "0:19:38.860365", 2026-07-03 06:57:46.247732 | ubuntu-noble-large | "end": "2026-07-03 06:57:45.841939", 2026-07-03 06:57:46.247786 | ubuntu-noble-large | "msg": "non-zero return code", 2026-07-03 06:57:46.247866 | ubuntu-noble-large | "rc": 2, 2026-07-03 06:57:46.247916 | ubuntu-noble-large | "start": "2026-07-03 06:38:06.981574" 2026-07-03 06:57:46.247975 | ubuntu-noble-large | } failure 2026-07-03 06:57:46.300946 | 2026-07-03 06:57:46.301181 | PLAY RECAP 2026-07-03 06:57:46.301319 | ubuntu-noble-large | ok: 1 changed: 1 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0 2026-07-03 06:57:46.301384 | 2026-07-03 06:57:46.483148 | RUN END RESULT_NORMAL: [untrusted : github.com/osism/openstack-project-manager/playbooks/test-integration.yml@main] 2026-07-03 06:57:46.484589 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-07-03 06:57:47.307729 | 2026-07-03 06:57:47.307997 | PLAY [Base post-fetch] 2026-07-03 06:57:47.325250 | 2026-07-03 06:57:47.325425 | TASK [diagnose-network : Ensure log directory exists] 2026-07-03 06:57:48.016431 | ubuntu-noble-large | ok 2026-07-03 06:57:48.036335 | 2026-07-03 06:57:48.036675 | TASK [diagnose-network : Snapshot dual-stack network state (post)] 2026-07-03 06:58:00.054408 | ubuntu-noble-large | ok: Runtime: 0:00:05.971887 2026-07-03 06:58:00.065407 | 2026-07-03 06:58:00.065597 | TASK [diagnose-network : Snapshot Docker/BuildKit IPv6 config (teardown)] 2026-07-03 06:58:06.230949 | ubuntu-noble-large | ok: Runtime: 0:00:00.422858 2026-07-03 06:58:06.239641 | 2026-07-03 06:58:06.239841 | TASK [diagnose-network : Probe container network namespace (teardown)] 2026-07-03 06:58:12.377745 | ubuntu-noble-large | ok: Runtime: 0:00:00.873053 2026-07-03 06:58:12.392256 | 2026-07-03 06:58:12.392384 | TASK [fetch-output : Set log path for multiple nodes] 2026-07-03 06:58:12.458122 | ubuntu-noble-large | skipping: Conditional result was False 2026-07-03 06:58:12.472857 | 2026-07-03 06:58:12.473032 | TASK [fetch-output : Set log path for single node] 2026-07-03 06:58:12.506266 | ubuntu-noble-large | ok 2026-07-03 06:58:12.511383 | 2026-07-03 06:58:12.511496 | LOOP [fetch-output : Ensure local output dirs] 2026-07-03 06:58:12.837034 | ubuntu-noble-large -> localhost | ok: "/var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/logs" 2026-07-03 06:58:13.100160 | ubuntu-noble-large -> localhost | changed: "/var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/artifacts" 2026-07-03 06:58:13.379365 | ubuntu-noble-large -> localhost | changed: "/var/lib/zuul/builds/c9c5cd8522ea434c8c5b4597d5632050/work/docs" 2026-07-03 06:58:13.400503 | 2026-07-03 06:58:13.400668 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-07-03 06:58:14.240842 | ubuntu-noble-large | changed: 2026-07-03 06:58:14.241330 | ubuntu-noble-large | .d..t...... ./ 2026-07-03 06:58:14.241428 | ubuntu-noble-large | >f+++++++++ net-debug.post.txt 2026-07-03 06:58:14.241480 | ubuntu-noble-large | >f+++++++++ net-debug.pre.txt 2026-07-03 06:58:14.241520 | ubuntu-noble-large | >f+++++++++ sudo-debug.txt 2026-07-03 06:58:14.241559 | ubuntu-noble-large | >f+++++++++ sudo-strace.log 2026-07-03 06:58:14.241597 | ubuntu-noble-large | >f+++++++++ sudo-strace.log.time 2026-07-03 06:58:14.241674 | ubuntu-noble-large | changed: All items complete 2026-07-03 06:58:14.241722 | 2026-07-03 06:58:14.891776 | ubuntu-noble-large | changed: .d..t...... ./ 2026-07-03 06:58:15.510148 | ubuntu-noble-large | changed: .d..t...... ./ 2026-07-03 06:58:15.524377 | 2026-07-03 06:58:15.524518 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-07-03 06:58:15.908875 | ubuntu-noble-large -> localhost | ok: Item: artifacts Runtime: 0:00:00.011294 2026-07-03 06:58:16.206296 | ubuntu-noble-large -> localhost | ok: Item: docs Runtime: 0:00:00.011406 2026-07-03 06:58:16.223760 | 2026-07-03 06:58:16.223929 | PLAY RECAP 2026-07-03 06:58:16.224016 | ubuntu-noble-large | ok: 8 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-07-03 06:58:16.224057 | 2026-07-03 06:58:16.372713 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post-fetch.yaml@main] 2026-07-03 06:58:16.373703 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-07-03 06:58:17.184085 | 2026-07-03 06:58:17.184282 | PLAY [Base post] 2026-07-03 06:58:17.198611 | 2026-07-03 06:58:17.198763 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-07-03 06:58:18.052261 | ubuntu-noble-large | changed 2026-07-03 06:58:18.061949 | 2026-07-03 06:58:18.062101 | PLAY RECAP 2026-07-03 06:58:18.062183 | ubuntu-noble-large | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-07-03 06:58:18.062264 | 2026-07-03 06:58:18.232924 | POST-RUN END RESULT_NORMAL: [trusted : github.com/osism/zuul-config/playbooks/base/post.yaml@main] 2026-07-03 06:58:18.234776 | POST-RUN START: [trusted : github.com/osism/zuul-config/playbooks/base/post-logs.yaml@main] 2026-07-03 06:58:19.111009 | 2026-07-03 06:58:19.111221 | PLAY [Base post-logs] 2026-07-03 06:58:19.122913 | 2026-07-03 06:58:19.123071 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-07-03 06:58:19.637179 | localhost | changed 2026-07-03 06:58:19.647956 | 2026-07-03 06:58:19.648121 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-07-03 06:58:19.687215 | localhost | ok 2026-07-03 06:58:19.694912 | 2026-07-03 06:58:19.695098 | TASK [Set zuul-log-path fact] 2026-07-03 06:58:19.725314 | localhost | ok 2026-07-03 06:58:19.742418 | 2026-07-03 06:58:19.742600 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-07-03 06:58:19.781037 | localhost | ok 2026-07-03 06:58:19.787284 | 2026-07-03 06:58:19.787578 | TASK [upload-logs : Create log directories] 2026-07-03 06:58:20.373527 | localhost | changed 2026-07-03 06:58:20.378619 | 2026-07-03 06:58:20.378803 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-07-03 06:58:20.975540 | localhost -> localhost | ok: Runtime: 0:00:00.009409 2026-07-03 06:58:20.989659 | 2026-07-03 06:58:20.989883 | TASK [upload-logs : Upload logs to log server] 2026-07-03 06:58:21.619873 | localhost | Output suppressed because no_log was given 2026-07-03 06:58:21.624532 | 2026-07-03 06:58:21.624730 | LOOP [upload-logs : Compress console log and json output] 2026-07-03 06:58:21.681366 | localhost | skipping: Conditional result was False 2026-07-03 06:58:21.686592 | localhost | skipping: Conditional result was False 2026-07-03 06:58:21.699479 | 2026-07-03 06:58:21.699680 | LOOP [upload-logs : Upload compressed console log and json output] 2026-07-03 06:58:21.763448 | localhost | skipping: Conditional result was False 2026-07-03 06:58:21.764210 | 2026-07-03 06:58:21.767606 | localhost | skipping: Conditional result was False 2026-07-03 06:58:21.775633 | 2026-07-03 06:58:21.775989 | LOOP [upload-logs : Upload console log and json output]